INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:58186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39936 - "GET /node/699397eacebe99dd8e074a7a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51446 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:37:33,871 - lava_callback - INFO - Received callback for node 69caa64b4b5e3e0ab6a60bb2 2026-03-30 16:37:33,878 - lava_callback - INFO - Starting async job submit for node 69caa64b4b5e3e0ab6a60bb2 INFO: 172.20.0.1:51460 - "POST /node/69caa64b4b5e3e0ab6a60bb2 HTTP/1.0" 202 Accepted 2026-03-30 16:37:33,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:37:33,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa64b4b5e3e0ab6a60bb2 HTTP/1.1" 200 None 2026-03-30 16:37:33,922 - lava_callback - DEBUG - Processing node 69caa64b4b5e3e0ab6a60bb2: baseline-arm 2026-03-30 16:37:34,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:37:34,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:37:34,320 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69caa64b4b5e3e0ab6a60bb2/log.txt.gz 2026-03-30 16:37:34,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:37:34,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:37:34,699 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69caa64b4b5e3e0ab6a60bb2/lava-logs.yaml 2026-03-30 16:37:34,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:37:34,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:37:34,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69caa64b4b5e3e0ab6a60bb2/lava_callback.json.gz 2026-03-30 16:37:34,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:37:34,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa64b4b5e3e0ab6a60bb2 HTTP/1.1" 200 None 2026-03-30 16:37:34,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:37:34,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2504b5e3e0ab6a60b5d HTTP/1.1" 200 None 2026-03-30 16:37:34,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:37:34,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa64b4b5e3e0ab6a60bb2 HTTP/1.1" 200 None 2026-03-30 16:37:34,962 - lava_callback - INFO - Completed processing callback for node 69caa64b4b5e3e0ab6a60bb2 INFO: 172.20.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40194 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:38:04,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:38:05,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37650 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:41:45,773 - lava_callback - INFO - Received callback for node 69c804c0123b47fd2376fed5 INFO: 172.20.0.1:39852 - "POST /node/69c804c0123b47fd2376fed5 HTTP/1.0" 202 Accepted 2026-03-30 16:41:45,779 - lava_callback - INFO - Starting async job submit for node 69c804c0123b47fd2376fed5 2026-03-30 16:41:45,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:45,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c0123b47fd2376fed5 HTTP/1.1" 200 None 2026-03-30 16:41:45,796 - lava_callback - DEBUG - Processing node 69c804c0123b47fd2376fed5: baseline-arm-clabbe 2026-03-30 16:41:45,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c804c0123b47fd2376fed5 2026-03-30 16:41:45,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:45,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c0123b47fd2376fed5 HTTP/1.1" 200 None 2026-03-30 16:41:45,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:45,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-30 16:41:45,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:45,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804c0123b47fd2376fed5 HTTP/1.1" 200 None 2026-03-30 16:41:45,870 - lava_callback - ERROR - Error processing callback for node 69c804c0123b47fd2376fed5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 16:41:46,457 - lava_callback - INFO - Received callback for node 69c804c5123b47fd2376fee2 INFO: 172.20.0.1:39860 - "POST /node/69c804c5123b47fd2376fee2 HTTP/1.0" 202 Accepted 2026-03-30 16:41:46,463 - lava_callback - INFO - Starting async job submit for node 69c804c5123b47fd2376fee2 2026-03-30 16:41:46,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:46,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c5123b47fd2376fee2 HTTP/1.1" 200 None 2026-03-30 16:41:46,493 - lava_callback - DEBUG - Processing node 69c804c5123b47fd2376fee2: baseline-arm-clabbe 2026-03-30 16:41:46,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c804c5123b47fd2376fee2 2026-03-30 16:41:46,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:39874 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:41:46,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c5123b47fd2376fee2 HTTP/1.1" 200 None 2026-03-30 16:41:46,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:46,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-30 16:41:46,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:46,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804c5123b47fd2376fee2 HTTP/1.1" 200 None 2026-03-30 16:41:46,546 - lava_callback - ERROR - Error processing callback for node 69c804c5123b47fd2376fee2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 16:41:47,136 - lava_callback - INFO - Received callback for node 69c804c6123b47fd2376fee5 INFO: 172.20.0.1:39876 - "POST /node/69c804c6123b47fd2376fee5 HTTP/1.0" 202 Accepted 2026-03-30 16:41:47,141 - lava_callback - INFO - Starting async job submit for node 69c804c6123b47fd2376fee5 2026-03-30 16:41:47,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:47,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c6123b47fd2376fee5 HTTP/1.1" 200 None 2026-03-30 16:41:47,158 - lava_callback - DEBUG - Processing node 69c804c6123b47fd2376fee5: baseline-arm-clabbe 2026-03-30 16:41:47,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c804c6123b47fd2376fee5 2026-03-30 16:41:47,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:47,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c6123b47fd2376fee5 HTTP/1.1" 200 None 2026-03-30 16:41:47,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:47,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-30 16:41:47,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:47,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804c6123b47fd2376fee5 HTTP/1.1" 200 None 2026-03-30 16:41:47,220 - lava_callback - ERROR - Error processing callback for node 69c804c6123b47fd2376fee5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 16:41:47,816 - lava_callback - INFO - Received callback for node 69c804c7123b47fd2376fee8 INFO: 172.20.0.1:39892 - "POST /node/69c804c7123b47fd2376fee8 HTTP/1.0" 202 Accepted 2026-03-30 16:41:47,822 - lava_callback - INFO - Starting async job submit for node 69c804c7123b47fd2376fee8 2026-03-30 16:41:47,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:47,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c7123b47fd2376fee8 HTTP/1.1" 200 None 2026-03-30 16:41:47,837 - lava_callback - DEBUG - Processing node 69c804c7123b47fd2376fee8: baseline-arm-clabbe 2026-03-30 16:41:47,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c804c7123b47fd2376fee8 2026-03-30 16:41:47,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:47,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804c7123b47fd2376fee8 HTTP/1.1" 200 None 2026-03-30 16:41:47,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:47,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-30 16:41:47,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:41:47,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804c7123b47fd2376fee8 HTTP/1.1" 200 None 2026-03-30 16:41:47,890 - lava_callback - ERROR - Error processing callback for node 69c804c7123b47fd2376fee8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50694 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:42:05,729 - lava_callback - INFO - Received callback for node 69c804ca123b47fd2376fef1 INFO: 172.20.0.1:48198 - "POST /node/69c804ca123b47fd2376fef1 HTTP/1.0" 202 Accepted 2026-03-30 16:42:05,734 - lava_callback - INFO - Starting async job submit for node 69c804ca123b47fd2376fef1 2026-03-30 16:42:05,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:42:05,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ca123b47fd2376fef1 HTTP/1.1" 200 None 2026-03-30 16:42:05,751 - lava_callback - DEBUG - Processing node 69c804ca123b47fd2376fef1: baseline-arm-clabbe 2026-03-30 16:42:05,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c804ca123b47fd2376fef1 2026-03-30 16:42:05,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:42:05,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c804ca123b47fd2376fef1 HTTP/1.1" 200 None 2026-03-30 16:42:05,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:42:05,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-30 16:42:05,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:42:05,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c804ca123b47fd2376fef1 HTTP/1.1" 200 None 2026-03-30 16:42:05,801 - lava_callback - ERROR - Error processing callback for node 69c804ca123b47fd2376fef1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37694 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:47:14,803 - lava_callback - INFO - Received callback for node 69c8060e123b47fd23770092 INFO: 172.20.0.1:58572 - "POST /node/69c8060e123b47fd23770092 HTTP/1.0" 202 Accepted 2026-03-30 16:47:14,808 - lava_callback - INFO - Starting async job submit for node 69c8060e123b47fd23770092 2026-03-30 16:47:14,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:47:14,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8060e123b47fd23770092 HTTP/1.1" 200 None 2026-03-30 16:47:14,825 - lava_callback - DEBUG - Processing node 69c8060e123b47fd23770092: baseline-arm-baylibre 2026-03-30 16:47:14,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8060e123b47fd23770092 2026-03-30 16:47:14,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:47:14,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8060e123b47fd23770092 HTTP/1.1" 200 None 2026-03-30 16:47:14,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:47:14,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 16:47:14,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:47:14,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8060e123b47fd23770092 HTTP/1.1" 200 None 2026-03-30 16:47:14,884 - lava_callback - ERROR - Error processing callback for node 69c8060e123b47fd23770092: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36414 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:48:34,801 - lava_callback - INFO - Received callback for node 69c8065a123b47fd237700b7 INFO: 172.20.0.1:36430 - "POST /node/69c8065a123b47fd237700b7 HTTP/1.0" 202 Accepted 2026-03-30 16:48:34,806 - lava_callback - INFO - Starting async job submit for node 69c8065a123b47fd237700b7 2026-03-30 16:48:34,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:48:34,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8065a123b47fd237700b7 HTTP/1.1" 200 None 2026-03-30 16:48:35,001 - lava_callback - DEBUG - Processing node 69c8065a123b47fd237700b7: baseline-arm-baylibre 2026-03-30 16:48:35,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8065a123b47fd237700b7 2026-03-30 16:48:35,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:48:35,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8065a123b47fd237700b7 HTTP/1.1" 200 None 2026-03-30 16:48:35,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:48:35,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 16:48:35,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:48:35,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8065a123b47fd237700b7 HTTP/1.1" 200 None 2026-03-30 16:48:35,144 - lava_callback - ERROR - Error processing callback for node 69c8065a123b47fd237700b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48452 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:49:14,790 - lava_callback - INFO - Received callback for node 69c80681123b47fd237700bf INFO: 172.20.0.1:48740 - "POST /node/69c80681123b47fd237700bf HTTP/1.0" 202 Accepted 2026-03-30 16:49:14,796 - lava_callback - INFO - Starting async job submit for node 69c80681123b47fd237700bf 2026-03-30 16:49:14,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:49:14,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80681123b47fd237700bf HTTP/1.1" 200 None 2026-03-30 16:49:14,813 - lava_callback - DEBUG - Processing node 69c80681123b47fd237700bf: baseline-arm-baylibre 2026-03-30 16:49:14,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80681123b47fd237700bf 2026-03-30 16:49:14,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:49:14,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80681123b47fd237700bf HTTP/1.1" 200 None 2026-03-30 16:49:14,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:49:14,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 16:49:14,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:49:14,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80681123b47fd237700bf HTTP/1.1" 200 None 2026-03-30 16:49:14,871 - lava_callback - ERROR - Error processing callback for node 69c80681123b47fd237700bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37060 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:50:34,919 - lava_callback - INFO - Received callback for node 69c806cf123b47fd237700dc INFO: 172.20.0.1:37074 - "POST /node/69c806cf123b47fd237700dc HTTP/1.0" 202 Accepted 2026-03-30 16:50:34,925 - lava_callback - INFO - Starting async job submit for node 69c806cf123b47fd237700dc 2026-03-30 16:50:34,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:50:34,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c806cf123b47fd237700dc HTTP/1.1" 200 None 2026-03-30 16:50:34,954 - lava_callback - DEBUG - Processing node 69c806cf123b47fd237700dc: baseline-arm-baylibre 2026-03-30 16:50:34,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c806cf123b47fd237700dc 2026-03-30 16:50:34,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:50:34,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c806cf123b47fd237700dc HTTP/1.1" 200 None 2026-03-30 16:50:34,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:50:34,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 16:50:34,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:50:35,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c806cf123b47fd237700dc HTTP/1.1" 200 None 2026-03-30 16:50:35,022 - lava_callback - ERROR - Error processing callback for node 69c806cf123b47fd237700dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48270 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:51:54,941 - lava_callback - INFO - Received callback for node 69c8071d123b47fd2377010e INFO: 172.20.0.1:42184 - "POST /node/69c8071d123b47fd2377010e HTTP/1.0" 202 Accepted 2026-03-30 16:51:54,950 - lava_callback - INFO - Starting async job submit for node 69c8071d123b47fd2377010e 2026-03-30 16:51:54,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:51:54,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8071d123b47fd2377010e HTTP/1.1" 200 None 2026-03-30 16:51:54,974 - lava_callback - DEBUG - Processing node 69c8071d123b47fd2377010e: baseline-arm-baylibre 2026-03-30 16:51:54,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8071d123b47fd2377010e 2026-03-30 16:51:54,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:51:55,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8071d123b47fd2377010e HTTP/1.1" 200 None 2026-03-30 16:51:55,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:51:55,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 16:51:55,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:51:55,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8071d123b47fd2377010e HTTP/1.1" 200 None 2026-03-30 16:51:55,087 - lava_callback - ERROR - Error processing callback for node 69c8071d123b47fd2377010e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55902 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:53:15,151 - lava_callback - INFO - Received callback for node 69c80766123b47fd23770178 INFO: 172.20.0.1:51804 - "POST /node/69c80766123b47fd23770178 HTTP/1.0" 202 Accepted 2026-03-30 16:53:15,158 - lava_callback - INFO - Starting async job submit for node 69c80766123b47fd23770178 INFO: 172.20.0.1:51812 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 16:53:15,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:15,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80766123b47fd23770178 HTTP/1.1" 200 None 2026-03-30 16:53:15,187 - lava_callback - DEBUG - Processing node 69c80766123b47fd23770178: baseline-arm-baylibre 2026-03-30 16:53:15,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80766123b47fd23770178 2026-03-30 16:53:15,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:15,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80766123b47fd23770178 HTTP/1.1" 200 None 2026-03-30 16:53:15,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:15,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 16:53:15,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:15,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80766123b47fd23770178 HTTP/1.1" 200 None 2026-03-30 16:53:15,274 - lava_callback - ERROR - Error processing callback for node 69c80766123b47fd23770178: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 16:53:15,836 - lava_callback - INFO - Received callback for node 69c80778123b47fd237701c0 INFO: 172.20.0.1:51814 - "POST /node/69c80778123b47fd237701c0 HTTP/1.0" 202 Accepted 2026-03-30 16:53:15,846 - lava_callback - INFO - Starting async job submit for node 69c80778123b47fd237701c0 2026-03-30 16:53:15,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:15,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80778123b47fd237701c0 HTTP/1.1" 200 None 2026-03-30 16:53:15,869 - lava_callback - DEBUG - Processing node 69c80778123b47fd237701c0: baseline-arm64-baylibre 2026-03-30 16:53:15,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80778123b47fd237701c0 2026-03-30 16:53:15,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:15,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80778123b47fd237701c0 HTTP/1.1" 200 None 2026-03-30 16:53:15,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:15,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 16:53:15,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:15,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80778123b47fd237701c0 HTTP/1.1" 200 None 2026-03-30 16:53:15,958 - lava_callback - ERROR - Error processing callback for node 69c80778123b47fd237701c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51824 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:53:16,532 - lava_callback - INFO - Received callback for node 69c80772123b47fd237701b6 INFO: 172.20.0.1:51828 - "POST /node/69c80772123b47fd237701b6 HTTP/1.0" 202 Accepted 2026-03-30 16:53:16,543 - lava_callback - INFO - Starting async job submit for node 69c80772123b47fd237701b6 2026-03-30 16:53:16,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:16,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80772123b47fd237701b6 HTTP/1.1" 200 None 2026-03-30 16:53:16,568 - lava_callback - DEBUG - Processing node 69c80772123b47fd237701b6: baseline-arm64-baylibre 2026-03-30 16:53:16,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80772123b47fd237701b6 2026-03-30 16:53:16,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:16,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80772123b47fd237701b6 HTTP/1.1" 200 None 2026-03-30 16:53:16,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:16,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 16:53:16,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:16,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80772123b47fd237701b6 HTTP/1.1" 200 None 2026-03-30 16:53:16,675 - lava_callback - ERROR - Error processing callback for node 69c80772123b47fd237701b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 16:53:17,197 - lava_callback - INFO - Received callback for node 69c80776123b47fd237701bd INFO: 172.20.0.1:51838 - "POST /node/69c80776123b47fd237701bd HTTP/1.0" 202 Accepted 2026-03-30 16:53:17,207 - lava_callback - INFO - Starting async job submit for node 69c80776123b47fd237701bd 2026-03-30 16:53:17,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:17,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80776123b47fd237701bd HTTP/1.1" 200 None 2026-03-30 16:53:17,231 - lava_callback - DEBUG - Processing node 69c80776123b47fd237701bd: baseline-arm64-baylibre 2026-03-30 16:53:17,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80776123b47fd237701bd 2026-03-30 16:53:17,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:17,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80776123b47fd237701bd HTTP/1.1" 200 None 2026-03-30 16:53:17,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:17,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 16:53:17,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:17,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80776123b47fd237701bd HTTP/1.1" 200 None 2026-03-30 16:53:17,320 - lava_callback - ERROR - Error processing callback for node 69c80776123b47fd237701bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56306 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:53:46,293 - lava_callback - INFO - Received callback for node 69c80787123b47fd23770206 INFO: 172.20.0.1:48078 - "POST /node/69c80787123b47fd23770206 HTTP/1.0" 202 Accepted 2026-03-30 16:53:46,303 - lava_callback - INFO - Starting async job submit for node 69c80787123b47fd23770206 2026-03-30 16:53:46,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:46,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80787123b47fd23770206 HTTP/1.1" 200 None 2026-03-30 16:53:46,332 - lava_callback - DEBUG - Processing node 69c80787123b47fd23770206: baseline-arm64-clabbe 2026-03-30 16:53:46,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80787123b47fd23770206 2026-03-30 16:53:46,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:46,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80787123b47fd23770206 HTTP/1.1" 200 None 2026-03-30 16:53:46,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:46,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 16:53:46,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:46,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80787123b47fd23770206 HTTP/1.1" 200 None 2026-03-30 16:53:46,417 - lava_callback - ERROR - Error processing callback for node 69c80787123b47fd23770206: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48084 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:53:46,995 - lava_callback - INFO - Received callback for node 69c80789123b47fd23770209 INFO: 172.20.0.1:48086 - "POST /node/69c80789123b47fd23770209 HTTP/1.0" 202 Accepted 2026-03-30 16:53:47,005 - lava_callback - INFO - Starting async job submit for node 69c80789123b47fd23770209 2026-03-30 16:53:47,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:47,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80789123b47fd23770209 HTTP/1.1" 200 None 2026-03-30 16:53:47,034 - lava_callback - DEBUG - Processing node 69c80789123b47fd23770209: baseline-arm64-clabbe 2026-03-30 16:53:47,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80789123b47fd23770209 2026-03-30 16:53:47,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:47,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80789123b47fd23770209 HTTP/1.1" 200 None 2026-03-30 16:53:47,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:47,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 16:53:47,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:47,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80789123b47fd23770209 HTTP/1.1" 200 None 2026-03-30 16:53:47,135 - lava_callback - ERROR - Error processing callback for node 69c80789123b47fd23770209: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 16:53:47,676 - lava_callback - INFO - Received callback for node 69c8078a123b47fd2377020c INFO: 172.20.0.1:48094 - "POST /node/69c8078a123b47fd2377020c HTTP/1.0" 202 Accepted 2026-03-30 16:53:47,687 - lava_callback - INFO - Starting async job submit for node 69c8078a123b47fd2377020c 2026-03-30 16:53:47,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:47,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8078a123b47fd2377020c HTTP/1.1" 200 None 2026-03-30 16:53:47,711 - lava_callback - DEBUG - Processing node 69c8078a123b47fd2377020c: baseline-arm64-clabbe 2026-03-30 16:53:47,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8078a123b47fd2377020c 2026-03-30 16:53:47,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:47,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8078a123b47fd2377020c HTTP/1.1" 200 None 2026-03-30 16:53:47,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:47,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 16:53:47,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:47,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8078a123b47fd2377020c HTTP/1.1" 200 None 2026-03-30 16:53:47,800 - lava_callback - ERROR - Error processing callback for node 69c8078a123b47fd2377020c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 16:53:48,378 - lava_callback - INFO - Received callback for node 69c8078b123b47fd2377020f INFO: 172.20.0.1:48098 - "POST /node/69c8078b123b47fd2377020f HTTP/1.0" 202 Accepted 2026-03-30 16:53:48,387 - lava_callback - INFO - Starting async job submit for node 69c8078b123b47fd2377020f 2026-03-30 16:53:48,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:48,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8078b123b47fd2377020f HTTP/1.1" 200 None 2026-03-30 16:53:48,421 - lava_callback - DEBUG - Processing node 69c8078b123b47fd2377020f: baseline-arm64-clabbe 2026-03-30 16:53:48,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8078b123b47fd2377020f 2026-03-30 16:53:48,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:48,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8078b123b47fd2377020f HTTP/1.1" 200 None 2026-03-30 16:53:48,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:48,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 16:53:48,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:48,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8078b123b47fd2377020f HTTP/1.1" 200 None 2026-03-30 16:53:48,516 - lava_callback - ERROR - Error processing callback for node 69c8078b123b47fd2377020f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 16:53:49,062 - lava_callback - INFO - Received callback for node 69c8078d123b47fd23770215 INFO: 172.20.0.1:48110 - "POST /node/69c8078d123b47fd23770215 HTTP/1.0" 202 Accepted 2026-03-30 16:53:49,070 - lava_callback - INFO - Starting async job submit for node 69c8078d123b47fd23770215 2026-03-30 16:53:49,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:49,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8078d123b47fd23770215 HTTP/1.1" 200 None 2026-03-30 16:53:49,099 - lava_callback - DEBUG - Processing node 69c8078d123b47fd23770215: baseline-arm64-clabbe 2026-03-30 16:53:49,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8078d123b47fd23770215 2026-03-30 16:53:49,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:49,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8078d123b47fd23770215 HTTP/1.1" 200 None 2026-03-30 16:53:49,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:49,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 16:53:49,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:49,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8078d123b47fd23770215 HTTP/1.1" 200 None 2026-03-30 16:53:49,197 - lava_callback - ERROR - Error processing callback for node 69c8078d123b47fd23770215: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 16:53:49,758 - lava_callback - INFO - Received callback for node 69c8078e123b47fd23770218 INFO: 172.20.0.1:52036 - "POST /node/69c8078e123b47fd23770218 HTTP/1.0" 202 Accepted 2026-03-30 16:53:49,769 - lava_callback - INFO - Starting async job submit for node 69c8078e123b47fd23770218 2026-03-30 16:53:49,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:49,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8078e123b47fd23770218 HTTP/1.1" 200 None 2026-03-30 16:53:49,800 - lava_callback - DEBUG - Processing node 69c8078e123b47fd23770218: baseline-arm64-clabbe 2026-03-30 16:53:49,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8078e123b47fd23770218 2026-03-30 16:53:49,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:49,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8078e123b47fd23770218 HTTP/1.1" 200 None 2026-03-30 16:53:49,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:49,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 16:53:49,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:53:49,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8078e123b47fd23770218 HTTP/1.1" 200 None 2026-03-30 16:53:49,901 - lava_callback - ERROR - Error processing callback for node 69c8078e123b47fd23770218: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39912 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:54:26,322 - lava_callback - INFO - Received callback for node 69c807b3123b47fd23770260 INFO: 172.20.0.1:43942 - "POST /node/69c807b3123b47fd23770260 HTTP/1.0" 202 Accepted 2026-03-30 16:54:26,331 - lava_callback - INFO - Starting async job submit for node 69c807b3123b47fd23770260 2026-03-30 16:54:26,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:54:26,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c807b3123b47fd23770260 HTTP/1.1" 200 None 2026-03-30 16:54:26,360 - lava_callback - DEBUG - Processing node 69c807b3123b47fd23770260: baseline-arm-clabbe 2026-03-30 16:54:26,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c807b3123b47fd23770260 2026-03-30 16:54:26,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:54:26,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c807b3123b47fd23770260 HTTP/1.1" 200 None 2026-03-30 16:54:26,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:54:26,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 16:54:26,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:54:26,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c807b3123b47fd23770260 HTTP/1.1" 200 None 2026-03-30 16:54:26,440 - lava_callback - ERROR - Error processing callback for node 69c807b3123b47fd23770260: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56034 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:55:13,602 - lava_callback - INFO - Received callback for node 69caa64c4b5e3e0ab6a60bb5 INFO: 172.20.0.1:37394 - "POST /node/69caa64c4b5e3e0ab6a60bb5 HTTP/1.0" 202 Accepted 2026-03-30 16:55:13,614 - lava_callback - INFO - Starting async job submit for node 69caa64c4b5e3e0ab6a60bb5 2026-03-30 16:55:13,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:55:13,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa64c4b5e3e0ab6a60bb5 HTTP/1.1" 200 None 2026-03-30 16:55:13,741 - lava_callback - DEBUG - Processing node 69caa64c4b5e3e0ab6a60bb5: ltp-smoke 2026-03-30 16:55:14,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:37404 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 16:55:16,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:55:16,139 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69caa64c4b5e3e0ab6a60bb5/log.txt.gz INFO: 172.20.0.1:37410 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:55:16,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:55:18,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:55:18,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69caa64c4b5e3e0ab6a60bb5/lava-logs.yaml 2026-03-30 16:55:18,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:55:20,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:55:20,169 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69caa64c4b5e3e0ab6a60bb5/lava_callback.json.gz 2026-03-30 16:55:20,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:55:20,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa64c4b5e3e0ab6a60bb5 HTTP/1.1" 200 None 2026-03-30 16:55:20,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:55:20,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2504b5e3e0ab6a60b5d HTTP/1.1" 200 None 2026-03-30 16:55:20,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:55:20,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa64c4b5e3e0ab6a60bb5 HTTP/1.1" 200 None 2026-03-30 16:55:20,787 - lava_callback - INFO - Completed processing callback for node 69caa64c4b5e3e0ab6a60bb5 INFO: 172.20.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53142 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:55:35,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:55:35,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53156 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:55:46,409 - lava_callback - INFO - Received callback for node 69c80803123b47fd23770347 INFO: 172.20.0.1:39342 - "POST /node/69c80803123b47fd23770347 HTTP/1.0" 202 Accepted 2026-03-30 16:55:46,418 - lava_callback - INFO - Starting async job submit for node 69c80803123b47fd23770347 2026-03-30 16:55:46,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:55:46,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80803123b47fd23770347 HTTP/1.1" 200 None 2026-03-30 16:55:46,443 - lava_callback - DEBUG - Processing node 69c80803123b47fd23770347: baseline-arm-clabbe 2026-03-30 16:55:46,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80803123b47fd23770347 2026-03-30 16:55:46,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:55:46,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80803123b47fd23770347 HTTP/1.1" 200 None 2026-03-30 16:55:46,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:39358 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:55:46,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 16:55:46,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:55:46,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80803123b47fd23770347 HTTP/1.1" 200 None 2026-03-30 16:55:46,545 - lava_callback - ERROR - Error processing callback for node 69c80803123b47fd23770347: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50912 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 16:56:15,154 - lava_callback - INFO - Received callback for node 69c80825123b47fd23770355 INFO: 172.20.0.1:50920 - "POST /node/69c80825123b47fd23770355 HTTP/1.0" 202 Accepted 2026-03-30 16:56:15,163 - lava_callback - INFO - Starting async job submit for node 69c80825123b47fd23770355 2026-03-30 16:56:15,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:56:15,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80825123b47fd23770355 HTTP/1.1" 200 None 2026-03-30 16:56:15,185 - lava_callback - DEBUG - Processing node 69c80825123b47fd23770355: baseline-arm-baylibre 2026-03-30 16:56:15,185 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80825123b47fd23770355 2026-03-30 16:56:15,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:56:15,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80825123b47fd23770355 HTTP/1.1" 200 None 2026-03-30 16:56:15,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:56:15,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 16:56:15,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:56:15,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80825123b47fd23770355 HTTP/1.1" 200 None 2026-03-30 16:56:15,274 - lava_callback - ERROR - Error processing callback for node 69c80825123b47fd23770355: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56692 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:56:46,202 - lava_callback - INFO - Received callback for node 69caab414b5e3e0ab6a63371 INFO: 172.20.0.1:53802 - "POST /node/69caab414b5e3e0ab6a63371 HTTP/1.0" 202 Accepted 2026-03-30 16:56:46,211 - lava_callback - INFO - Starting async job submit for node 69caab414b5e3e0ab6a63371 2026-03-30 16:56:46,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:56:46,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab414b5e3e0ab6a63371 HTTP/1.1" 200 None 2026-03-30 16:56:46,230 - lava_callback - DEBUG - Processing node 69caab414b5e3e0ab6a63371: baseline-arm 2026-03-30 16:56:46,237 - lava_callback - WARNING - Failed to upload log 2026-03-30 16:56:46,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:56:46,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:56:46,471 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69caab414b5e3e0ab6a63371/lava-logs.yaml 2026-03-30 16:56:46,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:53806 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:56:46,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:56:46,665 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69caab414b5e3e0ab6a63371/lava_callback.json.gz 2026-03-30 16:56:46,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:56:46,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab414b5e3e0ab6a63371 HTTP/1.1" 200 None 2026-03-30 16:56:46,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:56:46,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:56:46,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:56:46,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab414b5e3e0ab6a63371 HTTP/1.1" 200 None 2026-03-30 16:56:46,740 - lava_callback - INFO - Completed processing callback for node 69caab414b5e3e0ab6a63371 2026-03-30 16:56:55,144 - lava_callback - INFO - Received callback for node 69c8084d123b47fd2377036d 2026-03-30 16:56:55,174 - lava_callback - INFO - Starting async job submit for node 69c8084d123b47fd2377036d 2026-03-30 16:56:55,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:41146 - "POST /node/69c8084d123b47fd2377036d HTTP/1.0" 202 Accepted 2026-03-30 16:56:55,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8084d123b47fd2377036d HTTP/1.1" 200 None 2026-03-30 16:56:55,237 - lava_callback - DEBUG - Processing node 69c8084d123b47fd2377036d: baseline-arm-baylibre 2026-03-30 16:56:55,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8084d123b47fd2377036d 2026-03-30 16:56:55,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:56:55,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8084d123b47fd2377036d HTTP/1.1" 200 None 2026-03-30 16:56:55,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:56:55,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 16:56:55,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:56:55,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8084d123b47fd2377036d HTTP/1.1" 200 None 2026-03-30 16:56:55,365 - lava_callback - ERROR - Error processing callback for node 69c8084d123b47fd2377036d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41152 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:57:05,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:05,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43686 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:57:19,896 - lava_callback - INFO - Received callback for node 69caab454b5e3e0ab6a6337d INFO: 172.20.0.1:54284 - "POST /node/69caab454b5e3e0ab6a6337d HTTP/1.0" 202 Accepted 2026-03-30 16:57:19,949 - lava_callback - INFO - Starting async job submit for node 69caab454b5e3e0ab6a6337d 2026-03-30 16:57:19,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:20,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab454b5e3e0ab6a6337d HTTP/1.1" 200 None 2026-03-30 16:57:20,011 - lava_callback - DEBUG - Processing node 69caab454b5e3e0ab6a6337d: baseline-arm 2026-03-30 16:57:20,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:57:20,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:57:20,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69caab454b5e3e0ab6a6337d/log.txt.gz 2026-03-30 16:57:21,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:57:21,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:57:21,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69caab454b5e3e0ab6a6337d/lava-logs.yaml 2026-03-30 16:57:21,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:57:21,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:57:21,837 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69caab454b5e3e0ab6a6337d/lava_callback.json.gz 2026-03-30 16:57:21,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:21,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab454b5e3e0ab6a6337d HTTP/1.1" 200 None 2026-03-30 16:57:21,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:21,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:57:21,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:21,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab454b5e3e0ab6a6337d HTTP/1.1" 200 None 2026-03-30 16:57:21,961 - lava_callback - INFO - Completed processing callback for node 69caab454b5e3e0ab6a6337d INFO: 172.20.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42632 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:57:35,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:35,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-30 16:57:35,318 - lava_callback - INFO - Received callback for node 69c80875123b47fd23770387 INFO: 172.20.0.1:42638 - "POST /node/69c80875123b47fd23770387 HTTP/1.0" 202 Accepted 2026-03-30 16:57:35,328 - lava_callback - INFO - Starting async job submit for node 69c80875123b47fd23770387 2026-03-30 16:57:35,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:35,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80875123b47fd23770387 HTTP/1.1" 200 None 2026-03-30 16:57:35,355 - lava_callback - DEBUG - Processing node 69c80875123b47fd23770387: baseline-arm-baylibre 2026-03-30 16:57:35,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80875123b47fd23770387 2026-03-30 16:57:35,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:35,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80875123b47fd23770387 HTTP/1.1" 200 None 2026-03-30 16:57:35,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:35,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 16:57:35,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:35,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80875123b47fd23770387 HTTP/1.1" 200 None 2026-03-30 16:57:35,428 - lava_callback - ERROR - Error processing callback for node 69c80875123b47fd23770387: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 16:57:35,605 - lava_callback - INFO - Received callback for node 69caab424b5e3e0ab6a63374 INFO: 172.20.0.1:42650 - "POST /node/69caab424b5e3e0ab6a63374 HTTP/1.0" 202 Accepted 2026-03-30 16:57:35,657 - lava_callback - INFO - Starting async job submit for node 69caab424b5e3e0ab6a63374 2026-03-30 16:57:35,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:35,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab424b5e3e0ab6a63374 HTTP/1.1" 200 None 2026-03-30 16:57:35,726 - lava_callback - DEBUG - Processing node 69caab424b5e3e0ab6a63374: baseline-arm 2026-03-30 16:57:35,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:57:36,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:57:36,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69caab424b5e3e0ab6a63374/log.txt.gz 2026-03-30 16:57:36,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:42656 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:57:36,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:57:36,771 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69caab424b5e3e0ab6a63374/lava-logs.yaml 2026-03-30 16:57:36,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:57:36,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:57:36,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69caab424b5e3e0ab6a63374/lava_callback.json.gz 2026-03-30 16:57:36,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:36,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab424b5e3e0ab6a63374 HTTP/1.1" 200 None 2026-03-30 16:57:36,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:36,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:57:36,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:37,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab424b5e3e0ab6a63374 HTTP/1.1" 200 None 2026-03-30 16:57:37,047 - lava_callback - INFO - Completed processing callback for node 69caab424b5e3e0ab6a63374 2026-03-30 16:57:44,602 - lava_callback - INFO - Received callback for node 69caab444b5e3e0ab6a6337a INFO: 172.20.0.1:51468 - "POST /node/69caab444b5e3e0ab6a6337a HTTP/1.0" 202 Accepted 2026-03-30 16:57:44,626 - lava_callback - INFO - Starting async job submit for node 69caab444b5e3e0ab6a6337a 2026-03-30 16:57:44,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:44,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab444b5e3e0ab6a6337a HTTP/1.1" 200 None 2026-03-30 16:57:44,726 - lava_callback - DEBUG - Processing node 69caab444b5e3e0ab6a6337a: baseline-arm 2026-03-30 16:57:45,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:57:45,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:57:45,401 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69caab444b5e3e0ab6a6337a/log.txt.gz 2026-03-30 16:57:45,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:57:46,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:57:46,086 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69caab444b5e3e0ab6a6337a/lava-logs.yaml 2026-03-30 16:57:46,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:57:46,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:57:46,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69caab444b5e3e0ab6a6337a/lava_callback.json.gz 2026-03-30 16:57:46,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:46,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab444b5e3e0ab6a6337a HTTP/1.1" 200 None 2026-03-30 16:57:46,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:46,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:57:46,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:57:46,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab444b5e3e0ab6a6337a HTTP/1.1" 200 None 2026-03-30 16:57:46,417 - lava_callback - INFO - Completed processing callback for node 69caab444b5e3e0ab6a6337a INFO: 172.20.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60186 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:58:05,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:05,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56388 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:58:13,037 - lava_callback - INFO - Received callback for node 69caab554b5e3e0ab6a633b5 INFO: 172.20.0.1:34490 - "POST /node/69caab554b5e3e0ab6a633b5 HTTP/1.0" 202 Accepted 2026-03-30 16:58:13,046 - lava_callback - INFO - Starting async job submit for node 69caab554b5e3e0ab6a633b5 2026-03-30 16:58:13,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:13,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab554b5e3e0ab6a633b5 HTTP/1.1" 200 None 2026-03-30 16:58:13,101 - lava_callback - DEBUG - Processing node 69caab554b5e3e0ab6a633b5: baseline-arm-broonie 2026-03-30 16:58:13,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:13,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:13,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab554b5e3e0ab6a633b5/log.txt.gz 2026-03-30 16:58:13,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:14,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:14,341 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab554b5e3e0ab6a633b5/lava-logs.yaml 2026-03-30 16:58:14,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:14,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:14,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab554b5e3e0ab6a633b5/lava_callback.json.gz 2026-03-30 16:58:14,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:14,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab554b5e3e0ab6a633b5 HTTP/1.1" 200 None 2026-03-30 16:58:14,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:14,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:58:14,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:14,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab554b5e3e0ab6a633b5 HTTP/1.1" 200 None 2026-03-30 16:58:14,586 - lava_callback - INFO - Completed processing callback for node 69caab554b5e3e0ab6a633b5 INFO: 172.20.0.1:34498 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 16:58:15,256 - lava_callback - INFO - Received callback for node 69c8089c123b47fd2377039d INFO: 172.20.0.1:34510 - "POST /node/69c8089c123b47fd2377039d HTTP/1.0" 202 Accepted 2026-03-30 16:58:15,265 - lava_callback - INFO - Starting async job submit for node 69c8089c123b47fd2377039d 2026-03-30 16:58:15,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:15,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8089c123b47fd2377039d HTTP/1.1" 200 None 2026-03-30 16:58:15,300 - lava_callback - DEBUG - Processing node 69c8089c123b47fd2377039d: baseline-arm-baylibre 2026-03-30 16:58:15,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8089c123b47fd2377039d 2026-03-30 16:58:15,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:15,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8089c123b47fd2377039d HTTP/1.1" 200 None 2026-03-30 16:58:15,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:15,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 16:58:15,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:15,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8089c123b47fd2377039d HTTP/1.1" 200 None 2026-03-30 16:58:15,421 - lava_callback - ERROR - Error processing callback for node 69c8089c123b47fd2377039d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 16:58:15,952 - lava_callback - INFO - Received callback for node 69caab6e4b5e3e0ab6a63413 INFO: 172.20.0.1:34524 - "POST /node/69caab6e4b5e3e0ab6a63413 HTTP/1.0" 202 Accepted 2026-03-30 16:58:16,005 - lava_callback - INFO - Starting async job submit for node 69caab6e4b5e3e0ab6a63413 2026-03-30 16:58:16,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:16,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab6e4b5e3e0ab6a63413 HTTP/1.1" 200 None 2026-03-30 16:58:16,075 - lava_callback - DEBUG - Processing node 69caab6e4b5e3e0ab6a63413: baseline-arm-pengutronix 2026-03-30 16:58:16,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:16,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:16,448 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6e4b5e3e0ab6a63413/log.txt.gz INFO: 172.20.0.1:34528 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:58:16,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:16,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:16,945 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6e4b5e3e0ab6a63413/lava-logs.yaml 2026-03-30 16:58:16,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:17,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:17,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6e4b5e3e0ab6a63413/lava_callback.json.gz 2026-03-30 16:58:17,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:17,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab6e4b5e3e0ab6a63413 HTTP/1.1" 200 None 2026-03-30 16:58:17,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:17,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:58:17,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:17,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab6e4b5e3e0ab6a63413 HTTP/1.1" 200 None 2026-03-30 16:58:17,152 - lava_callback - INFO - Completed processing callback for node 69caab6e4b5e3e0ab6a63413 2026-03-30 16:58:19,746 - lava_callback - INFO - Received callback for node 69caab404b5e3e0ab6a6336e INFO: 172.20.0.1:46036 - "POST /node/69caab404b5e3e0ab6a6336e HTTP/1.0" 202 Accepted 2026-03-30 16:58:19,756 - lava_callback - INFO - Starting async job submit for node 69caab404b5e3e0ab6a6336e 2026-03-30 16:58:19,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:19,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab404b5e3e0ab6a6336e HTTP/1.1" 200 None 2026-03-30 16:58:19,849 - lava_callback - DEBUG - Processing node 69caab404b5e3e0ab6a6336e: baseline-arm 2026-03-30 16:58:20,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:20,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:20,453 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69caab404b5e3e0ab6a6336e/log.txt.gz 2026-03-30 16:58:20,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:21,026 - lava_callback - INFO - Received callback for node 69caab6a4b5e3e0ab6a6340a 2026-03-30 16:58:21,035 - lava_callback - INFO - Starting async job submit for node 69caab6a4b5e3e0ab6a6340a INFO: 172.20.0.1:46040 - "POST /node/69caab6a4b5e3e0ab6a6340a HTTP/1.0" 202 Accepted 2026-03-30 16:58:21,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:21,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab6a4b5e3e0ab6a6340a HTTP/1.1" 200 None 2026-03-30 16:58:21,103 - lava_callback - DEBUG - Processing node 69caab6a4b5e3e0ab6a6340a: baseline-arm-pengutronix 2026-03-30 16:58:21,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:21,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69caab404b5e3e0ab6a6336e/lava-logs.yaml 2026-03-30 16:58:21,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:21,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:21,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:21,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6a4b5e3e0ab6a6340a/log.txt.gz 2026-03-30 16:58:21,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:21,795 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69caab404b5e3e0ab6a6336e/lava_callback.json.gz 2026-03-30 16:58:21,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:21,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:21,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab404b5e3e0ab6a6336e HTTP/1.1" 200 None 2026-03-30 16:58:21,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:21,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:58:21,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:22,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab404b5e3e0ab6a6336e HTTP/1.1" 200 None 2026-03-30 16:58:22,009 - lava_callback - INFO - Completed processing callback for node 69caab404b5e3e0ab6a6336e 2026-03-30 16:58:22,268 - lava_callback - INFO - Received callback for node 69caab6c4b5e3e0ab6a6340d INFO: 172.20.0.1:46052 - "POST /node/69caab6c4b5e3e0ab6a6340d HTTP/1.0" 202 Accepted 2026-03-30 16:58:22,279 - lava_callback - INFO - Starting async job submit for node 69caab6c4b5e3e0ab6a6340d 2026-03-30 16:58:22,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:22,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab6c4b5e3e0ab6a6340d HTTP/1.1" 200 None 2026-03-30 16:58:22,350 - lava_callback - DEBUG - Processing node 69caab6c4b5e3e0ab6a6340d: baseline-arm-pengutronix 2026-03-30 16:58:22,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:22,632 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6a4b5e3e0ab6a6340a/lava-logs.yaml 2026-03-30 16:58:22,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:22,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:22,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:22,914 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6c4b5e3e0ab6a6340d/log.txt.gz 2026-03-30 16:58:22,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:22,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6a4b5e3e0ab6a6340a/lava_callback.json.gz 2026-03-30 16:58:22,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:23,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab6a4b5e3e0ab6a6340a HTTP/1.1" 200 None 2026-03-30 16:58:23,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:23,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:58:23,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:23,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:23,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab6a4b5e3e0ab6a6340a HTTP/1.1" 200 None 2026-03-30 16:58:23,191 - lava_callback - INFO - Completed processing callback for node 69caab6a4b5e3e0ab6a6340a 2026-03-30 16:58:23,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:23,589 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6c4b5e3e0ab6a6340d/lava-logs.yaml 2026-03-30 16:58:23,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:23,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:23,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6c4b5e3e0ab6a6340d/lava_callback.json.gz 2026-03-30 16:58:23,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:23,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab6c4b5e3e0ab6a6340d HTTP/1.1" 200 None 2026-03-30 16:58:23,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:23,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:58:23,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:23,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab6c4b5e3e0ab6a6340d HTTP/1.1" 200 None 2026-03-30 16:58:23,894 - lava_callback - INFO - Completed processing callback for node 69caab6c4b5e3e0ab6a6340d INFO: 172.20.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58034 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:58:33,656 - lava_callback - INFO - Received callback for node 69caab534b5e3e0ab6a633b0 INFO: 172.20.0.1:58042 - "POST /node/69caab534b5e3e0ab6a633b0 HTTP/1.0" 202 Accepted 2026-03-30 16:58:33,666 - lava_callback - INFO - Starting async job submit for node 69caab534b5e3e0ab6a633b0 2026-03-30 16:58:33,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:33,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab534b5e3e0ab6a633b0 HTTP/1.1" 200 None 2026-03-30 16:58:33,737 - lava_callback - DEBUG - Processing node 69caab534b5e3e0ab6a633b0: baseline-arm-broonie 2026-03-30 16:58:33,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:34,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:34,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab534b5e3e0ab6a633b0/log.txt.gz 2026-03-30 16:58:34,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:35,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:35,056 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab534b5e3e0ab6a633b0/lava-logs.yaml 2026-03-30 16:58:35,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:35,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:35,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-30 16:58:35,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:35,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab534b5e3e0ab6a633b0/lava_callback.json.gz 2026-03-30 16:58:35,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:35,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab534b5e3e0ab6a633b0 HTTP/1.1" 200 None 2026-03-30 16:58:35,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:35,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:58:35,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:35,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab534b5e3e0ab6a633b0 HTTP/1.1" 200 None 2026-03-30 16:58:35,294 - lava_callback - INFO - Completed processing callback for node 69caab534b5e3e0ab6a633b0 INFO: 172.20.0.1:58044 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:58:36,814 - lava_callback - INFO - Received callback for node 69caab5e4b5e3e0ab6a633ca INFO: 172.20.0.1:58054 - "POST /node/69caab5e4b5e3e0ab6a633ca HTTP/1.0" 202 Accepted 2026-03-30 16:58:36,823 - lava_callback - INFO - Starting async job submit for node 69caab5e4b5e3e0ab6a633ca 2026-03-30 16:58:36,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:36,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab5e4b5e3e0ab6a633ca HTTP/1.1" 200 None 2026-03-30 16:58:36,893 - lava_callback - DEBUG - Processing node 69caab5e4b5e3e0ab6a633ca: baseline-arm-clabbe 2026-03-30 16:58:37,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:37,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:37,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab5e4b5e3e0ab6a633ca/log.txt.gz 2026-03-30 16:58:37,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:38,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:38,289 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab5e4b5e3e0ab6a633ca/lava-logs.yaml 2026-03-30 16:58:38,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:38,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:38,477 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab5e4b5e3e0ab6a633ca/lava_callback.json.gz 2026-03-30 16:58:38,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:38,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab5e4b5e3e0ab6a633ca HTTP/1.1" 200 None 2026-03-30 16:58:38,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:38,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:58:38,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:38,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab5e4b5e3e0ab6a633ca HTTP/1.1" 200 None 2026-03-30 16:58:38,618 - lava_callback - INFO - Completed processing callback for node 69caab5e4b5e3e0ab6a633ca 2026-03-30 16:58:42,049 - lava_callback - INFO - Received callback for node 69caab574b5e3e0ab6a633b9 INFO: 172.20.0.1:49490 - "POST /node/69caab574b5e3e0ab6a633b9 HTTP/1.0" 202 Accepted 2026-03-30 16:58:42,059 - lava_callback - INFO - Starting async job submit for node 69caab574b5e3e0ab6a633b9 2026-03-30 16:58:42,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:42,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab574b5e3e0ab6a633b9 HTTP/1.1" 200 None 2026-03-30 16:58:42,119 - lava_callback - DEBUG - Processing node 69caab574b5e3e0ab6a633b9: baseline-arm-broonie 2026-03-30 16:58:42,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:42,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:42,743 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab574b5e3e0ab6a633b9/log.txt.gz 2026-03-30 16:58:42,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:43,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:43,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab574b5e3e0ab6a633b9/lava-logs.yaml 2026-03-30 16:58:43,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:58:43,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:58:43,567 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab574b5e3e0ab6a633b9/lava_callback.json.gz 2026-03-30 16:58:43,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:43,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab574b5e3e0ab6a633b9 HTTP/1.1" 200 None 2026-03-30 16:58:43,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:43,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:58:43,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:43,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab574b5e3e0ab6a633b9 HTTP/1.1" 200 None 2026-03-30 16:58:43,669 - lava_callback - INFO - Completed processing callback for node 69caab574b5e3e0ab6a633b9 INFO: 172.20.0.1:49498 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:58:55,387 - lava_callback - INFO - Received callback for node 69c808c4123b47fd237703af INFO: 172.20.0.1:41762 - "POST /node/69c808c4123b47fd237703af HTTP/1.0" 202 Accepted 2026-03-30 16:58:55,392 - lava_callback - INFO - Starting async job submit for node 69c808c4123b47fd237703af 2026-03-30 16:58:55,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:55,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c808c4123b47fd237703af HTTP/1.1" 200 None 2026-03-30 16:58:55,414 - lava_callback - DEBUG - Processing node 69c808c4123b47fd237703af: baseline-arm-baylibre 2026-03-30 16:58:55,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c808c4123b47fd237703af 2026-03-30 16:58:55,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:55,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c808c4123b47fd237703af HTTP/1.1" 200 None 2026-03-30 16:58:55,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:55,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 16:58:55,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:58:55,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c808c4123b47fd237703af HTTP/1.1" 200 None 2026-03-30 16:58:55,468 - lava_callback - ERROR - Error processing callback for node 69c808c4123b47fd237703af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41778 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:59:05,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:59:05,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45748 - "GET / HTTP/1.0" 200 OK 2026-03-30 16:59:33,331 - lava_callback - INFO - Received callback for node 69caab8a4b5e3e0ab6a6343f INFO: 172.20.0.1:45758 - "POST /node/69caab8a4b5e3e0ab6a6343f HTTP/1.0" 202 Accepted 2026-03-30 16:59:33,338 - lava_callback - INFO - Starting async job submit for node 69caab8a4b5e3e0ab6a6343f 2026-03-30 16:59:33,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:59:33,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab8a4b5e3e0ab6a6343f HTTP/1.1" 200 None 2026-03-30 16:59:33,377 - lava_callback - DEBUG - Processing node 69caab8a4b5e3e0ab6a6343f: ltp-dio 2026-03-30 16:59:33,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:59:33,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:59:33,910 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69caab8a4b5e3e0ab6a6343f/log.txt.gz 2026-03-30 16:59:34,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:59:34,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:59:34,355 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69caab8a4b5e3e0ab6a6343f/lava-logs.yaml 2026-03-30 16:59:34,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 16:59:34,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 16:59:34,524 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69caab8a4b5e3e0ab6a6343f/lava_callback.json.gz 2026-03-30 16:59:34,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:59:34,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab8a4b5e3e0ab6a6343f HTTP/1.1" 200 None 2026-03-30 16:59:34,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:59:34,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 16:59:34,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:59:34,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab8a4b5e3e0ab6a6343f HTTP/1.1" 200 None 2026-03-30 16:59:34,618 - lava_callback - INFO - Completed processing callback for node 69caab8a4b5e3e0ab6a6343f 2026-03-30 16:59:35,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 16:59:35,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59328 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:00:01,976 - lava_callback - INFO - Received callback for node 69caab524b5e3e0ab6a633ad INFO: 172.20.0.1:56556 - "POST /node/69caab524b5e3e0ab6a633ad HTTP/1.0" 202 Accepted 2026-03-30 17:00:01,982 - lava_callback - INFO - Starting async job submit for node 69caab524b5e3e0ab6a633ad 2026-03-30 17:00:02,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:02,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab524b5e3e0ab6a633ad HTTP/1.1" 200 None 2026-03-30 17:00:02,020 - lava_callback - DEBUG - Processing node 69caab524b5e3e0ab6a633ad: baseline-arm-broonie 2026-03-30 17:00:02,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:00:02,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:00:02,403 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab524b5e3e0ab6a633ad/log.txt.gz 2026-03-30 17:00:02,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:00:02,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:00:02,794 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab524b5e3e0ab6a633ad/lava-logs.yaml 2026-03-30 17:00:02,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:00:02,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:00:02,973 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69caab524b5e3e0ab6a633ad/lava_callback.json.gz 2026-03-30 17:00:02,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:03,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab524b5e3e0ab6a633ad HTTP/1.1" 200 None 2026-03-30 17:00:03,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:03,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:00:03,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:03,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab524b5e3e0ab6a633ad HTTP/1.1" 200 None 2026-03-30 17:00:03,074 - lava_callback - INFO - Completed processing callback for node 69caab524b5e3e0ab6a633ad 2026-03-30 17:00:05,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:05,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41818 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 17:00:15,513 - lava_callback - INFO - Received callback for node 69c8090f123b47fd237703e0 INFO: 172.20.0.1:41824 - "POST /node/69c8090f123b47fd237703e0 HTTP/1.0" 202 Accepted 2026-03-30 17:00:15,519 - lava_callback - INFO - Starting async job submit for node 69c8090f123b47fd237703e0 2026-03-30 17:00:15,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:15,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8090f123b47fd237703e0 HTTP/1.1" 200 None 2026-03-30 17:00:15,564 - lava_callback - DEBUG - Processing node 69c8090f123b47fd237703e0: baseline-arm-baylibre 2026-03-30 17:00:15,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8090f123b47fd237703e0 2026-03-30 17:00:15,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:15,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8090f123b47fd237703e0 HTTP/1.1" 200 None 2026-03-30 17:00:15,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:15,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 17:00:15,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:15,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8090f123b47fd237703e0 HTTP/1.1" 200 None 2026-03-30 17:00:15,627 - lava_callback - ERROR - Error processing callback for node 69c8090f123b47fd237703e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41838 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:00:24,184 - lava_callback - INFO - Received callback for node 69caab5f4b5e3e0ab6a633ce INFO: 172.20.0.1:50506 - "POST /node/69caab5f4b5e3e0ab6a633ce HTTP/1.0" 202 Accepted 2026-03-30 17:00:24,190 - lava_callback - INFO - Starting async job submit for node 69caab5f4b5e3e0ab6a633ce 2026-03-30 17:00:24,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:24,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab5f4b5e3e0ab6a633ce HTTP/1.1" 200 None 2026-03-30 17:00:24,226 - lava_callback - DEBUG - Processing node 69caab5f4b5e3e0ab6a633ce: baseline-arm-clabbe 2026-03-30 17:00:24,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:00:24,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:00:24,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab5f4b5e3e0ab6a633ce/log.txt.gz 2026-03-30 17:00:24,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:00:24,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:00:24,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab5f4b5e3e0ab6a633ce/lava-logs.yaml 2026-03-30 17:00:24,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:00:25,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:00:25,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab5f4b5e3e0ab6a633ce/lava_callback.json.gz 2026-03-30 17:00:25,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:25,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab5f4b5e3e0ab6a633ce HTTP/1.1" 200 None 2026-03-30 17:00:25,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:25,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:00:25,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:25,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab5f4b5e3e0ab6a633ce HTTP/1.1" 200 None 2026-03-30 17:00:25,142 - lava_callback - INFO - Completed processing callback for node 69caab5f4b5e3e0ab6a633ce INFO: 172.20.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34164 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:00:35,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:35,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41512 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:00:46,539 - lava_callback - INFO - Received callback for node 69c80937123b47fd237703f2 INFO: 172.20.0.1:41514 - "POST /node/69c80937123b47fd237703f2 HTTP/1.0" 202 Accepted 2026-03-30 17:00:46,544 - lava_callback - INFO - Starting async job submit for node 69c80937123b47fd237703f2 2026-03-30 17:00:46,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:46,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80937123b47fd237703f2 HTTP/1.1" 200 None 2026-03-30 17:00:46,561 - lava_callback - DEBUG - Processing node 69c80937123b47fd237703f2: baseline-arm-clabbe 2026-03-30 17:00:46,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80937123b47fd237703f2 2026-03-30 17:00:46,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:46,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80937123b47fd237703f2 HTTP/1.1" 200 None 2026-03-30 17:00:46,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:46,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 17:00:46,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:00:46,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80937123b47fd237703f2 HTTP/1.1" 200 None 2026-03-30 17:00:46,617 - lava_callback - ERROR - Error processing callback for node 69c80937123b47fd237703f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42182 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:01:29,597 - lava_callback - INFO - Received callback for node 69c8095d123b47fd23770406 INFO: 172.20.0.1:42192 - "POST /node/69c8095d123b47fd23770406 HTTP/1.0" 202 Accepted 2026-03-30 17:01:29,603 - lava_callback - INFO - Starting async job submit for node 69c8095d123b47fd23770406 2026-03-30 17:01:29,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:01:29,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8095d123b47fd23770406 HTTP/1.1" 200 None 2026-03-30 17:01:29,618 - lava_callback - DEBUG - Processing node 69c8095d123b47fd23770406: baseline-arm-clabbe 2026-03-30 17:01:29,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8095d123b47fd23770406 2026-03-30 17:01:29,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:01:29,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8095d123b47fd23770406 HTTP/1.1" 200 None 2026-03-30 17:01:29,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:01:29,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 17:01:29,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:01:29,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8095d123b47fd23770406 HTTP/1.1" 200 None 2026-03-30 17:01:29,675 - lava_callback - ERROR - Error processing callback for node 69c8095d123b47fd23770406: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52952 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:02:02,220 - lava_callback - INFO - Received callback for node 69caab9a4b5e3e0ab6a6345b INFO: 172.20.0.1:50842 - "POST /node/69caab9a4b5e3e0ab6a6345b HTTP/1.0" 202 Accepted 2026-03-30 17:02:02,227 - lava_callback - INFO - Starting async job submit for node 69caab9a4b5e3e0ab6a6345b 2026-03-30 17:02:02,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:02,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab9a4b5e3e0ab6a6345b HTTP/1.1" 200 None 2026-03-30 17:02:02,279 - lava_callback - DEBUG - Processing node 69caab9a4b5e3e0ab6a6345b: ltp-syscalls 2026-03-30 17:02:02,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:02:03,058 - lava_callback - INFO - Received callback for node 69caab634b5e3e0ab6a633db INFO: 172.20.0.1:50848 - "POST /node/69caab634b5e3e0ab6a633db HTTP/1.0" 202 Accepted 2026-03-30 17:02:03,064 - lava_callback - INFO - Starting async job submit for node 69caab634b5e3e0ab6a633db 2026-03-30 17:02:03,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:03,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab634b5e3e0ab6a633db HTTP/1.1" 200 None 2026-03-30 17:02:03,102 - lava_callback - DEBUG - Processing node 69caab634b5e3e0ab6a633db: baseline-arm-clabbe 2026-03-30 17:02:03,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:02:03,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69caab9a4b5e3e0ab6a6345b/log.txt.gz 2026-03-30 17:02:03,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:02:03,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:02:03,696 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab634b5e3e0ab6a633db/log.txt.gz 2026-03-30 17:02:03,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:02:03,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:02:04,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:02:04,133 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab634b5e3e0ab6a633db/lava-logs.yaml 2026-03-30 17:02:04,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:02:04,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:02:04,144 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69caab9a4b5e3e0ab6a6345b/lava-logs.yaml 2026-03-30 17:02:04,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:02:04,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:02:04,290 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab634b5e3e0ab6a633db/lava_callback.json.gz 2026-03-30 17:02:04,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:04,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab634b5e3e0ab6a633db HTTP/1.1" 200 None 2026-03-30 17:02:04,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:04,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:02:04,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:04,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:02:04,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69caab9a4b5e3e0ab6a6345b/lava_callback.json.gz 2026-03-30 17:02:04,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:04,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab9a4b5e3e0ab6a6345b HTTP/1.1" 200 None 2026-03-30 17:02:04,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:04,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab634b5e3e0ab6a633db HTTP/1.1" 200 None 2026-03-30 17:02:04,465 - lava_callback - INFO - Completed processing callback for node 69caab634b5e3e0ab6a633db 2026-03-30 17:02:04,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:02:04,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:04,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab9a4b5e3e0ab6a6345b HTTP/1.1" 200 None 2026-03-30 17:02:04,562 - lava_callback - INFO - Completed processing callback for node 69caab9a4b5e3e0ab6a6345b 2026-03-30 17:02:05,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:05,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50856 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:02:06,741 - lava_callback - INFO - Received callback for node 69c80985123b47fd23770423 INFO: 172.20.0.1:50864 - "POST /node/69c80985123b47fd23770423 HTTP/1.0" 202 Accepted 2026-03-30 17:02:06,747 - lava_callback - INFO - Starting async job submit for node 69c80985123b47fd23770423 2026-03-30 17:02:06,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:06,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80985123b47fd23770423 HTTP/1.1" 200 None 2026-03-30 17:02:06,767 - lava_callback - DEBUG - Processing node 69c80985123b47fd23770423: baseline-arm-clabbe 2026-03-30 17:02:06,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80985123b47fd23770423 2026-03-30 17:02:06,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:06,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80985123b47fd23770423 HTTP/1.1" 200 None 2026-03-30 17:02:06,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:06,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 17:02:06,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:06,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80985123b47fd23770423 HTTP/1.1" 200 None 2026-03-30 17:02:06,839 - lava_callback - ERROR - Error processing callback for node 69c80985123b47fd23770423: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41120 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:02:46,693 - lava_callback - INFO - Received callback for node 69c809aa123b47fd2377042d INFO: 172.20.0.1:41136 - "POST /node/69c809aa123b47fd2377042d HTTP/1.0" 202 Accepted 2026-03-30 17:02:46,699 - lava_callback - INFO - Starting async job submit for node 69c809aa123b47fd2377042d 2026-03-30 17:02:46,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:46,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c809aa123b47fd2377042d HTTP/1.1" 200 None 2026-03-30 17:02:46,715 - lava_callback - DEBUG - Processing node 69c809aa123b47fd2377042d: baseline-arm-clabbe 2026-03-30 17:02:46,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c809aa123b47fd2377042d 2026-03-30 17:02:46,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:46,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c809aa123b47fd2377042d HTTP/1.1" 200 None 2026-03-30 17:02:46,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:46,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 17:02:46,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:02:46,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c809aa123b47fd2377042d HTTP/1.1" 200 None 2026-03-30 17:02:46,783 - lava_callback - ERROR - Error processing callback for node 69c809aa123b47fd2377042d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36734 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:03:26,704 - lava_callback - INFO - Received callback for node 69c809cf123b47fd23770439 INFO: 172.20.0.1:36748 - "POST /node/69c809cf123b47fd23770439 HTTP/1.0" 202 Accepted 2026-03-30 17:03:26,712 - lava_callback - INFO - Starting async job submit for node 69c809cf123b47fd23770439 2026-03-30 17:03:26,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:03:26,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c809cf123b47fd23770439 HTTP/1.1" 200 None 2026-03-30 17:03:26,753 - lava_callback - DEBUG - Processing node 69c809cf123b47fd23770439: baseline-arm-clabbe 2026-03-30 17:03:26,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c809cf123b47fd23770439 2026-03-30 17:03:26,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:03:26,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c809cf123b47fd23770439 HTTP/1.1" 200 None 2026-03-30 17:03:26,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:03:26,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 17:03:26,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:03:26,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c809cf123b47fd23770439 HTTP/1.1" 200 None 2026-03-30 17:03:26,870 - lava_callback - ERROR - Error processing callback for node 69c809cf123b47fd23770439: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40668 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:03:42,072 - lava_callback - INFO - Received callback for node 69caab654b5e3e0ab6a633de INFO: 172.20.0.1:48054 - "POST /node/69caab654b5e3e0ab6a633de HTTP/1.0" 202 Accepted 2026-03-30 17:03:42,082 - lava_callback - INFO - Starting async job submit for node 69caab654b5e3e0ab6a633de 2026-03-30 17:03:42,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:03:42,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab654b5e3e0ab6a633de HTTP/1.1" 200 None 2026-03-30 17:03:42,163 - lava_callback - DEBUG - Processing node 69caab654b5e3e0ab6a633de: baseline-arm-clabbe 2026-03-30 17:03:42,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:03:42,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:03:42,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab654b5e3e0ab6a633de/log.txt.gz 2026-03-30 17:03:42,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:03:43,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:03:43,549 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab654b5e3e0ab6a633de/lava-logs.yaml 2026-03-30 17:03:43,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:03:43,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:03:43,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69caab654b5e3e0ab6a633de/lava_callback.json.gz 2026-03-30 17:03:43,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:03:43,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab654b5e3e0ab6a633de HTTP/1.1" 200 None 2026-03-30 17:03:43,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:03:43,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:03:43,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:03:43,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab654b5e3e0ab6a633de HTTP/1.1" 200 None 2026-03-30 17:03:43,829 - lava_callback - INFO - Completed processing callback for node 69caab654b5e3e0ab6a633de INFO: 172.20.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44160 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:04:02,060 - lava_callback - INFO - Received callback for node 69caab814b5e3e0ab6a63428 INFO: 172.20.0.1:60444 - "POST /node/69caab814b5e3e0ab6a63428 HTTP/1.0" 202 Accepted 2026-03-30 17:04:02,068 - lava_callback - INFO - Starting async job submit for node 69caab814b5e3e0ab6a63428 2026-03-30 17:04:02,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:02,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab814b5e3e0ab6a63428 HTTP/1.1" 200 None 2026-03-30 17:04:02,113 - lava_callback - DEBUG - Processing node 69caab814b5e3e0ab6a63428: ltp-cap_bounds 2026-03-30 17:04:02,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:04:02,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:04:02,926 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69caab814b5e3e0ab6a63428/log.txt.gz 2026-03-30 17:04:03,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:04:03,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:04:03,755 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69caab814b5e3e0ab6a63428/lava-logs.yaml 2026-03-30 17:04:03,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:04:03,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:04:03,920 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69caab814b5e3e0ab6a63428/lava_callback.json.gz 2026-03-30 17:04:03,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:03,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab814b5e3e0ab6a63428 HTTP/1.1" 200 None 2026-03-30 17:04:03,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:03,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:04:03,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:04,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab814b5e3e0ab6a63428 HTTP/1.1" 200 None 2026-03-30 17:04:04,039 - lava_callback - INFO - Completed processing callback for node 69caab814b5e3e0ab6a63428 2026-03-30 17:04:05,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:05,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60450 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:04:06,780 - lava_callback - INFO - Received callback for node 69c809f3123b47fd2377044a INFO: 172.20.0.1:60464 - "POST /node/69c809f3123b47fd2377044a HTTP/1.0" 202 Accepted 2026-03-30 17:04:06,789 - lava_callback - INFO - Starting async job submit for node 69c809f3123b47fd2377044a 2026-03-30 17:04:06,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:06,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c809f3123b47fd2377044a HTTP/1.1" 200 None 2026-03-30 17:04:06,821 - lava_callback - DEBUG - Processing node 69c809f3123b47fd2377044a: baseline-arm-clabbe 2026-03-30 17:04:06,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c809f3123b47fd2377044a 2026-03-30 17:04:06,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:06,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c809f3123b47fd2377044a HTTP/1.1" 200 None 2026-03-30 17:04:06,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:06,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 17:04:06,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:06,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c809f3123b47fd2377044a HTTP/1.1" 200 None 2026-03-30 17:04:06,935 - lava_callback - ERROR - Error processing callback for node 69c809f3123b47fd2377044a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50200 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:04:46,818 - lava_callback - INFO - Received callback for node 69c80a19123b47fd23770457 INFO: 172.20.0.1:50212 - "POST /node/69c80a19123b47fd23770457 HTTP/1.0" 202 Accepted 2026-03-30 17:04:46,824 - lava_callback - INFO - Starting async job submit for node 69c80a19123b47fd23770457 2026-03-30 17:04:46,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:46,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80a19123b47fd23770457 HTTP/1.1" 200 None 2026-03-30 17:04:46,840 - lava_callback - DEBUG - Processing node 69c80a19123b47fd23770457: baseline-arm-clabbe 2026-03-30 17:04:46,840 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80a19123b47fd23770457 2026-03-30 17:04:46,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:46,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80a19123b47fd23770457 HTTP/1.1" 200 None 2026-03-30 17:04:46,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:46,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 17:04:46,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:04:46,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80a19123b47fd23770457 HTTP/1.1" 200 None 2026-03-30 17:04:46,904 - lava_callback - ERROR - Error processing callback for node 69c80a19123b47fd23770457: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53866 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:05:02,000 - lava_callback - INFO - Received callback for node 69caab834b5e3e0ab6a6342b INFO: 172.20.0.1:39938 - "POST /node/69caab834b5e3e0ab6a6342b HTTP/1.0" 202 Accepted 2026-03-30 17:05:02,010 - lava_callback - INFO - Starting async job submit for node 69caab834b5e3e0ab6a6342b 2026-03-30 17:05:02,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:02,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab834b5e3e0ab6a6342b HTTP/1.1" 200 None 2026-03-30 17:05:02,087 - lava_callback - DEBUG - Processing node 69caab834b5e3e0ab6a6342b: ltp-containers 2026-03-30 17:05:02,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:05:03,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:05:03,088 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69caab834b5e3e0ab6a6342b/log.txt.gz 2026-03-30 17:05:03,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:05:03,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:05:03,954 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69caab834b5e3e0ab6a6342b/lava-logs.yaml 2026-03-30 17:05:03,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:05:04,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:05:04,135 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69caab834b5e3e0ab6a6342b/lava_callback.json.gz 2026-03-30 17:05:04,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:04,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab834b5e3e0ab6a6342b HTTP/1.1" 200 None 2026-03-30 17:05:04,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:04,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:05:04,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:04,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab834b5e3e0ab6a6342b HTTP/1.1" 200 None 2026-03-30 17:05:04,245 - lava_callback - INFO - Completed processing callback for node 69caab834b5e3e0ab6a6342b 2026-03-30 17:05:05,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:05,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53122 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:05:33,641 - lava_callback - INFO - Received callback for node 69caab854b5e3e0ab6a6342f INFO: 172.20.0.1:53134 - "POST /node/69caab854b5e3e0ab6a6342f HTTP/1.0" 202 Accepted 2026-03-30 17:05:33,651 - lava_callback - INFO - Starting async job submit for node 69caab854b5e3e0ab6a6342f 2026-03-30 17:05:33,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:33,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab854b5e3e0ab6a6342f HTTP/1.1" 200 None 2026-03-30 17:05:33,723 - lava_callback - DEBUG - Processing node 69caab854b5e3e0ab6a6342f: ltp-controllers 2026-03-30 17:05:34,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:05:34,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:05:34,719 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69caab854b5e3e0ab6a6342f/log.txt.gz 2026-03-30 17:05:35,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:05:35,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:05:35,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69caab854b5e3e0ab6a6342f/lava-logs.yaml 2026-03-30 17:05:35,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:05:35,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:05:35,377 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69caab854b5e3e0ab6a6342f/lava_callback.json.gz 2026-03-30 17:05:35,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:35,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab854b5e3e0ab6a6342f HTTP/1.1" 200 None 2026-03-30 17:05:35,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:35,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:05:35,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:35,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab854b5e3e0ab6a6342f HTTP/1.1" 200 None 2026-03-30 17:05:35,493 - lava_callback - INFO - Completed processing callback for node 69caab854b5e3e0ab6a6342f INFO: 172.20.0.1:53150 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:05:42,096 - lava_callback - INFO - Received callback for node 69caab884b5e3e0ab6a6343c INFO: 172.20.0.1:42578 - "POST /node/69caab884b5e3e0ab6a6343c HTTP/1.0" 202 Accepted 2026-03-30 17:05:42,107 - lava_callback - INFO - Starting async job submit for node 69caab884b5e3e0ab6a6343c 2026-03-30 17:05:42,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:42,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab884b5e3e0ab6a6343c HTTP/1.1" 200 None 2026-03-30 17:05:42,166 - lava_callback - DEBUG - Processing node 69caab884b5e3e0ab6a6343c: ltp-cve 2026-03-30 17:05:42,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:05:42,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:05:42,852 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69caab884b5e3e0ab6a6343c/log.txt.gz 2026-03-30 17:05:43,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:05:43,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:05:43,296 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69caab884b5e3e0ab6a6343c/lava-logs.yaml 2026-03-30 17:05:43,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:05:43,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:05:43,501 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69caab884b5e3e0ab6a6343c/lava_callback.json.gz 2026-03-30 17:05:43,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:43,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab884b5e3e0ab6a6343c HTTP/1.1" 200 None 2026-03-30 17:05:43,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:43,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:05:43,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:43,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab884b5e3e0ab6a6343c HTTP/1.1" 200 None 2026-03-30 17:05:43,596 - lava_callback - INFO - Completed processing callback for node 69caab884b5e3e0ab6a6343c INFO: 172.20.0.1:42584 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:05:46,905 - lava_callback - INFO - Received callback for node 69c80a62123b47fd23770470 INFO: 172.20.0.1:42594 - "POST /node/69c80a62123b47fd23770470 HTTP/1.0" 202 Accepted 2026-03-30 17:05:46,911 - lava_callback - INFO - Starting async job submit for node 69c80a62123b47fd23770470 2026-03-30 17:05:46,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:46,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80a62123b47fd23770470 HTTP/1.1" 200 None 2026-03-30 17:05:46,928 - lava_callback - DEBUG - Processing node 69c80a62123b47fd23770470: baseline-arm-clabbe 2026-03-30 17:05:46,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80a62123b47fd23770470 2026-03-30 17:05:46,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:46,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80a62123b47fd23770470 HTTP/1.1" 200 None 2026-03-30 17:05:46,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:46,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 17:05:46,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:05:47,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80a62123b47fd23770470 HTTP/1.1" 200 None 2026-03-30 17:05:47,040 - lava_callback - ERROR - Error processing callback for node 69c80a62123b47fd23770470: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48742 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:06:05,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:05,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36614 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:06:14,050 - lava_callback - INFO - Received callback for node 69caad804b5e3e0ab6a635c3 INFO: 172.20.0.1:49176 - "POST /node/69caad804b5e3e0ab6a635c3 HTTP/1.0" 202 Accepted 2026-03-30 17:06:14,056 - lava_callback - INFO - Starting async job submit for node 69caad804b5e3e0ab6a635c3 2026-03-30 17:06:14,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:14,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad804b5e3e0ab6a635c3 HTTP/1.1" 200 None 2026-03-30 17:06:14,075 - lava_callback - DEBUG - Processing node 69caad804b5e3e0ab6a635c3: baseline-nfs-arm64 2026-03-30 17:06:14,077 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:06:14,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:14,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:14,211 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad804b5e3e0ab6a635c3/lava-logs.yaml 2026-03-30 17:06:14,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:14,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:14,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad804b5e3e0ab6a635c3/lava_callback.json.gz 2026-03-30 17:06:14,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:14,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad804b5e3e0ab6a635c3 HTTP/1.1" 200 None 2026-03-30 17:06:14,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:14,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:06:14,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:14,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad804b5e3e0ab6a635c3 HTTP/1.1" 200 None 2026-03-30 17:06:14,453 - lava_callback - INFO - Completed processing callback for node 69caad804b5e3e0ab6a635c3 INFO: 172.20.0.1:49190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40220 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:06:34,528 - lava_callback - INFO - Received callback for node 69caad6f4b5e3e0ab6a63595 INFO: 172.20.0.1:40230 - "POST /node/69caad6f4b5e3e0ab6a63595 HTTP/1.0" 202 Accepted 2026-03-30 17:06:34,537 - lava_callback - INFO - Starting async job submit for node 69caad6f4b5e3e0ab6a63595 2026-03-30 17:06:34,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:34,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6f4b5e3e0ab6a63595 HTTP/1.1" 200 None 2026-03-30 17:06:34,580 - lava_callback - DEBUG - Processing node 69caad6f4b5e3e0ab6a63595: baseline-arm64 2026-03-30 17:06:34,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:34,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:34,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6f4b5e3e0ab6a63595/log.txt.gz 2026-03-30 17:06:35,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:35,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:35,282 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6f4b5e3e0ab6a63595/lava-logs.yaml 2026-03-30 17:06:35,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:35,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:35,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-30 17:06:35,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:35,459 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6f4b5e3e0ab6a63595/lava_callback.json.gz 2026-03-30 17:06:35,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:35,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6f4b5e3e0ab6a63595 HTTP/1.1" 200 None 2026-03-30 17:06:35,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:35,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:06:35,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:35,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad6f4b5e3e0ab6a63595 HTTP/1.1" 200 None 2026-03-30 17:06:35,534 - lava_callback - INFO - Completed processing callback for node 69caad6f4b5e3e0ab6a63595 INFO: 172.20.0.1:40240 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:06:45,555 - lava_callback - INFO - Received callback for node 69caad664b5e3e0ab6a63578 INFO: 172.20.0.1:60024 - "POST /node/69caad664b5e3e0ab6a63578 HTTP/1.0" 202 Accepted 2026-03-30 17:06:45,563 - lava_callback - INFO - Starting async job submit for node 69caad664b5e3e0ab6a63578 2026-03-30 17:06:45,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:45,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad664b5e3e0ab6a63578 HTTP/1.1" 200 None 2026-03-30 17:06:45,618 - lava_callback - DEBUG - Processing node 69caad664b5e3e0ab6a63578: baseline-arm64 2026-03-30 17:06:45,762 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:06:45,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:46,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:46,014 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad664b5e3e0ab6a63578/lava-logs.yaml 2026-03-30 17:06:46,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:46,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:46,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad664b5e3e0ab6a63578/lava_callback.json.gz 2026-03-30 17:06:46,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:46,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad664b5e3e0ab6a63578 HTTP/1.1" 200 None 2026-03-30 17:06:46,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:46,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:06:46,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:46,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad664b5e3e0ab6a63578 HTTP/1.1" 200 None 2026-03-30 17:06:46,294 - lava_callback - INFO - Completed processing callback for node 69caad664b5e3e0ab6a63578 INFO: 172.20.0.1:60034 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:06:54,353 - lava_callback - INFO - Received callback for node 69caad6b4b5e3e0ab6a6358a INFO: 172.20.0.1:33188 - "POST /node/69caad6b4b5e3e0ab6a6358a HTTP/1.0" 202 Accepted 2026-03-30 17:06:54,359 - lava_callback - INFO - Starting async job submit for node 69caad6b4b5e3e0ab6a6358a 2026-03-30 17:06:54,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:54,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6b4b5e3e0ab6a6358a HTTP/1.1" 200 None 2026-03-30 17:06:54,394 - lava_callback - DEBUG - Processing node 69caad6b4b5e3e0ab6a6358a: baseline-arm64 2026-03-30 17:06:54,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:54,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:54,883 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6b4b5e3e0ab6a6358a/log.txt.gz 2026-03-30 17:06:55,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:55,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:55,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6b4b5e3e0ab6a6358a/lava-logs.yaml 2026-03-30 17:06:55,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:55,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:55,605 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6b4b5e3e0ab6a6358a/lava_callback.json.gz 2026-03-30 17:06:55,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:55,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6b4b5e3e0ab6a6358a HTTP/1.1" 200 None 2026-03-30 17:06:55,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:55,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:06:55,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:55,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad6b4b5e3e0ab6a6358a HTTP/1.1" 200 None 2026-03-30 17:06:55,713 - lava_callback - INFO - Completed processing callback for node 69caad6b4b5e3e0ab6a6358a INFO: 172.20.0.1:33202 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:06:58,422 - lava_callback - INFO - Received callback for node 69caad744b5e3e0ab6a635a2 INFO: 172.20.0.1:33218 - "POST /node/69caad744b5e3e0ab6a635a2 HTTP/1.0" 202 Accepted 2026-03-30 17:06:58,432 - lava_callback - INFO - Starting async job submit for node 69caad744b5e3e0ab6a635a2 2026-03-30 17:06:58,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:58,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad744b5e3e0ab6a635a2 HTTP/1.1" 200 None 2026-03-30 17:06:58,488 - lava_callback - DEBUG - Processing node 69caad744b5e3e0ab6a635a2: baseline-arm64 2026-03-30 17:06:58,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:58,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:58,952 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad744b5e3e0ab6a635a2/log.txt.gz 2026-03-30 17:06:59,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:59,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:59,289 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad744b5e3e0ab6a635a2/lava-logs.yaml 2026-03-30 17:06:59,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:06:59,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:06:59,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad744b5e3e0ab6a635a2/lava_callback.json.gz 2026-03-30 17:06:59,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:59,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad744b5e3e0ab6a635a2 HTTP/1.1" 200 None 2026-03-30 17:06:59,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:59,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:06:59,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:06:59,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad744b5e3e0ab6a635a2 HTTP/1.1" 200 None 2026-03-30 17:06:59,562 - lava_callback - INFO - Completed processing callback for node 69caad744b5e3e0ab6a635a2 2026-03-30 17:07:02,300 - lava_callback - INFO - Received callback for node 69caad674b5e3e0ab6a6357f INFO: 172.20.0.1:42528 - "POST /node/69caad674b5e3e0ab6a6357f HTTP/1.0" 202 Accepted 2026-03-30 17:07:02,307 - lava_callback - INFO - Starting async job submit for node 69caad674b5e3e0ab6a6357f 2026-03-30 17:07:02,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:02,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad674b5e3e0ab6a6357f HTTP/1.1" 200 None 2026-03-30 17:07:02,354 - lava_callback - DEBUG - Processing node 69caad674b5e3e0ab6a6357f: baseline-arm64 2026-03-30 17:07:02,542 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:07:02,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:02,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:02,792 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad674b5e3e0ab6a6357f/lava-logs.yaml 2026-03-30 17:07:02,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:02,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:02,925 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad674b5e3e0ab6a6357f/lava_callback.json.gz 2026-03-30 17:07:02,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:02,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad674b5e3e0ab6a6357f HTTP/1.1" 200 None 2026-03-30 17:07:02,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:02,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:02,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:03,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad674b5e3e0ab6a6357f HTTP/1.1" 200 None 2026-03-30 17:07:03,115 - lava_callback - INFO - Completed processing callback for node 69caad674b5e3e0ab6a6357f 2026-03-30 17:07:05,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:05,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-30 17:07:05,741 - lava_callback - INFO - Received callback for node 69caad6c4b5e3e0ab6a6358d INFO: 172.20.0.1:42544 - "POST /node/69caad6c4b5e3e0ab6a6358d HTTP/1.0" 202 Accepted 2026-03-30 17:07:05,749 - lava_callback - INFO - Starting async job submit for node 69caad6c4b5e3e0ab6a6358d 2026-03-30 17:07:05,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:05,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6c4b5e3e0ab6a6358d HTTP/1.1" 200 None 2026-03-30 17:07:05,829 - lava_callback - DEBUG - Processing node 69caad6c4b5e3e0ab6a6358d: baseline-arm64 2026-03-30 17:07:06,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:06,471 - lava_callback - INFO - Received callback for node 69caad624b5e3e0ab6a63564 INFO: 172.20.0.1:42560 - "POST /node/69caad624b5e3e0ab6a63564 HTTP/1.0" 202 Accepted 2026-03-30 17:07:06,481 - lava_callback - INFO - Starting async job submit for node 69caad624b5e3e0ab6a63564 INFO: 172.20.0.1:42564 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:07:06,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:06,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad624b5e3e0ab6a63564 HTTP/1.1" 200 None 2026-03-30 17:07:06,542 - lava_callback - DEBUG - Processing node 69caad624b5e3e0ab6a63564: baseline-arm64 2026-03-30 17:07:06,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:06,613 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6c4b5e3e0ab6a6358d/log.txt.gz 2026-03-30 17:07:07,150 - lava_callback - INFO - Received callback for node 69caad634b5e3e0ab6a63567 2026-03-30 17:07:07,176 - lava_callback - INFO - Starting async job submit for node 69caad634b5e3e0ab6a63567 2026-03-30 17:07:07,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:42580 - "POST /node/69caad634b5e3e0ab6a63567 HTTP/1.0" 202 Accepted 2026-03-30 17:07:07,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:07,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:07,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad634b5e3e0ab6a63567 HTTP/1.1" 200 None 2026-03-30 17:07:07,261 - lava_callback - DEBUG - Processing node 69caad634b5e3e0ab6a63567: baseline-arm64 2026-03-30 17:07:07,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:07,490 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad624b5e3e0ab6a63564/log.txt.gz 2026-03-30 17:07:07,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:07,679 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6c4b5e3e0ab6a6358d/lava-logs.yaml 2026-03-30 17:07:07,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:07,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:07,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:07,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:07,951 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad634b5e3e0ab6a63567/log.txt.gz 2026-03-30 17:07:08,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:08,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:08,063 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad624b5e3e0ab6a63564/lava-logs.yaml 2026-03-30 17:07:08,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6c4b5e3e0ab6a6358d/lava_callback.json.gz 2026-03-30 17:07:08,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:08,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:08,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:08,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6c4b5e3e0ab6a6358d HTTP/1.1" 200 None 2026-03-30 17:07:08,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:08,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:08,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:08,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad6c4b5e3e0ab6a6358d HTTP/1.1" 200 None 2026-03-30 17:07:08,269 - lava_callback - INFO - Completed processing callback for node 69caad6c4b5e3e0ab6a6358d 2026-03-30 17:07:08,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:08,395 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad624b5e3e0ab6a63564/lava_callback.json.gz 2026-03-30 17:07:08,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:08,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad624b5e3e0ab6a63564 HTTP/1.1" 200 None 2026-03-30 17:07:08,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:08,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:08,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:08,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:08,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad634b5e3e0ab6a63567/lava-logs.yaml 2026-03-30 17:07:08,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:08,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad624b5e3e0ab6a63564 HTTP/1.1" 200 None 2026-03-30 17:07:08,511 - lava_callback - INFO - Completed processing callback for node 69caad624b5e3e0ab6a63564 2026-03-30 17:07:08,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:08,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad634b5e3e0ab6a63567/lava_callback.json.gz 2026-03-30 17:07:08,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:08,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad634b5e3e0ab6a63567 HTTP/1.1" 200 None 2026-03-30 17:07:08,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:08,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:08,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:08,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad634b5e3e0ab6a63567 HTTP/1.1" 200 None 2026-03-30 17:07:08,798 - lava_callback - INFO - Completed processing callback for node 69caad634b5e3e0ab6a63567 2026-03-30 17:07:11,286 - lava_callback - INFO - Received callback for node 69caad614b5e3e0ab6a63561 INFO: 172.20.0.1:38300 - "POST /node/69caad614b5e3e0ab6a63561 HTTP/1.0" 202 Accepted 2026-03-30 17:07:11,292 - lava_callback - INFO - Starting async job submit for node 69caad614b5e3e0ab6a63561 2026-03-30 17:07:11,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:11,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad614b5e3e0ab6a63561 HTTP/1.1" 200 None 2026-03-30 17:07:11,327 - lava_callback - DEBUG - Processing node 69caad614b5e3e0ab6a63561: baseline-arm64 2026-03-30 17:07:11,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:11,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:11,641 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad614b5e3e0ab6a63561/log.txt.gz 2026-03-30 17:07:11,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:11,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:11,935 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad614b5e3e0ab6a63561/lava-logs.yaml 2026-03-30 17:07:11,937 - lava_callback - INFO - Received callback for node 69caad754b5e3e0ab6a635a5 INFO: 172.20.0.1:38314 - "POST /node/69caad754b5e3e0ab6a635a5 HTTP/1.0" 202 Accepted 2026-03-30 17:07:11,944 - lava_callback - INFO - Starting async job submit for node 69caad754b5e3e0ab6a635a5 2026-03-30 17:07:11,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:11,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:12,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad754b5e3e0ab6a635a5 HTTP/1.1" 200 None 2026-03-30 17:07:12,017 - lava_callback - DEBUG - Processing node 69caad754b5e3e0ab6a635a5: baseline-arm64 2026-03-30 17:07:12,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:12,173 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad614b5e3e0ab6a63561/lava_callback.json.gz 2026-03-30 17:07:12,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:12,241 - lava_callback - INFO - Received callback for node 69caad6a4b5e3e0ab6a63585 INFO: 172.20.0.1:38320 - "POST /node/69caad6a4b5e3e0ab6a63585 HTTP/1.0" 202 Accepted 2026-03-30 17:07:12,284 - lava_callback - INFO - Starting async job submit for node 69caad6a4b5e3e0ab6a63585 2026-03-30 17:07:12,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:12,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad614b5e3e0ab6a63561 HTTP/1.1" 200 None 2026-03-30 17:07:12,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:12,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6a4b5e3e0ab6a63585 HTTP/1.1" 200 None 2026-03-30 17:07:12,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:12,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:12,433 - lava_callback - DEBUG - Processing node 69caad6a4b5e3e0ab6a63585: baseline-arm64 2026-03-30 17:07:12,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:12,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad614b5e3e0ab6a63561 HTTP/1.1" 200 None 2026-03-30 17:07:12,601 - lava_callback - INFO - Completed processing callback for node 69caad614b5e3e0ab6a63561 2026-03-30 17:07:12,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:12,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad754b5e3e0ab6a635a5/log.txt.gz 2026-03-30 17:07:12,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:13,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:13,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:13,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6a4b5e3e0ab6a63585/log.txt.gz 2026-03-30 17:07:13,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:13,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad754b5e3e0ab6a635a5/lava-logs.yaml 2026-03-30 17:07:13,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:13,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:13,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:13,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad754b5e3e0ab6a635a5/lava_callback.json.gz 2026-03-30 17:07:13,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:13,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:13,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6a4b5e3e0ab6a63585/lava-logs.yaml 2026-03-30 17:07:13,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:13,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad754b5e3e0ab6a635a5 HTTP/1.1" 200 None 2026-03-30 17:07:13,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:13,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:13,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:13,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad754b5e3e0ab6a635a5 HTTP/1.1" 200 None 2026-03-30 17:07:13,604 - lava_callback - INFO - Completed processing callback for node 69caad754b5e3e0ab6a635a5 2026-03-30 17:07:13,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:13,771 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6a4b5e3e0ab6a63585/lava_callback.json.gz 2026-03-30 17:07:13,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:13,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6a4b5e3e0ab6a63585 HTTP/1.1" 200 None 2026-03-30 17:07:13,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:13,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:13,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:13,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad6a4b5e3e0ab6a63585 HTTP/1.1" 200 None 2026-03-30 17:07:13,867 - lava_callback - INFO - Completed processing callback for node 69caad6a4b5e3e0ab6a63585 2026-03-30 17:07:14,604 - lava_callback - INFO - Received callback for node 69caad6d4b5e3e0ab6a63590 INFO: 172.20.0.1:38332 - "POST /node/69caad6d4b5e3e0ab6a63590 HTTP/1.0" 202 Accepted 2026-03-30 17:07:14,610 - lava_callback - INFO - Starting async job submit for node 69caad6d4b5e3e0ab6a63590 2026-03-30 17:07:14,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:14,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6d4b5e3e0ab6a63590 HTTP/1.1" 200 None 2026-03-30 17:07:14,649 - lava_callback - DEBUG - Processing node 69caad6d4b5e3e0ab6a63590: baseline-arm64 2026-03-30 17:07:15,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:38344 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 17:07:15,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:15,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6d4b5e3e0ab6a63590/log.txt.gz 2026-03-30 17:07:15,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:15,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:15,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6d4b5e3e0ab6a63590/lava-logs.yaml 2026-03-30 17:07:15,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:16,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:16,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad6d4b5e3e0ab6a63590/lava_callback.json.gz 2026-03-30 17:07:16,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:16,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad6d4b5e3e0ab6a63590 HTTP/1.1" 200 None 2026-03-30 17:07:16,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:16,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:16,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:16,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad6d4b5e3e0ab6a63590 HTTP/1.1" 200 None 2026-03-30 17:07:16,304 - lava_callback - INFO - Completed processing callback for node 69caad6d4b5e3e0ab6a63590 INFO: 172.20.0.1:38354 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:07:19,384 - lava_callback - INFO - Received callback for node 69caad724b5e3e0ab6a6359f INFO: 172.20.0.1:38356 - "POST /node/69caad724b5e3e0ab6a6359f HTTP/1.0" 202 Accepted 2026-03-30 17:07:19,391 - lava_callback - INFO - Starting async job submit for node 69caad724b5e3e0ab6a6359f 2026-03-30 17:07:19,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:19,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad724b5e3e0ab6a6359f HTTP/1.1" 200 None 2026-03-30 17:07:19,438 - lava_callback - DEBUG - Processing node 69caad724b5e3e0ab6a6359f: baseline-arm64 2026-03-30 17:07:19,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:20,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:20,046 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad724b5e3e0ab6a6359f/log.txt.gz 2026-03-30 17:07:20,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:20,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:20,440 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad724b5e3e0ab6a6359f/lava-logs.yaml 2026-03-30 17:07:20,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:20,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:20,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad724b5e3e0ab6a6359f/lava_callback.json.gz 2026-03-30 17:07:20,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:20,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad724b5e3e0ab6a6359f HTTP/1.1" 200 None 2026-03-30 17:07:20,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:20,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:20,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:20,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad724b5e3e0ab6a6359f HTTP/1.1" 200 None 2026-03-30 17:07:20,718 - lava_callback - INFO - Completed processing callback for node 69caad724b5e3e0ab6a6359f 2026-03-30 17:07:21,251 - lava_callback - INFO - Received callback for node 69caad654b5e3e0ab6a6356b INFO: 172.20.0.1:53408 - "POST /node/69caad654b5e3e0ab6a6356b HTTP/1.0" 202 Accepted 2026-03-30 17:07:21,260 - lava_callback - INFO - Starting async job submit for node 69caad654b5e3e0ab6a6356b 2026-03-30 17:07:21,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:21,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad654b5e3e0ab6a6356b HTTP/1.1" 200 None 2026-03-30 17:07:21,301 - lava_callback - DEBUG - Processing node 69caad654b5e3e0ab6a6356b: baseline-arm64 2026-03-30 17:07:21,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:21,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:21,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad654b5e3e0ab6a6356b/log.txt.gz 2026-03-30 17:07:21,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:22,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:22,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad654b5e3e0ab6a6356b/lava-logs.yaml 2026-03-30 17:07:22,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:22,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:22,370 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad654b5e3e0ab6a6356b/lava_callback.json.gz 2026-03-30 17:07:22,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:22,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad654b5e3e0ab6a6356b HTTP/1.1" 200 None 2026-03-30 17:07:22,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:22,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:22,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:22,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad654b5e3e0ab6a6356b HTTP/1.1" 200 None 2026-03-30 17:07:22,464 - lava_callback - INFO - Completed processing callback for node 69caad654b5e3e0ab6a6356b INFO: 172.20.0.1:53422 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:07:29,271 - lava_callback - INFO - Received callback for node 69caad7d4b5e3e0ab6a635bd INFO: 172.20.0.1:53430 - "POST /node/69caad7d4b5e3e0ab6a635bd HTTP/1.0" 202 Accepted 2026-03-30 17:07:29,278 - lava_callback - INFO - Starting async job submit for node 69caad7d4b5e3e0ab6a635bd 2026-03-30 17:07:29,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:29,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad7d4b5e3e0ab6a635bd HTTP/1.1" 200 None 2026-03-30 17:07:29,330 - lava_callback - DEBUG - Processing node 69caad7d4b5e3e0ab6a635bd: baseline-nfs-arm64 2026-03-30 17:07:29,678 - lava_callback - INFO - Received callback for node 69caad704b5e3e0ab6a63599 INFO: 172.20.0.1:53434 - "POST /node/69caad704b5e3e0ab6a63599 HTTP/1.0" 202 Accepted 2026-03-30 17:07:29,700 - lava_callback - INFO - Starting async job submit for node 69caad704b5e3e0ab6a63599 2026-03-30 17:07:29,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:29,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad704b5e3e0ab6a63599 HTTP/1.1" 200 None 2026-03-30 17:07:29,855 - lava_callback - DEBUG - Processing node 69caad704b5e3e0ab6a63599: baseline-arm64 2026-03-30 17:07:29,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:30,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:30,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:30,235 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7d4b5e3e0ab6a635bd/log.txt.gz 2026-03-30 17:07:30,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:30,334 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad704b5e3e0ab6a63599/log.txt.gz 2026-03-30 17:07:30,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:30,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:31,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:31,120 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad704b5e3e0ab6a63599/lava-logs.yaml 2026-03-30 17:07:31,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:31,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:31,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7d4b5e3e0ab6a635bd/lava-logs.yaml 2026-03-30 17:07:31,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:31,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:31,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad704b5e3e0ab6a63599/lava_callback.json.gz 2026-03-30 17:07:31,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:31,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:31,415 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7d4b5e3e0ab6a635bd/lava_callback.json.gz 2026-03-30 17:07:31,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad704b5e3e0ab6a63599 HTTP/1.1" 200 None 2026-03-30 17:07:31,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:31,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:31,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:31,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:31,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad7d4b5e3e0ab6a635bd HTTP/1.1" 200 None 2026-03-30 17:07:31,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:31,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad704b5e3e0ab6a63599 HTTP/1.1" 200 None 2026-03-30 17:07:31,536 - lava_callback - INFO - Completed processing callback for node 69caad704b5e3e0ab6a63599 2026-03-30 17:07:31,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:31,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:31,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad7d4b5e3e0ab6a635bd HTTP/1.1" 200 None 2026-03-30 17:07:31,624 - lava_callback - INFO - Completed processing callback for node 69caad7d4b5e3e0ab6a635bd 2026-03-30 17:07:31,858 - lava_callback - INFO - Received callback for node 69caada64b5e3e0ab6a63662 INFO: 172.20.0.1:42418 - "POST /node/69caada64b5e3e0ab6a63662 HTTP/1.0" 202 Accepted 2026-03-30 17:07:31,870 - lava_callback - INFO - Starting async job submit for node 69caada64b5e3e0ab6a63662 2026-03-30 17:07:31,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:31,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada64b5e3e0ab6a63662 HTTP/1.1" 200 None 2026-03-30 17:07:31,933 - lava_callback - DEBUG - Processing node 69caada64b5e3e0ab6a63662: baseline-arm64-pengutronix 2026-03-30 17:07:32,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:32,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:32,411 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69caada64b5e3e0ab6a63662/log.txt.gz 2026-03-30 17:07:32,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:32,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:32,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69caada64b5e3e0ab6a63662/lava-logs.yaml INFO: 172.20.0.1:42428 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:07:32,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:32,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:32,983 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69caada64b5e3e0ab6a63662/lava_callback.json.gz 2026-03-30 17:07:33,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:33,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada64b5e3e0ab6a63662 HTTP/1.1" 200 None 2026-03-30 17:07:33,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:33,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:33,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:33,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caada64b5e3e0ab6a63662 HTTP/1.1" 200 None 2026-03-30 17:07:33,097 - lava_callback - INFO - Completed processing callback for node 69caada64b5e3e0ab6a63662 2026-03-30 17:07:33,398 - lava_callback - INFO - Received callback for node 69caad7a4b5e3e0ab6a635b1 INFO: 172.20.0.1:42444 - "POST /node/69caad7a4b5e3e0ab6a635b1 HTTP/1.0" 202 Accepted 2026-03-30 17:07:33,405 - lava_callback - INFO - Starting async job submit for node 69caad7a4b5e3e0ab6a635b1 2026-03-30 17:07:33,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:33,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad7a4b5e3e0ab6a635b1 HTTP/1.1" 200 None 2026-03-30 17:07:33,459 - lava_callback - DEBUG - Processing node 69caad7a4b5e3e0ab6a635b1: baseline-nfs-arm64 2026-03-30 17:07:33,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:34,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:34,008 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7a4b5e3e0ab6a635b1/log.txt.gz 2026-03-30 17:07:34,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:34,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:34,470 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7a4b5e3e0ab6a635b1/lava-logs.yaml 2026-03-30 17:07:34,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:34,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:34,615 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7a4b5e3e0ab6a635b1/lava_callback.json.gz 2026-03-30 17:07:34,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:34,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad7a4b5e3e0ab6a635b1 HTTP/1.1" 200 None 2026-03-30 17:07:34,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:34,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:34,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:34,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad7a4b5e3e0ab6a635b1 HTTP/1.1" 200 None 2026-03-30 17:07:34,700 - lava_callback - INFO - Completed processing callback for node 69caad7a4b5e3e0ab6a635b1 2026-03-30 17:07:35,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:35,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59430 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:07:51,291 - lava_callback - INFO - Received callback for node 69caad7f4b5e3e0ab6a635c0 INFO: 172.20.0.1:54876 - "POST /node/69caad7f4b5e3e0ab6a635c0 HTTP/1.0" 202 Accepted 2026-03-30 17:07:51,298 - lava_callback - INFO - Starting async job submit for node 69caad7f4b5e3e0ab6a635c0 2026-03-30 17:07:51,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:51,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad7f4b5e3e0ab6a635c0 HTTP/1.1" 200 None 2026-03-30 17:07:51,337 - lava_callback - DEBUG - Processing node 69caad7f4b5e3e0ab6a635c0: baseline-nfs-arm64 2026-03-30 17:07:51,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:52,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:52,144 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7f4b5e3e0ab6a635c0/log.txt.gz 2026-03-30 17:07:52,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:52,831 - lava_callback - INFO - Received callback for node 69caad844b5e3e0ab6a635eb INFO: 172.20.0.1:54892 - "POST /node/69caad844b5e3e0ab6a635eb HTTP/1.0" 202 Accepted 2026-03-30 17:07:52,839 - lava_callback - INFO - Starting async job submit for node 69caad844b5e3e0ab6a635eb 2026-03-30 17:07:52,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:52,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:52,871 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7f4b5e3e0ab6a635c0/lava-logs.yaml 2026-03-30 17:07:52,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:52,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad844b5e3e0ab6a635eb HTTP/1.1" 200 None 2026-03-30 17:07:52,892 - lava_callback - DEBUG - Processing node 69caad844b5e3e0ab6a635eb: baseline-nfs-arm64 2026-03-30 17:07:53,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:53,186 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7f4b5e3e0ab6a635c0/lava_callback.json.gz 2026-03-30 17:07:53,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:53,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad7f4b5e3e0ab6a635c0 HTTP/1.1" 200 None 2026-03-30 17:07:53,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:53,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:53,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:53,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:53,451 - lava_callback - INFO - Received callback for node 69caad914b5e3e0ab6a63607 INFO: 172.20.0.1:54896 - "POST /node/69caad914b5e3e0ab6a63607 HTTP/1.0" 202 Accepted 2026-03-30 17:07:53,461 - lava_callback - INFO - Starting async job submit for node 69caad914b5e3e0ab6a63607 2026-03-30 17:07:53,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:53,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad7f4b5e3e0ab6a635c0 HTTP/1.1" 200 None 2026-03-30 17:07:53,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad914b5e3e0ab6a63607 HTTP/1.1" 200 None 2026-03-30 17:07:53,554 - lava_callback - DEBUG - Processing node 69caad914b5e3e0ab6a63607: baseline-arm64-broonie 2026-03-30 17:07:53,582 - lava_callback - INFO - Received callback for node 69caadb34b5e3e0ab6a63673 2026-03-30 17:07:53,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:53,648 - lava_callback - INFO - Starting async job submit for node 69caadb34b5e3e0ab6a63673 2026-03-30 17:07:53,657 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad844b5e3e0ab6a635eb/log.txt.gz INFO: 172.20.0.1:54902 - "POST /node/69caadb34b5e3e0ab6a63673 HTTP/1.0" 202 Accepted 2026-03-30 17:07:53,781 - lava_callback - INFO - Completed processing callback for node 69caad7f4b5e3e0ab6a635c0 2026-03-30 17:07:53,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:54,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caadb34b5e3e0ab6a63673 HTTP/1.1" 200 None 2026-03-30 17:07:54,076 - lava_callback - DEBUG - Processing node 69caadb34b5e3e0ab6a63673: baseline-arm64-foundriesio 2026-03-30 17:07:54,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:54,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:54,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:54,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:54,725 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad914b5e3e0ab6a63607/log.txt.gz 2026-03-30 17:07:54,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:54,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69caadb34b5e3e0ab6a63673/log.txt.gz 2026-03-30 17:07:54,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:54,928 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad844b5e3e0ab6a635eb/lava-logs.yaml 2026-03-30 17:07:54,955 - lava_callback - INFO - Received callback for node 69caad984b5e3e0ab6a63618 INFO: 172.20.0.1:54908 - "POST /node/69caad984b5e3e0ab6a63618 HTTP/1.0" 202 Accepted 2026-03-30 17:07:54,966 - lava_callback - INFO - Starting async job submit for node 69caad984b5e3e0ab6a63618 2026-03-30 17:07:54,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:55,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:55,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:55,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad984b5e3e0ab6a63618 HTTP/1.1" 200 None 2026-03-30 17:07:55,103 - lava_callback - DEBUG - Processing node 69caad984b5e3e0ab6a63618: baseline-arm64-broonie 2026-03-30 17:07:55,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:55,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:55,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:55,419 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad914b5e3e0ab6a63607/lava-logs.yaml 2026-03-30 17:07:55,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:55,426 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad844b5e3e0ab6a635eb/lava_callback.json.gz 2026-03-30 17:07:55,481 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69caadb34b5e3e0ab6a63673/lava-logs.yaml 2026-03-30 17:07:55,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:55,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:55,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:55,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:55,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad844b5e3e0ab6a635eb HTTP/1.1" 200 None 2026-03-30 17:07:55,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:55,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:55,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:55,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad844b5e3e0ab6a635eb HTTP/1.1" 200 None 2026-03-30 17:07:55,590 - lava_callback - INFO - Completed processing callback for node 69caad844b5e3e0ab6a635eb 2026-03-30 17:07:55,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:55,738 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad914b5e3e0ab6a63607/lava_callback.json.gz 2026-03-30 17:07:55,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:55,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:55,776 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69caadb34b5e3e0ab6a63673/lava_callback.json.gz 2026-03-30 17:07:55,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:55,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad914b5e3e0ab6a63607 HTTP/1.1" 200 None 2026-03-30 17:07:55,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:55,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:55,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad984b5e3e0ab6a63618/log.txt.gz 2026-03-30 17:07:55,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caadb34b5e3e0ab6a63673 HTTP/1.1" 200 None 2026-03-30 17:07:55,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:55,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:55,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:56,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:56,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:56,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:56,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad914b5e3e0ab6a63607 HTTP/1.1" 200 None 2026-03-30 17:07:56,036 - lava_callback - INFO - Completed processing callback for node 69caad914b5e3e0ab6a63607 2026-03-30 17:07:56,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caadb34b5e3e0ab6a63673 HTTP/1.1" 200 None 2026-03-30 17:07:56,151 - lava_callback - INFO - Completed processing callback for node 69caadb34b5e3e0ab6a63673 2026-03-30 17:07:56,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:56,270 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad984b5e3e0ab6a63618/lava-logs.yaml 2026-03-30 17:07:56,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:56,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:56,431 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad984b5e3e0ab6a63618/lava_callback.json.gz 2026-03-30 17:07:56,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:56,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad984b5e3e0ab6a63618 HTTP/1.1" 200 None 2026-03-30 17:07:56,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:56,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:56,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:54922 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:07:56,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad984b5e3e0ab6a63618 HTTP/1.1" 200 None 2026-03-30 17:07:56,531 - lava_callback - INFO - Completed processing callback for node 69caad984b5e3e0ab6a63618 2026-03-30 17:07:56,621 - lava_callback - INFO - Received callback for node 69caada74b5e3e0ab6a63665 INFO: 172.20.0.1:54924 - "POST /node/69caada74b5e3e0ab6a63665 HTTP/1.0" 202 Accepted 2026-03-30 17:07:56,628 - lava_callback - INFO - Starting async job submit for node 69caada74b5e3e0ab6a63665 2026-03-30 17:07:56,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:56,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada74b5e3e0ab6a63665 HTTP/1.1" 200 None 2026-03-30 17:07:56,676 - lava_callback - DEBUG - Processing node 69caada74b5e3e0ab6a63665: baseline-arm64-pengutronix 2026-03-30 17:07:56,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:57,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:57,008 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69caada74b5e3e0ab6a63665/log.txt.gz 2026-03-30 17:07:57,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:57,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:57,346 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69caada74b5e3e0ab6a63665/lava-logs.yaml 2026-03-30 17:07:57,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:57,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:57,478 - lava_callback - INFO - Received callback for node 69caad874b5e3e0ab6a635f3 INFO: 172.20.0.1:54938 - "POST /node/69caad874b5e3e0ab6a635f3 HTTP/1.0" 202 Accepted 2026-03-30 17:07:57,486 - lava_callback - INFO - Starting async job submit for node 69caad874b5e3e0ab6a635f3 2026-03-30 17:07:57,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:57,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69caada74b5e3e0ab6a63665/lava_callback.json.gz 2026-03-30 17:07:57,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:57,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad874b5e3e0ab6a635f3 HTTP/1.1" 200 None 2026-03-30 17:07:57,555 - lava_callback - DEBUG - Processing node 69caad874b5e3e0ab6a635f3: baseline-nfs-arm64 2026-03-30 17:07:57,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada74b5e3e0ab6a63665 HTTP/1.1" 200 None 2026-03-30 17:07:57,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:57,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:57,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:57,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caada74b5e3e0ab6a63665 HTTP/1.1" 200 None 2026-03-30 17:07:57,819 - lava_callback - INFO - Completed processing callback for node 69caada74b5e3e0ab6a63665 2026-03-30 17:07:58,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:58,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:58,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad874b5e3e0ab6a635f3/log.txt.gz 2026-03-30 17:07:58,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:58,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:58,675 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad874b5e3e0ab6a635f3/lava-logs.yaml 2026-03-30 17:07:58,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:07:58,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:07:58,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad874b5e3e0ab6a635f3/lava_callback.json.gz 2026-03-30 17:07:58,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:58,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad874b5e3e0ab6a635f3 HTTP/1.1" 200 None 2026-03-30 17:07:58,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:58,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:07:58,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:07:58,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad874b5e3e0ab6a635f3 HTTP/1.1" 200 None 2026-03-30 17:07:58,946 - lava_callback - INFO - Completed processing callback for node 69caad874b5e3e0ab6a635f3 2026-03-30 17:08:02,085 - lava_callback - INFO - Received callback for node 69caab8c4b5e3e0ab6a63446 INFO: 172.20.0.1:51150 - "POST /node/69caab8c4b5e3e0ab6a63446 HTTP/1.0" 202 Accepted 2026-03-30 17:08:02,092 - lava_callback - INFO - Starting async job submit for node 69caab8c4b5e3e0ab6a63446 2026-03-30 17:08:02,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:02,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab8c4b5e3e0ab6a63446 HTTP/1.1" 200 None 2026-03-30 17:08:02,144 - lava_callback - DEBUG - Processing node 69caab8c4b5e3e0ab6a63446: ltp-fs_bind 2026-03-30 17:08:02,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:02,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:02,641 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69caab8c4b5e3e0ab6a63446/log.txt.gz 2026-03-30 17:08:02,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:03,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:03,076 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69caab8c4b5e3e0ab6a63446/lava-logs.yaml 2026-03-30 17:08:03,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:03,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:03,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69caab8c4b5e3e0ab6a63446/lava_callback.json.gz 2026-03-30 17:08:03,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:03,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab8c4b5e3e0ab6a63446 HTTP/1.1" 200 None 2026-03-30 17:08:03,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:03,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:08:03,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:03,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab8c4b5e3e0ab6a63446 HTTP/1.1" 200 None 2026-03-30 17:08:03,426 - lava_callback - INFO - Completed processing callback for node 69caab8c4b5e3e0ab6a63446 2026-03-30 17:08:03,429 - lava_callback - INFO - Received callback for node 69caad814b5e3e0ab6a635c6 INFO: 172.20.0.1:51164 - "POST /node/69caad814b5e3e0ab6a635c6 HTTP/1.0" 202 Accepted 2026-03-30 17:08:03,459 - lava_callback - INFO - Starting async job submit for node 69caad814b5e3e0ab6a635c6 2026-03-30 17:08:03,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:03,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad814b5e3e0ab6a635c6 HTTP/1.1" 200 None 2026-03-30 17:08:03,520 - lava_callback - DEBUG - Processing node 69caad814b5e3e0ab6a635c6: baseline-nfs-arm64 2026-03-30 17:08:03,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:04,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:04,002 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad814b5e3e0ab6a635c6/log.txt.gz 2026-03-30 17:08:04,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:04,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:04,382 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad814b5e3e0ab6a635c6/lava-logs.yaml 2026-03-30 17:08:04,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:04,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:04,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad814b5e3e0ab6a635c6/lava_callback.json.gz 2026-03-30 17:08:04,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:04,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad814b5e3e0ab6a635c6 HTTP/1.1" 200 None 2026-03-30 17:08:04,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:04,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:08:04,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:04,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad814b5e3e0ab6a635c6 HTTP/1.1" 200 None 2026-03-30 17:08:04,614 - lava_callback - INFO - Completed processing callback for node 69caad814b5e3e0ab6a635c6 2026-03-30 17:08:05,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:05,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:51176 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:08:06,534 - lava_callback - INFO - Received callback for node 69caada84b5e3e0ab6a63668 INFO: 172.20.0.1:51184 - "POST /node/69caada84b5e3e0ab6a63668 HTTP/1.0" 202 Accepted 2026-03-30 17:08:06,541 - lava_callback - INFO - Starting async job submit for node 69caada84b5e3e0ab6a63668 2026-03-30 17:08:06,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:06,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada84b5e3e0ab6a63668 HTTP/1.1" 200 None 2026-03-30 17:08:06,582 - lava_callback - DEBUG - Processing node 69caada84b5e3e0ab6a63668: baseline-arm64-pengutronix 2026-03-30 17:08:06,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:06,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:06,911 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69caada84b5e3e0ab6a63668/log.txt.gz 2026-03-30 17:08:07,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:07,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:07,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69caada84b5e3e0ab6a63668/lava-logs.yaml 2026-03-30 17:08:07,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:07,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:07,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69caada84b5e3e0ab6a63668/lava_callback.json.gz 2026-03-30 17:08:07,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:07,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada84b5e3e0ab6a63668 HTTP/1.1" 200 None 2026-03-30 17:08:07,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:07,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:08:07,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:07,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caada84b5e3e0ab6a63668 HTTP/1.1" 200 None 2026-03-30 17:08:07,491 - lava_callback - INFO - Completed processing callback for node 69caada84b5e3e0ab6a63668 2026-03-30 17:08:14,030 - lava_callback - INFO - Received callback for node 69caad774b5e3e0ab6a635ab INFO: 172.20.0.1:60060 - "POST /node/69caad774b5e3e0ab6a635ab HTTP/1.0" 202 Accepted 2026-03-30 17:08:14,039 - lava_callback - INFO - Starting async job submit for node 69caad774b5e3e0ab6a635ab 2026-03-30 17:08:14,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:14,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad774b5e3e0ab6a635ab HTTP/1.1" 200 None 2026-03-30 17:08:14,110 - lava_callback - DEBUG - Processing node 69caad774b5e3e0ab6a635ab: baseline-nfs-arm64 2026-03-30 17:08:14,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:14,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:14,577 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad774b5e3e0ab6a635ab/log.txt.gz 2026-03-30 17:08:14,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:14,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:14,980 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad774b5e3e0ab6a635ab/lava-logs.yaml 2026-03-30 17:08:14,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:60066 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 17:08:15,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:15,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad774b5e3e0ab6a635ab/lava_callback.json.gz 2026-03-30 17:08:15,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:15,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad774b5e3e0ab6a635ab HTTP/1.1" 200 None 2026-03-30 17:08:15,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:15,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:08:15,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:15,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad774b5e3e0ab6a635ab HTTP/1.1" 200 None 2026-03-30 17:08:15,248 - lava_callback - INFO - Completed processing callback for node 69caad774b5e3e0ab6a635ab INFO: 172.20.0.1:60076 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:08:21,673 - lava_callback - INFO - Received callback for node 69caadb44b5e3e0ab6a63676 INFO: 172.20.0.1:60650 - "POST /node/69caadb44b5e3e0ab6a63676 HTTP/1.0" 202 Accepted 2026-03-30 17:08:21,682 - lava_callback - INFO - Starting async job submit for node 69caadb44b5e3e0ab6a63676 2026-03-30 17:08:21,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:21,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caadb44b5e3e0ab6a63676 HTTP/1.1" 200 None 2026-03-30 17:08:21,726 - lava_callback - DEBUG - Processing node 69caadb44b5e3e0ab6a63676: baseline-arm64-foundriesio 2026-03-30 17:08:22,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:22,261 - lava_callback - INFO - Received callback for node 69caad9c4b5e3e0ab6a63624 INFO: 172.20.0.1:60658 - "POST /node/69caad9c4b5e3e0ab6a63624 HTTP/1.0" 202 Accepted 2026-03-30 17:08:22,267 - lava_callback - INFO - Starting async job submit for node 69caad9c4b5e3e0ab6a63624 2026-03-30 17:08:22,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:22,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad9c4b5e3e0ab6a63624 HTTP/1.1" 200 None 2026-03-30 17:08:22,305 - lava_callback - DEBUG - Processing node 69caad9c4b5e3e0ab6a63624: baseline-arm64-broonie 2026-03-30 17:08:22,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:22,420 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69caadb44b5e3e0ab6a63676/log.txt.gz 2026-03-30 17:08:22,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:22,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:22,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:22,955 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad9c4b5e3e0ab6a63624/log.txt.gz 2026-03-30 17:08:23,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:23,118 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69caadb44b5e3e0ab6a63676/lava-logs.yaml 2026-03-30 17:08:23,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:23,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:23,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:23,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69caadb44b5e3e0ab6a63676/lava_callback.json.gz 2026-03-30 17:08:23,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:23,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:23,373 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad9c4b5e3e0ab6a63624/lava-logs.yaml 2026-03-30 17:08:23,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caadb44b5e3e0ab6a63676 HTTP/1.1" 200 None 2026-03-30 17:08:23,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:23,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:23,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:08:23,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:23,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caadb44b5e3e0ab6a63676 HTTP/1.1" 200 None 2026-03-30 17:08:23,436 - lava_callback - INFO - Completed processing callback for node 69caadb44b5e3e0ab6a63676 2026-03-30 17:08:23,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:23,587 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad9c4b5e3e0ab6a63624/lava_callback.json.gz 2026-03-30 17:08:23,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:23,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad9c4b5e3e0ab6a63624 HTTP/1.1" 200 None 2026-03-30 17:08:23,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:23,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:08:23,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:23,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad9c4b5e3e0ab6a63624 HTTP/1.1" 200 None 2026-03-30 17:08:23,704 - lava_callback - INFO - Completed processing callback for node 69caad9c4b5e3e0ab6a63624 2026-03-30 17:08:25,446 - lava_callback - INFO - Received callback for node 69caada24b5e3e0ab6a63637 INFO: 172.20.0.1:60674 - "POST /node/69caada24b5e3e0ab6a63637 HTTP/1.0" 202 Accepted 2026-03-30 17:08:25,454 - lava_callback - INFO - Starting async job submit for node 69caada24b5e3e0ab6a63637 2026-03-30 17:08:25,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:25,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada24b5e3e0ab6a63637 HTTP/1.1" 200 None 2026-03-30 17:08:25,493 - lava_callback - DEBUG - Processing node 69caada24b5e3e0ab6a63637: baseline-arm64-clabbe 2026-03-30 17:08:25,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:25,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:25,829 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69caada24b5e3e0ab6a63637/log.txt.gz 2026-03-30 17:08:25,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:26,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:26,154 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69caada24b5e3e0ab6a63637/lava-logs.yaml 2026-03-30 17:08:26,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:26,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:26,310 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69caada24b5e3e0ab6a63637/lava_callback.json.gz 2026-03-30 17:08:26,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:26,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caada24b5e3e0ab6a63637 HTTP/1.1" 200 None 2026-03-30 17:08:26,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:26,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:08:26,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:26,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caada24b5e3e0ab6a63637 HTTP/1.1" 200 None 2026-03-30 17:08:26,404 - lava_callback - INFO - Completed processing callback for node 69caada24b5e3e0ab6a63637 INFO: 172.20.0.1:60680 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:08:31,964 - lava_callback - INFO - Received callback for node 69caad864b5e3e0ab6a635ee INFO: 172.20.0.1:44780 - "POST /node/69caad864b5e3e0ab6a635ee HTTP/1.0" 202 Accepted 2026-03-30 17:08:31,971 - lava_callback - INFO - Starting async job submit for node 69caad864b5e3e0ab6a635ee 2026-03-30 17:08:31,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:32,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad864b5e3e0ab6a635ee HTTP/1.1" 200 None 2026-03-30 17:08:32,008 - lava_callback - DEBUG - Processing node 69caad864b5e3e0ab6a635ee: baseline-nfs-arm64 2026-03-30 17:08:32,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:32,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:32,662 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad864b5e3e0ab6a635ee/log.txt.gz INFO: 172.20.0.1:44782 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:08:32,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:33,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:33,074 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad864b5e3e0ab6a635ee/lava-logs.yaml 2026-03-30 17:08:33,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:33,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:33,213 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad864b5e3e0ab6a635ee/lava_callback.json.gz 2026-03-30 17:08:33,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:33,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad864b5e3e0ab6a635ee HTTP/1.1" 200 None 2026-03-30 17:08:33,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:33,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:08:33,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:33,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad864b5e3e0ab6a635ee HTTP/1.1" 200 None 2026-03-30 17:08:33,303 - lava_callback - INFO - Completed processing callback for node 69caad864b5e3e0ab6a635ee 2026-03-30 17:08:33,721 - lava_callback - INFO - Received callback for node 69caad9d4b5e3e0ab6a63627 INFO: 172.20.0.1:44792 - "POST /node/69caad9d4b5e3e0ab6a63627 HTTP/1.0" 202 Accepted 2026-03-30 17:08:33,729 - lava_callback - INFO - Starting async job submit for node 69caad9d4b5e3e0ab6a63627 2026-03-30 17:08:33,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:33,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad9d4b5e3e0ab6a63627 HTTP/1.1" 200 None 2026-03-30 17:08:33,773 - lava_callback - DEBUG - Processing node 69caad9d4b5e3e0ab6a63627: baseline-arm64-broonie 2026-03-30 17:08:34,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:34,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:34,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad9d4b5e3e0ab6a63627/log.txt.gz 2026-03-30 17:08:34,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:34,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:34,520 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad9d4b5e3e0ab6a63627/lava-logs.yaml 2026-03-30 17:08:34,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:34,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:34,658 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad9d4b5e3e0ab6a63627/lava_callback.json.gz 2026-03-30 17:08:34,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:34,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad9d4b5e3e0ab6a63627 HTTP/1.1" 200 None 2026-03-30 17:08:34,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:34,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:08:34,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:34,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad9d4b5e3e0ab6a63627 HTTP/1.1" 200 None 2026-03-30 17:08:34,756 - lava_callback - INFO - Completed processing callback for node 69caad9d4b5e3e0ab6a63627 2026-03-30 17:08:35,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:35,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:44796 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:08:42,053 - lava_callback - INFO - Received callback for node 69caad954b5e3e0ab6a63610 INFO: 172.20.0.1:40350 - "POST /node/69caad954b5e3e0ab6a63610 HTTP/1.0" 202 Accepted 2026-03-30 17:08:42,059 - lava_callback - INFO - Starting async job submit for node 69caad954b5e3e0ab6a63610 2026-03-30 17:08:42,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:42,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad954b5e3e0ab6a63610 HTTP/1.1" 200 None 2026-03-30 17:08:42,096 - lava_callback - DEBUG - Processing node 69caad954b5e3e0ab6a63610: baseline-arm64-broonie 2026-03-30 17:08:42,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:42,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:42,487 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad954b5e3e0ab6a63610/log.txt.gz 2026-03-30 17:08:42,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:42,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:42,856 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad954b5e3e0ab6a63610/lava-logs.yaml 2026-03-30 17:08:42,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:42,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:42,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad954b5e3e0ab6a63610/lava_callback.json.gz 2026-03-30 17:08:43,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:43,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad954b5e3e0ab6a63610 HTTP/1.1" 200 None 2026-03-30 17:08:43,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:43,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:08:43,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:43,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad954b5e3e0ab6a63610 HTTP/1.1" 200 None 2026-03-30 17:08:43,085 - lava_callback - INFO - Completed processing callback for node 69caad954b5e3e0ab6a63610 2026-03-30 17:08:43,553 - lava_callback - INFO - Received callback for node 69caad9a4b5e3e0ab6a6361c INFO: 172.20.0.1:40358 - "POST /node/69caad9a4b5e3e0ab6a6361c HTTP/1.0" 202 Accepted 2026-03-30 17:08:43,563 - lava_callback - INFO - Starting async job submit for node 69caad9a4b5e3e0ab6a6361c 2026-03-30 17:08:43,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:43,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad9a4b5e3e0ab6a6361c HTTP/1.1" 200 None 2026-03-30 17:08:43,604 - lava_callback - DEBUG - Processing node 69caad9a4b5e3e0ab6a6361c: baseline-arm64-broonie 2026-03-30 17:08:43,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:44,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:44,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad9a4b5e3e0ab6a6361c/log.txt.gz 2026-03-30 17:08:44,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:44,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:44,961 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad9a4b5e3e0ab6a6361c/lava-logs.yaml 2026-03-30 17:08:44,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:08:45,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:08:45,110 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad9a4b5e3e0ab6a6361c/lava_callback.json.gz 2026-03-30 17:08:45,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:45,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad9a4b5e3e0ab6a6361c HTTP/1.1" 200 None 2026-03-30 17:08:45,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:45,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:08:45,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:08:45,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad9a4b5e3e0ab6a6361c HTTP/1.1" 200 None 2026-03-30 17:08:45,195 - lava_callback - INFO - Completed processing callback for node 69caad9a4b5e3e0ab6a6361c INFO: 172.20.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35408 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:09:03,212 - lava_callback - INFO - Received callback for node 69caad694b5e3e0ab6a63582 INFO: 172.20.0.1:34384 - "POST /node/69caad694b5e3e0ab6a63582 HTTP/1.0" 202 Accepted 2026-03-30 17:09:03,221 - lava_callback - INFO - Starting async job submit for node 69caad694b5e3e0ab6a63582 2026-03-30 17:09:03,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:03,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad694b5e3e0ab6a63582 HTTP/1.1" 200 None 2026-03-30 17:09:03,271 - lava_callback - DEBUG - Processing node 69caad694b5e3e0ab6a63582: baseline-arm64 2026-03-30 17:09:03,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:03,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:03,997 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad694b5e3e0ab6a63582/log.txt.gz 2026-03-30 17:09:04,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:04,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:04,564 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad694b5e3e0ab6a63582/lava-logs.yaml 2026-03-30 17:09:04,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:04,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:04,726 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad694b5e3e0ab6a63582/lava_callback.json.gz 2026-03-30 17:09:04,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:04,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad694b5e3e0ab6a63582 HTTP/1.1" 200 None 2026-03-30 17:09:04,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:04,840 - lava_callback - INFO - Received callback for node 69caae234b5e3e0ab6a63784 INFO: 172.20.0.1:34400 - "POST /node/69caae234b5e3e0ab6a63784 HTTP/1.0" 202 Accepted 2026-03-30 17:09:04,852 - lava_callback - INFO - Starting async job submit for node 69caae234b5e3e0ab6a63784 2026-03-30 17:09:04,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:04,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:09:04,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:04,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caae234b5e3e0ab6a63784 HTTP/1.1" 200 None 2026-03-30 17:09:04,886 - lava_callback - DEBUG - Processing node 69caae234b5e3e0ab6a63784: baseline-arm 2026-03-30 17:09:04,896 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:09:04,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:04,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad694b5e3e0ab6a63582 HTTP/1.1" 200 None 2026-03-30 17:09:04,978 - lava_callback - INFO - Completed processing callback for node 69caad694b5e3e0ab6a63582 2026-03-30 17:09:05,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:05,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69caae234b5e3e0ab6a63784/lava-logs.yaml 2026-03-30 17:09:05,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:05,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:05,425 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69caae234b5e3e0ab6a63784/lava_callback.json.gz 2026-03-30 17:09:05,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:05,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caae234b5e3e0ab6a63784 HTTP/1.1" 200 None 2026-03-30 17:09:05,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:05,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:09:05,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:05,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caae234b5e3e0ab6a63784 HTTP/1.1" 200 None 2026-03-30 17:09:05,518 - lava_callback - INFO - Completed processing callback for node 69caae234b5e3e0ab6a63784 2026-03-30 17:09:05,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:05,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33256 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:09:33,682 - lava_callback - INFO - Received callback for node 69caab924b5e3e0ab6a6344f INFO: 172.20.0.1:33270 - "POST /node/69caab924b5e3e0ab6a6344f HTTP/1.0" 202 Accepted 2026-03-30 17:09:33,689 - lava_callback - INFO - Starting async job submit for node 69caab924b5e3e0ab6a6344f 2026-03-30 17:09:33,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:33,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab924b5e3e0ab6a6344f HTTP/1.1" 200 None 2026-03-30 17:09:33,739 - lava_callback - DEBUG - Processing node 69caab924b5e3e0ab6a6344f: ltp-ipc 2026-03-30 17:09:34,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:34,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:34,452 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69caab924b5e3e0ab6a6344f/log.txt.gz 2026-03-30 17:09:34,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:35,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:35,022 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69caab924b5e3e0ab6a6344f/lava-logs.yaml 2026-03-30 17:09:35,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:35,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:35,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69caab924b5e3e0ab6a6344f/lava_callback.json.gz 2026-03-30 17:09:35,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:35,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab924b5e3e0ab6a6344f HTTP/1.1" 200 None 2026-03-30 17:09:35,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:35,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:09:35,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:35,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab924b5e3e0ab6a6344f HTTP/1.1" 200 None 2026-03-30 17:09:35,521 - lava_callback - INFO - Completed processing callback for node 69caab924b5e3e0ab6a6344f 2026-03-30 17:09:35,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:35,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-30 17:09:36,070 - lava_callback - INFO - Received callback for node 69caad924b5e3e0ab6a6360a INFO: 172.20.0.1:33280 - "POST /node/69caad924b5e3e0ab6a6360a HTTP/1.0" 202 Accepted 2026-03-30 17:09:36,078 - lava_callback - INFO - Starting async job submit for node 69caad924b5e3e0ab6a6360a 2026-03-30 17:09:36,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:36,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad924b5e3e0ab6a6360a HTTP/1.1" 200 None 2026-03-30 17:09:36,167 - lava_callback - DEBUG - Processing node 69caad924b5e3e0ab6a6360a: baseline-arm64-broonie 2026-03-30 17:09:36,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:33292 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:09:36,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:36,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad924b5e3e0ab6a6360a/log.txt.gz 2026-03-30 17:09:36,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:37,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:37,153 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad924b5e3e0ab6a6360a/lava-logs.yaml 2026-03-30 17:09:37,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:37,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:37,597 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad924b5e3e0ab6a6360a/lava_callback.json.gz 2026-03-30 17:09:37,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:37,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad924b5e3e0ab6a6360a HTTP/1.1" 200 None 2026-03-30 17:09:37,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:37,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:09:37,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:37,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad924b5e3e0ab6a6360a HTTP/1.1" 200 None 2026-03-30 17:09:37,738 - lava_callback - INFO - Completed processing callback for node 69caad924b5e3e0ab6a6360a 2026-03-30 17:09:42,578 - lava_callback - INFO - Received callback for node 69caab8e4b5e3e0ab6a63449 INFO: 172.20.0.1:48486 - "POST /node/69caab8e4b5e3e0ab6a63449 HTTP/1.0" 202 Accepted 2026-03-30 17:09:42,589 - lava_callback - INFO - Starting async job submit for node 69caab8e4b5e3e0ab6a63449 2026-03-30 17:09:42,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:42,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab8e4b5e3e0ab6a63449 HTTP/1.1" 200 None 2026-03-30 17:09:42,667 - lava_callback - DEBUG - Processing node 69caab8e4b5e3e0ab6a63449: ltp-fsx 2026-03-30 17:09:43,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:43,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:43,507 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69caab8e4b5e3e0ab6a63449/log.txt.gz 2026-03-30 17:09:43,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:44,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:44,243 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69caab8e4b5e3e0ab6a63449/lava-logs.yaml 2026-03-30 17:09:44,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:44,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:44,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69caab8e4b5e3e0ab6a63449/lava_callback.json.gz 2026-03-30 17:09:44,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:44,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab8e4b5e3e0ab6a63449 HTTP/1.1" 200 None 2026-03-30 17:09:44,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:44,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:09:44,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:44,519 - lava_callback - INFO - Received callback for node 69caab904b5e3e0ab6a6344c 2026-03-30 17:09:44,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab8e4b5e3e0ab6a63449 HTTP/1.1" 200 None 2026-03-30 17:09:44,562 - lava_callback - INFO - Completed processing callback for node 69caab8e4b5e3e0ab6a63449 INFO: 172.20.0.1:48500 - "POST /node/69caab904b5e3e0ab6a6344c HTTP/1.0" 202 Accepted 2026-03-30 17:09:44,563 - lava_callback - INFO - Starting async job submit for node 69caab904b5e3e0ab6a6344c 2026-03-30 17:09:44,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:44,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab904b5e3e0ab6a6344c HTTP/1.1" 200 None 2026-03-30 17:09:44,679 - lava_callback - DEBUG - Processing node 69caab904b5e3e0ab6a6344c: ltp-input 2026-03-30 17:09:45,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:45,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:45,734 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69caab904b5e3e0ab6a6344c/log.txt.gz 2026-03-30 17:09:45,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:09:46,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:46,434 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69caab904b5e3e0ab6a6344c/lava-logs.yaml 2026-03-30 17:09:46,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:48516 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:09:46,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:09:46,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69caab904b5e3e0ab6a6344c/lava_callback.json.gz 2026-03-30 17:09:46,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:46,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab904b5e3e0ab6a6344c HTTP/1.1" 200 None 2026-03-30 17:09:46,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:46,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:09:46,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:09:46,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab904b5e3e0ab6a6344c HTTP/1.1" 200 None 2026-03-30 17:09:46,749 - lava_callback - INFO - Completed processing callback for node 69caab904b5e3e0ab6a6344c INFO: 172.20.0.1:34584 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:10:05,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:10:05,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54534 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:10:10,620 - lava_callback - INFO - Received callback for node 69caad794b5e3e0ab6a635ae INFO: 172.20.0.1:33542 - "POST /node/69caad794b5e3e0ab6a635ae HTTP/1.0" 202 Accepted 2026-03-30 17:10:10,631 - lava_callback - INFO - Starting async job submit for node 69caad794b5e3e0ab6a635ae 2026-03-30 17:10:10,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:10:10,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad794b5e3e0ab6a635ae HTTP/1.1" 200 None 2026-03-30 17:10:10,688 - lava_callback - DEBUG - Processing node 69caad794b5e3e0ab6a635ae: baseline-nfs-arm64 2026-03-30 17:10:11,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:10:11,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:10:11,479 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad794b5e3e0ab6a635ae/log.txt.gz 2026-03-30 17:10:11,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:10:12,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:10:12,172 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad794b5e3e0ab6a635ae/lava-logs.yaml 2026-03-30 17:10:12,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:10:12,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:10:12,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad794b5e3e0ab6a635ae/lava_callback.json.gz 2026-03-30 17:10:12,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:10:12,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad794b5e3e0ab6a635ae HTTP/1.1" 200 None 2026-03-30 17:10:12,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:10:12,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:10:12,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:10:12,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad794b5e3e0ab6a635ae HTTP/1.1" 200 None 2026-03-30 17:10:12,759 - lava_callback - INFO - Completed processing callback for node 69caad794b5e3e0ab6a635ae 2026-03-30 17:10:14,033 - lava_callback - INFO - Received callback for node 69caad974b5e3e0ab6a63613 INFO: 172.20.0.1:33554 - "POST /node/69caad974b5e3e0ab6a63613 HTTP/1.0" 202 Accepted 2026-03-30 17:10:14,044 - lava_callback - INFO - Starting async job submit for node 69caad974b5e3e0ab6a63613 2026-03-30 17:10:14,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:10:14,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad974b5e3e0ab6a63613 HTTP/1.1" 200 None 2026-03-30 17:10:14,115 - lava_callback - DEBUG - Processing node 69caad974b5e3e0ab6a63613: baseline-arm64-broonie 2026-03-30 17:10:14,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:10:14,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:10:14,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad974b5e3e0ab6a63613/log.txt.gz INFO: 172.20.0.1:33562 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 17:10:15,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:10:15,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:10:15,789 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad974b5e3e0ab6a63613/lava-logs.yaml 2026-03-30 17:10:15,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:10:15,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:10:15,973 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad974b5e3e0ab6a63613/lava_callback.json.gz 2026-03-30 17:10:15,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:10:16,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad974b5e3e0ab6a63613 HTTP/1.1" 200 None 2026-03-30 17:10:16,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:10:16,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:10:16,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:10:16,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad974b5e3e0ab6a63613 HTTP/1.1" 200 None 2026-03-30 17:10:16,073 - lava_callback - INFO - Completed processing callback for node 69caad974b5e3e0ab6a63613 INFO: 172.20.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54656 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:10:35,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:10:35,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59084 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:11:51,804 - lava_callback - INFO - Received callback for node 69caad764b5e3e0ab6a635a8 INFO: 172.20.0.1:36954 - "POST /node/69caad764b5e3e0ab6a635a8 HTTP/1.0" 202 Accepted 2026-03-30 17:11:51,816 - lava_callback - INFO - Starting async job submit for node 69caad764b5e3e0ab6a635a8 2026-03-30 17:11:51,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:11:51,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad764b5e3e0ab6a635a8 HTTP/1.1" 200 None 2026-03-30 17:11:51,920 - lava_callback - DEBUG - Processing node 69caad764b5e3e0ab6a635a8: baseline-arm64 2026-03-30 17:11:52,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:11:52,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:11:52,659 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad764b5e3e0ab6a635a8/log.txt.gz 2026-03-30 17:11:52,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:11:53,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:11:53,283 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad764b5e3e0ab6a635a8/lava-logs.yaml 2026-03-30 17:11:53,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:11:53,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:11:53,423 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad764b5e3e0ab6a635a8/lava_callback.json.gz DEBUG: Setup failed for 69caad764b5e3e0ab6a635a8. Transitting job node result: incomplete -> fail 2026-03-30 17:11:53,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:11:53,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad764b5e3e0ab6a635a8 HTTP/1.1" 200 None 2026-03-30 17:11:53,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:11:53,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:11:53,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:11:53,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad764b5e3e0ab6a635a8 HTTP/1.1" 200 None 2026-03-30 17:11:53,713 - lava_callback - INFO - Completed processing callback for node 69caad764b5e3e0ab6a635a8 INFO: 172.20.0.1:36956 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:12:02,396 - lava_callback - INFO - Received callback for node 69caab944b5e3e0ab6a63452 INFO: 172.20.0.1:35850 - "POST /node/69caab944b5e3e0ab6a63452 HTTP/1.0" 202 Accepted 2026-03-30 17:12:02,403 - lava_callback - INFO - Starting async job submit for node 69caab944b5e3e0ab6a63452 2026-03-30 17:12:02,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:12:02,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab944b5e3e0ab6a63452 HTTP/1.1" 200 None 2026-03-30 17:12:02,444 - lava_callback - DEBUG - Processing node 69caab944b5e3e0ab6a63452: ltp-pty 2026-03-30 17:12:02,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:12:03,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:12:03,116 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69caab944b5e3e0ab6a63452/log.txt.gz 2026-03-30 17:12:03,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:12:03,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:12:03,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69caab944b5e3e0ab6a63452/lava-logs.yaml 2026-03-30 17:12:03,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:12:03,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:12:03,830 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69caab944b5e3e0ab6a63452/lava_callback.json.gz 2026-03-30 17:12:03,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:12:03,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab944b5e3e0ab6a63452 HTTP/1.1" 200 None 2026-03-30 17:12:03,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:12:03,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:12:03,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:12:03,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab944b5e3e0ab6a63452 HTTP/1.1" 200 None 2026-03-30 17:12:03,922 - lava_callback - INFO - Completed processing callback for node 69caab944b5e3e0ab6a63452 2026-03-30 17:12:05,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:12:05,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33666 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:13:33,779 - lava_callback - INFO - Received callback for node 69caab984b5e3e0ab6a63458 INFO: 172.20.0.1:33682 - "POST /node/69caab984b5e3e0ab6a63458 HTTP/1.0" 202 Accepted 2026-03-30 17:13:33,789 - lava_callback - INFO - Starting async job submit for node 69caab984b5e3e0ab6a63458 2026-03-30 17:13:33,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:13:33,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab984b5e3e0ab6a63458 HTTP/1.1" 200 None 2026-03-30 17:13:33,860 - lava_callback - DEBUG - Processing node 69caab984b5e3e0ab6a63458: ltp-smoke 2026-03-30 17:13:34,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:13:34,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:13:34,502 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69caab984b5e3e0ab6a63458/log.txt.gz 2026-03-30 17:13:34,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:13:35,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:13:35,491 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69caab984b5e3e0ab6a63458/lava-logs.yaml 2026-03-30 17:13:35,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:13:35,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:13:35,665 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69caab984b5e3e0ab6a63458/lava_callback.json.gz 2026-03-30 17:13:35,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:13:35,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab984b5e3e0ab6a63458 HTTP/1.1" 200 None 2026-03-30 17:13:35,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:13:35,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:13:35,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:13:35,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab984b5e3e0ab6a63458 HTTP/1.1" 200 None 2026-03-30 17:13:35,755 - lava_callback - INFO - Completed processing callback for node 69caab984b5e3e0ab6a63458 INFO: 172.20.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35824 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:14:02,410 - lava_callback - INFO - Received callback for node 69caab9c4b5e3e0ab6a6345e INFO: 172.20.0.1:47460 - "POST /node/69caab9c4b5e3e0ab6a6345e HTTP/1.0" 202 Accepted 2026-03-30 17:14:02,421 - lava_callback - INFO - Starting async job submit for node 69caab9c4b5e3e0ab6a6345e 2026-03-30 17:14:02,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:02,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab9c4b5e3e0ab6a6345e HTTP/1.1" 200 None 2026-03-30 17:14:02,494 - lava_callback - DEBUG - Processing node 69caab9c4b5e3e0ab6a6345e: ltp-syscalls-ipc 2026-03-30 17:14:03,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:14:03,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:14:03,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69caab9c4b5e3e0ab6a6345e/log.txt.gz 2026-03-30 17:14:03,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:14:03,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:14:03,832 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69caab9c4b5e3e0ab6a6345e/lava-logs.yaml 2026-03-30 17:14:03,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:14:04,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:14:04,179 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69caab9c4b5e3e0ab6a6345e/lava_callback.json.gz 2026-03-30 17:14:04,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:04,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab9c4b5e3e0ab6a6345e HTTP/1.1" 200 None 2026-03-30 17:14:04,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:04,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:14:04,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:04,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab9c4b5e3e0ab6a6345e HTTP/1.1" 200 None 2026-03-30 17:14:04,336 - lava_callback - INFO - Completed processing callback for node 69caab9c4b5e3e0ab6a6345e 2026-03-30 17:14:05,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:05,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60996 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:14:20,846 - lava_callback - INFO - Received callback for node 69caab434b5e3e0ab6a63377 INFO: 172.20.0.1:47504 - "POST /node/69caab434b5e3e0ab6a63377 HTTP/1.0" 202 Accepted 2026-03-30 17:14:20,860 - lava_callback - INFO - Starting async job submit for node 69caab434b5e3e0ab6a63377 2026-03-30 17:14:20,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:20,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab434b5e3e0ab6a63377 HTTP/1.1" 200 None 2026-03-30 17:14:20,960 - lava_callback - DEBUG - Processing node 69caab434b5e3e0ab6a63377: baseline-arm 2026-03-30 17:14:21,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:14:21,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:14:21,989 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69caab434b5e3e0ab6a63377/log.txt.gz 2026-03-30 17:14:22,606 - lava_callback - INFO - Received callback for node 69caab964b5e3e0ab6a63455 INFO: 172.20.0.1:47512 - "POST /node/69caab964b5e3e0ab6a63455 HTTP/1.0" 202 Accepted 2026-03-30 17:14:22,619 - lava_callback - INFO - Starting async job submit for node 69caab964b5e3e0ab6a63455 2026-03-30 17:14:22,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:14:22,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:22,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab964b5e3e0ab6a63455 HTTP/1.1" 200 None 2026-03-30 17:14:22,720 - lava_callback - DEBUG - Processing node 69caab964b5e3e0ab6a63455: ltp-sched 2026-03-30 17:14:22,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:14:23,010 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69caab434b5e3e0ab6a63377/lava-logs.yaml 2026-03-30 17:14:23,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:14:23,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:14:23,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:14:23,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69caab434b5e3e0ab6a63377/lava_callback.json.gz 2026-03-30 17:14:23,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:14:23,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69caab964b5e3e0ab6a63455/log.txt.gz DEBUG: Setup failed for 69caab434b5e3e0ab6a63377. Transitting job node result: incomplete -> fail 2026-03-30 17:14:23,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:23,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab434b5e3e0ab6a63377 HTTP/1.1" 200 None 2026-03-30 17:14:23,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:24,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:14:24,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:14:24,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:24,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab434b5e3e0ab6a63377 HTTP/1.1" 200 None 2026-03-30 17:14:24,232 - lava_callback - INFO - Completed processing callback for node 69caab434b5e3e0ab6a63377 2026-03-30 17:14:24,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:14:24,353 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69caab964b5e3e0ab6a63455/lava-logs.yaml 2026-03-30 17:14:24,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:14:24,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:14:24,611 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69caab964b5e3e0ab6a63455/lava_callback.json.gz 2026-03-30 17:14:24,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:24,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab964b5e3e0ab6a63455 HTTP/1.1" 200 None 2026-03-30 17:14:24,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:24,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:14:24,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:24,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab964b5e3e0ab6a63455 HTTP/1.1" 200 None 2026-03-30 17:14:24,737 - lava_callback - INFO - Completed processing callback for node 69caab964b5e3e0ab6a63455 INFO: 172.20.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:14:35,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:14:35,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46082 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:16:02,482 - lava_callback - INFO - Received callback for node 69caab9e4b5e3e0ab6a63467 INFO: 172.20.0.1:42124 - "POST /node/69caab9e4b5e3e0ab6a63467 HTTP/1.0" 202 Accepted 2026-03-30 17:16:02,489 - lava_callback - INFO - Starting async job submit for node 69caab9e4b5e3e0ab6a63467 2026-03-30 17:16:02,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:02,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab9e4b5e3e0ab6a63467 HTTP/1.1" 200 None 2026-03-30 17:16:02,548 - lava_callback - DEBUG - Processing node 69caab9e4b5e3e0ab6a63467: ltp-timers 2026-03-30 17:16:02,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:16:03,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:16:03,048 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69caab9e4b5e3e0ab6a63467/log.txt.gz 2026-03-30 17:16:03,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:16:03,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:16:03,455 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69caab9e4b5e3e0ab6a63467/lava-logs.yaml 2026-03-30 17:16:03,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:16:03,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:16:03,621 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69caab9e4b5e3e0ab6a63467/lava_callback.json.gz 2026-03-30 17:16:03,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:03,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab9e4b5e3e0ab6a63467 HTTP/1.1" 200 None 2026-03-30 17:16:03,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:03,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:16:03,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:03,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab9e4b5e3e0ab6a63467 HTTP/1.1" 200 None 2026-03-30 17:16:03,738 - lava_callback - INFO - Completed processing callback for node 69caab9e4b5e3e0ab6a63467 2026-03-30 17:16:05,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:05,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50820 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:16:41,493 - lava_callback - INFO - Received callback for node 69caab6d4b5e3e0ab6a63410 INFO: 172.20.0.1:58134 - "POST /node/69caab6d4b5e3e0ab6a63410 HTTP/1.0" 202 Accepted 2026-03-30 17:16:41,543 - lava_callback - INFO - Starting async job submit for node 69caab6d4b5e3e0ab6a63410 2026-03-30 17:16:41,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:41,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab6d4b5e3e0ab6a63410 HTTP/1.1" 200 None 2026-03-30 17:16:41,599 - lava_callback - DEBUG - Processing node 69caab6d4b5e3e0ab6a63410: baseline-arm-pengutronix 2026-03-30 17:16:41,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:16:41,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:16:41,892 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6d4b5e3e0ab6a63410/log.txt.gz 2026-03-30 17:16:41,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:16:42,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:16:42,132 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6d4b5e3e0ab6a63410/lava-logs.yaml 2026-03-30 17:16:42,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:16:42,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:16:42,291 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69caab6d4b5e3e0ab6a63410/lava_callback.json.gz DEBUG: Setup failed for 69caab6d4b5e3e0ab6a63410. Transitting job node result: incomplete -> fail 2026-03-30 17:16:42,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:42,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caab6d4b5e3e0ab6a63410 HTTP/1.1" 200 None 2026-03-30 17:16:42,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:42,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:16:42,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:42,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caab6d4b5e3e0ab6a63410 HTTP/1.1" 200 None 2026-03-30 17:16:42,463 - lava_callback - INFO - Completed processing callback for node 69caab6d4b5e3e0ab6a63410 2026-03-30 17:16:43,875 - lava_callback - INFO - Received callback for node 69caad714b5e3e0ab6a6359c INFO: 172.20.0.1:58144 - "POST /node/69caad714b5e3e0ab6a6359c HTTP/1.0" 202 Accepted 2026-03-30 17:16:43,882 - lava_callback - INFO - Starting async job submit for node 69caad714b5e3e0ab6a6359c 2026-03-30 17:16:43,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:43,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad714b5e3e0ab6a6359c HTTP/1.1" 200 None 2026-03-30 17:16:43,933 - lava_callback - DEBUG - Processing node 69caad714b5e3e0ab6a6359c: baseline-arm64 2026-03-30 17:16:44,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:16:44,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:16:44,699 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad714b5e3e0ab6a6359c/log.txt.gz 2026-03-30 17:16:45,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:16:45,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:16:45,203 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad714b5e3e0ab6a6359c/lava-logs.yaml 2026-03-30 17:16:45,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:16:45,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:16:45,379 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69caad714b5e3e0ab6a6359c/lava_callback.json.gz 2026-03-30 17:16:45,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:45,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad714b5e3e0ab6a6359c HTTP/1.1" 200 None 2026-03-30 17:16:45,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:45,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:16:45,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:16:45,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad714b5e3e0ab6a6359c HTTP/1.1" 200 None 2026-03-30 17:16:45,526 - lava_callback - INFO - Completed processing callback for node 69caad714b5e3e0ab6a6359c INFO: 172.20.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42994 - "GET /node/693f414624745582e399fc3d%5Cn HTTP/1.0" 405 Method Not Allowed 2026-03-30 17:17:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:17:05,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48282 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 17:17:16,480 - lava_callback - INFO - Received callback for node 69c80d19123b47fd23770538 INFO: 172.20.0.1:48298 - "POST /node/69c80d19123b47fd23770538 HTTP/1.0" 202 Accepted 2026-03-30 17:17:16,486 - lava_callback - INFO - Starting async job submit for node 69c80d19123b47fd23770538 2026-03-30 17:17:16,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:17:16,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80d19123b47fd23770538 HTTP/1.1" 200 None 2026-03-30 17:17:16,505 - lava_callback - DEBUG - Processing node 69c80d19123b47fd23770538: baseline-arm-baylibre 2026-03-30 17:17:16,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80d19123b47fd23770538 2026-03-30 17:17:16,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:17:16,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80d19123b47fd23770538 HTTP/1.1" 200 None 2026-03-30 17:17:16,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:48306 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:17:16,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-30 17:17:16,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:17:16,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80d19123b47fd23770538 HTTP/1.1" 200 None 2026-03-30 17:17:16,562 - lava_callback - ERROR - Error processing callback for node 69c80d19123b47fd23770538: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56680 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:17:34,143 - lava_callback - INFO - Received callback for node 69caaba04b5e3e0ab6a6346a INFO: 172.20.0.1:56684 - "POST /node/69caaba04b5e3e0ab6a6346a HTTP/1.0" 202 Accepted 2026-03-30 17:17:34,150 - lava_callback - INFO - Starting async job submit for node 69caaba04b5e3e0ab6a6346a 2026-03-30 17:17:34,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:17:34,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaba04b5e3e0ab6a6346a HTTP/1.1" 200 None 2026-03-30 17:17:34,214 - lava_callback - DEBUG - Processing node 69caaba04b5e3e0ab6a6346a: ltp-watchqueue 2026-03-30 17:17:34,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:17:34,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:17:34,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69caaba04b5e3e0ab6a6346a/log.txt.gz 2026-03-30 17:17:35,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:17:35,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:17:35,238 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69caaba04b5e3e0ab6a6346a/lava-logs.yaml 2026-03-30 17:17:35,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:17:35,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:17:35,431 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69caaba04b5e3e0ab6a6346a/lava_callback.json.gz 2026-03-30 17:17:35,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:17:35,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caaba04b5e3e0ab6a6346a HTTP/1.1" 200 None 2026-03-30 17:17:35,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:17:35,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:17:35,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:17:35,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caaba04b5e3e0ab6a6346a HTTP/1.1" 200 None 2026-03-30 17:17:35,515 - lava_callback - INFO - Completed processing callback for node 69caaba04b5e3e0ab6a6346a 2026-03-30 17:17:35,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:17:35,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42664 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 17:19:16,459 - lava_callback - INFO - Received callback for node 69c80d89123b47fd2377054f INFO: 172.20.0.1:42670 - "POST /node/69c80d89123b47fd2377054f HTTP/1.0" 202 Accepted 2026-03-30 17:19:16,465 - lava_callback - INFO - Starting async job submit for node 69c80d89123b47fd2377054f 2026-03-30 17:19:16,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:19:16,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80d89123b47fd2377054f HTTP/1.1" 200 None 2026-03-30 17:19:16,483 - lava_callback - DEBUG - Processing node 69c80d89123b47fd2377054f: baseline-arm-baylibre 2026-03-30 17:19:16,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80d89123b47fd2377054f 2026-03-30 17:19:16,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:19:16,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80d89123b47fd2377054f HTTP/1.1" 200 None 2026-03-30 17:19:16,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:42680 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:19:16,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-30 17:19:16,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:19:16,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80d89123b47fd2377054f HTTP/1.1" 200 None 2026-03-30 17:19:16,549 - lava_callback - ERROR - Error processing callback for node 69c80d89123b47fd2377054f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35322 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:20:14,173 - lava_callback - INFO - Received callback for node 69cab0c74b5e3e0ab6a638e8 INFO: 172.20.0.1:51512 - "POST /node/69cab0c74b5e3e0ab6a638e8 HTTP/1.0" 202 Accepted 2026-03-30 17:20:14,179 - lava_callback - INFO - Starting async job submit for node 69cab0c74b5e3e0ab6a638e8 2026-03-30 17:20:14,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:14,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab0c74b5e3e0ab6a638e8 HTTP/1.1" 200 None 2026-03-30 17:20:14,198 - lava_callback - DEBUG - Processing node 69cab0c74b5e3e0ab6a638e8: baseline-nfs-arm64 2026-03-30 17:20:14,200 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:20:14,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:20:14,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:20:14,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab0c74b5e3e0ab6a638e8/lava-logs.yaml 2026-03-30 17:20:14,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:20:14,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:20:14,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab0c74b5e3e0ab6a638e8/lava_callback.json.gz 2026-03-30 17:20:14,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:14,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab0c74b5e3e0ab6a638e8 HTTP/1.1" 200 None 2026-03-30 17:20:14,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:14,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:20:14,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:14,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab0c74b5e3e0ab6a638e8 HTTP/1.1" 200 None 2026-03-30 17:20:14,570 - lava_callback - INFO - Completed processing callback for node 69cab0c74b5e3e0ab6a638e8 INFO: 172.20.0.1:51528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53288 - "GET /node/69483dd99214b493871673ae%5Cn HTTP/1.0" 405 Method Not Allowed 2026-03-30 17:20:35,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:35,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53292 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:20:36,549 - lava_callback - INFO - Received callback for node 69c80dd1123b47fd23770565 INFO: 172.20.0.1:53306 - "POST /node/69c80dd1123b47fd23770565 HTTP/1.0" 202 Accepted 2026-03-30 17:20:36,555 - lava_callback - INFO - Starting async job submit for node 69c80dd1123b47fd23770565 2026-03-30 17:20:36,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:36,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80dd1123b47fd23770565 HTTP/1.1" 200 None 2026-03-30 17:20:36,572 - lava_callback - DEBUG - Processing node 69c80dd1123b47fd23770565: baseline-arm-baylibre 2026-03-30 17:20:36,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80dd1123b47fd23770565 2026-03-30 17:20:36,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:36,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80dd1123b47fd23770565 HTTP/1.1" 200 None 2026-03-30 17:20:36,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:36,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-30 17:20:36,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:36,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80dd1123b47fd23770565 HTTP/1.1" 200 None 2026-03-30 17:20:36,629 - lava_callback - ERROR - Error processing callback for node 69c80dd1123b47fd23770565: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53320 - "GET /node/6919ac1540db568ee36c59d9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56214 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:20:56,517 - lava_callback - INFO - Received callback for node 69c80df6123b47fd23770572 INFO: 172.20.0.1:56224 - "POST /node/69c80df6123b47fd23770572 HTTP/1.0" 202 Accepted 2026-03-30 17:20:56,523 - lava_callback - INFO - Starting async job submit for node 69c80df6123b47fd23770572 2026-03-30 17:20:56,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:56,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80df6123b47fd23770572 HTTP/1.1" 200 None 2026-03-30 17:20:56,541 - lava_callback - DEBUG - Processing node 69c80df6123b47fd23770572: baseline-arm-baylibre 2026-03-30 17:20:56,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80df6123b47fd23770572 2026-03-30 17:20:56,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:56,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80df6123b47fd23770572 HTTP/1.1" 200 None 2026-03-30 17:20:56,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:56,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-30 17:20:56,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:20:56,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80df6123b47fd23770572 HTTP/1.1" 200 None 2026-03-30 17:20:56,598 - lava_callback - ERROR - Error processing callback for node 69c80df6123b47fd23770572: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36770 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:22:56,700 - lava_callback - INFO - Received callback for node 69c80e64123b47fd23770587 INFO: 172.20.0.1:36772 - "POST /node/69c80e64123b47fd23770587 HTTP/1.0" 202 Accepted 2026-03-30 17:22:56,707 - lava_callback - INFO - Starting async job submit for node 69c80e64123b47fd23770587 2026-03-30 17:22:56,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:22:56,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80e64123b47fd23770587 HTTP/1.1" 200 None 2026-03-30 17:22:56,728 - lava_callback - DEBUG - Processing node 69c80e64123b47fd23770587: baseline-arm-baylibre 2026-03-30 17:22:56,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80e64123b47fd23770587 2026-03-30 17:22:56,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:22:56,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80e64123b47fd23770587 HTTP/1.1" 200 None 2026-03-30 17:22:56,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:22:56,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-30 17:22:56,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:22:56,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80e64123b47fd23770587 HTTP/1.1" 200 None 2026-03-30 17:22:56,783 - lava_callback - ERROR - Error processing callback for node 69c80e64123b47fd23770587: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58722 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:23:36,656 - lava_callback - INFO - Received callback for node 69c80e8a123b47fd23770597 INFO: 172.20.0.1:58732 - "POST /node/69c80e8a123b47fd23770597 HTTP/1.0" 202 Accepted 2026-03-30 17:23:36,665 - lava_callback - INFO - Starting async job submit for node 69c80e8a123b47fd23770597 2026-03-30 17:23:36,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:36,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80e8a123b47fd23770597 HTTP/1.1" 200 None 2026-03-30 17:23:36,682 - lava_callback - DEBUG - Processing node 69c80e8a123b47fd23770597: baseline-arm-baylibre 2026-03-30 17:23:36,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80e8a123b47fd23770597 2026-03-30 17:23:36,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:36,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80e8a123b47fd23770597 HTTP/1.1" 200 None 2026-03-30 17:23:36,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:36,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-30 17:23:36,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:36,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80e8a123b47fd23770597 HTTP/1.1" 200 None 2026-03-30 17:23:36,744 - lava_callback - ERROR - Error processing callback for node 69c80e8a123b47fd23770597: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 17:23:38,433 - lava_callback - INFO - Received callback for node 69cab1594b5e3e0ab6a63907 INFO: 172.20.0.1:58736 - "POST /node/69cab1594b5e3e0ab6a63907 HTTP/1.0" 202 Accepted 2026-03-30 17:23:38,440 - lava_callback - INFO - Starting async job submit for node 69cab1594b5e3e0ab6a63907 2026-03-30 17:23:38,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:38,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab1594b5e3e0ab6a63907 HTTP/1.1" 200 None 2026-03-30 17:23:38,498 - lava_callback - DEBUG - Processing node 69cab1594b5e3e0ab6a63907: baseline-arm64 2026-03-30 17:23:38,660 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:23:38,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:23:38,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:23:38,940 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab1594b5e3e0ab6a63907/lava-logs.yaml 2026-03-30 17:23:38,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:23:39,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:23:39,064 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab1594b5e3e0ab6a63907/lava_callback.json.gz 2026-03-30 17:23:39,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:39,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab1594b5e3e0ab6a63907 HTTP/1.1" 200 None 2026-03-30 17:23:39,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:39,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:23:39,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:39,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab1594b5e3e0ab6a63907 HTTP/1.1" 200 None 2026-03-30 17:23:39,265 - lava_callback - INFO - Completed processing callback for node 69cab1594b5e3e0ab6a63907 INFO: 172.20.0.1:40670 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:23:54,286 - lava_callback - INFO - Received callback for node 69caad8e4b5e3e0ab6a635fe INFO: 172.20.0.1:58070 - "POST /node/69caad8e4b5e3e0ab6a635fe HTTP/1.0" 202 Accepted 2026-03-30 17:23:54,293 - lava_callback - INFO - Starting async job submit for node 69caad8e4b5e3e0ab6a635fe 2026-03-30 17:23:54,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:54,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad8e4b5e3e0ab6a635fe HTTP/1.1" 200 None 2026-03-30 17:23:54,367 - lava_callback - DEBUG - Processing node 69caad8e4b5e3e0ab6a635fe: ltp-smoke 2026-03-30 17:23:54,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:23:55,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:23:55,006 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69caad8e4b5e3e0ab6a635fe/log.txt.gz 2026-03-30 17:23:55,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:23:55,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:23:55,499 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69caad8e4b5e3e0ab6a635fe/lava-logs.yaml 2026-03-30 17:23:55,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:23:55,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:23:55,684 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69caad8e4b5e3e0ab6a635fe/lava_callback.json.gz 2026-03-30 17:23:55,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:55,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad8e4b5e3e0ab6a635fe HTTP/1.1" 200 None 2026-03-30 17:23:55,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:55,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2504b5e3e0ab6a60b5d HTTP/1.1" 200 None 2026-03-30 17:23:55,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:23:55,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad8e4b5e3e0ab6a635fe HTTP/1.1" 200 None 2026-03-30 17:23:55,959 - lava_callback - INFO - Completed processing callback for node 69caad8e4b5e3e0ab6a635fe INFO: 172.20.0.1:58074 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:24:05,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:24:05,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41518 - "GET /node/69402b5f575bc060ce155404%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41522 - "GET /node/69be595d448e074b3ffe1727%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41524 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:24:56,049 - lava_callback - INFO - Received callback for node 69cab1a74b5e3e0ab6a63917 INFO: 172.20.0.1:54458 - "POST /node/69cab1a74b5e3e0ab6a63917 HTTP/1.0" 202 Accepted 2026-03-30 17:24:56,056 - lava_callback - INFO - Starting async job submit for node 69cab1a74b5e3e0ab6a63917 2026-03-30 17:24:56,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:24:56,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab1a74b5e3e0ab6a63917 HTTP/1.1" 200 None 2026-03-30 17:24:56,106 - lava_callback - DEBUG - Processing node 69cab1a74b5e3e0ab6a63917: baseline-arm64 2026-03-30 17:24:56,262 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:24:56,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:24:56,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:24:56,505 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab1a74b5e3e0ab6a63917/lava-logs.yaml 2026-03-30 17:24:56,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:54464 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:24:56,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:24:56,644 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab1a74b5e3e0ab6a63917/lava_callback.json.gz 2026-03-30 17:24:56,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:24:56,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab1a74b5e3e0ab6a63917 HTTP/1.1" 200 None 2026-03-30 17:24:56,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:24:56,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:24:56,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:24:56,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab1a74b5e3e0ab6a63917 HTTP/1.1" 200 None 2026-03-30 17:24:56,814 - lava_callback - INFO - Completed processing callback for node 69cab1a74b5e3e0ab6a63917 2026-03-30 17:25:05,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:25:05,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34850 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:25:27,832 - lava_callback - INFO - Received callback for node 69c80efa123b47fd237705be INFO: 172.20.0.1:34860 - "POST /node/69c80efa123b47fd237705be HTTP/1.0" 202 Accepted 2026-03-30 17:25:27,838 - lava_callback - INFO - Starting async job submit for node 69c80efa123b47fd237705be 2026-03-30 17:25:27,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:25:27,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80efa123b47fd237705be HTTP/1.1" 200 None 2026-03-30 17:25:27,858 - lava_callback - DEBUG - Processing node 69c80efa123b47fd237705be: baseline-arm-clabbe 2026-03-30 17:25:27,858 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80efa123b47fd237705be 2026-03-30 17:25:27,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:25:27,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80efa123b47fd237705be HTTP/1.1" 200 None 2026-03-30 17:25:27,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:25:27,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-30 17:25:27,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:25:27,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80efa123b47fd237705be HTTP/1.1" 200 None 2026-03-30 17:25:27,925 - lava_callback - ERROR - Error processing callback for node 69c80efa123b47fd237705be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54934 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:26:08,902 - lava_callback - INFO - Received callback for node 69caad7c4b5e3e0ab6a635b4 INFO: 172.20.0.1:54942 - "POST /node/69caad7c4b5e3e0ab6a635b4 HTTP/1.0" 202 Accepted 2026-03-30 17:26:08,911 - lava_callback - INFO - Starting async job submit for node 69caad7c4b5e3e0ab6a635b4 2026-03-30 17:26:08,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:26:08,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad7c4b5e3e0ab6a635b4 HTTP/1.1" 200 None 2026-03-30 17:26:08,970 - lava_callback - DEBUG - Processing node 69caad7c4b5e3e0ab6a635b4: baseline-nfs-arm64 2026-03-30 17:26:10,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:26:10,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:26:10,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7c4b5e3e0ab6a635b4/log.txt.gz 2026-03-30 17:26:11,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:26:11,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:26:11,312 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7c4b5e3e0ab6a635b4/lava-logs.yaml 2026-03-30 17:26:11,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:26:11,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:26:11,501 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad7c4b5e3e0ab6a635b4/lava_callback.json.gz DEBUG: Setup failed for 69caad7c4b5e3e0ab6a635b4. Transitting job node result: incomplete -> fail 2026-03-30 17:26:11,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:26:11,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad7c4b5e3e0ab6a635b4 HTTP/1.1" 200 None 2026-03-30 17:26:11,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:26:11,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:26:11,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:26:11,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad7c4b5e3e0ab6a635b4 HTTP/1.1" 200 None 2026-03-30 17:26:11,739 - lava_callback - INFO - Completed processing callback for node 69caad7c4b5e3e0ab6a635b4 INFO: 172.20.0.1:35734 - "GET /node/698a8072d9a1cfa777a232c4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35738 - "GET /node/69928fcb98a8bdb31c398be6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:35750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39022 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:26:35,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:26:35,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41728 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:26:57,740 - lava_callback - INFO - Received callback for node 69caad834b5e3e0ab6a635c9 INFO: 172.20.0.1:41744 - "POST /node/69caad834b5e3e0ab6a635c9 HTTP/1.0" 202 Accepted 2026-03-30 17:26:57,747 - lava_callback - INFO - Starting async job submit for node 69caad834b5e3e0ab6a635c9 2026-03-30 17:26:57,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:26:57,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad834b5e3e0ab6a635c9 HTTP/1.1" 200 None 2026-03-30 17:26:57,789 - lava_callback - DEBUG - Processing node 69caad834b5e3e0ab6a635c9: baseline-nfs-arm64 2026-03-30 17:26:58,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:26:58,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:26:58,463 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad834b5e3e0ab6a635c9/log.txt.gz 2026-03-30 17:26:58,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:26:58,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:26:58,997 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad834b5e3e0ab6a635c9/lava-logs.yaml 2026-03-30 17:26:59,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:26:59,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:26:59,205 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69caad834b5e3e0ab6a635c9/lava_callback.json.gz 2026-03-30 17:26:59,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:26:59,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad834b5e3e0ab6a635c9 HTTP/1.1" 200 None 2026-03-30 17:26:59,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:26:59,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:26:59,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:26:59,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad834b5e3e0ab6a635c9 HTTP/1.1" 200 None 2026-03-30 17:26:59,375 - lava_callback - INFO - Completed processing callback for node 69caad834b5e3e0ab6a635c9 2026-03-30 17:27:05,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:05,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54470 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:27:27,875 - lava_callback - INFO - Received callback for node 69c80f6d123b47fd237705e0 INFO: 172.20.0.1:54478 - "POST /node/69c80f6d123b47fd237705e0 HTTP/1.0" 202 Accepted 2026-03-30 17:27:27,882 - lava_callback - INFO - Starting async job submit for node 69c80f6d123b47fd237705e0 2026-03-30 17:27:27,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:27,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80f6d123b47fd237705e0 HTTP/1.1" 200 None 2026-03-30 17:27:27,899 - lava_callback - DEBUG - Processing node 69c80f6d123b47fd237705e0: baseline-arm-clabbe 2026-03-30 17:27:27,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80f6d123b47fd237705e0 2026-03-30 17:27:27,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:27,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80f6d123b47fd237705e0 HTTP/1.1" 200 None 2026-03-30 17:27:27,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:27,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-30 17:27:27,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:27,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80f6d123b47fd237705e0 HTTP/1.1" 200 None 2026-03-30 17:27:27,967 - lava_callback - ERROR - Error processing callback for node 69c80f6d123b47fd237705e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34768 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:27:34,589 - lava_callback - INFO - Received callback for node 69cab2224b5e3e0ab6a6393b INFO: 172.20.0.1:34776 - "POST /node/69cab2224b5e3e0ab6a6393b HTTP/1.0" 202 Accepted 2026-03-30 17:27:34,599 - lava_callback - INFO - Starting async job submit for node 69cab2224b5e3e0ab6a6393b 2026-03-30 17:27:34,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:34,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab2224b5e3e0ab6a6393b HTTP/1.1" 200 None 2026-03-30 17:27:34,658 - lava_callback - DEBUG - Processing node 69cab2224b5e3e0ab6a6393b: baseline-nfs-arm64 2026-03-30 17:27:35,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:27:35,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:27:35,402 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab2224b5e3e0ab6a6393b/log.txt.gz 2026-03-30 17:27:35,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:27:35,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:27:35,993 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab2224b5e3e0ab6a6393b/lava-logs.yaml 2026-03-30 17:27:36,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:27:36,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:27:36,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab2224b5e3e0ab6a6393b/lava_callback.json.gz 2026-03-30 17:27:36,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:36,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab2224b5e3e0ab6a6393b HTTP/1.1" 200 None 2026-03-30 17:27:36,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:36,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:27:36,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:36,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab2224b5e3e0ab6a6393b HTTP/1.1" 200 None 2026-03-30 17:27:36,235 - lava_callback - INFO - Completed processing callback for node 69cab2224b5e3e0ab6a6393b INFO: 172.20.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38902 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:27:56,987 - lava_callback - INFO - Received callback for node 69c80f96123b47fd237705ef INFO: 172.20.0.1:38904 - "POST /node/69c80f96123b47fd237705ef HTTP/1.0" 202 Accepted 2026-03-30 17:27:56,993 - lava_callback - INFO - Starting async job submit for node 69c80f96123b47fd237705ef 2026-03-30 17:27:56,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:57,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80f96123b47fd237705ef HTTP/1.1" 200 None 2026-03-30 17:27:57,010 - lava_callback - DEBUG - Processing node 69c80f96123b47fd237705ef: baseline-arm64-baylibre 2026-03-30 17:27:57,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c80f96123b47fd237705ef 2026-03-30 17:27:57,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:57,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c80f96123b47fd237705ef HTTP/1.1" 200 None 2026-03-30 17:27:57,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:57,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:27:57,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:27:57,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c80f96123b47fd237705ef HTTP/1.1" 200 None 2026-03-30 17:27:57,069 - lava_callback - ERROR - Error processing callback for node 69c80f96123b47fd237705ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-30 17:28:05,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:28:05,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40676 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:29:27,781 - lava_callback - INFO - Received callback for node 69cab2d84b5e3e0ab6a6396e INFO: 172.20.0.1:40688 - "POST /node/69cab2d84b5e3e0ab6a6396e HTTP/1.0" 202 Accepted 2026-03-30 17:29:27,787 - lava_callback - INFO - Starting async job submit for node 69cab2d84b5e3e0ab6a6396e 2026-03-30 17:29:27,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:29:27,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab2d84b5e3e0ab6a6396e HTTP/1.1" 200 None 2026-03-30 17:29:27,807 - lava_callback - DEBUG - Processing node 69cab2d84b5e3e0ab6a6396e: baseline-arm 2026-03-30 17:29:27,813 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:29:27,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:29:27,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:29:27,978 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69cab2d84b5e3e0ab6a6396e/lava-logs.yaml 2026-03-30 17:29:27,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:29:28,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:29:28,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69cab2d84b5e3e0ab6a6396e/lava_callback.json.gz 2026-03-30 17:29:28,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:29:28,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab2d84b5e3e0ab6a6396e HTTP/1.1" 200 None 2026-03-30 17:29:28,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:29:28,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:29:28,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:29:28,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab2d84b5e3e0ab6a6396e HTTP/1.1" 200 None 2026-03-30 17:29:28,166 - lava_callback - INFO - Completed processing callback for node 69cab2d84b5e3e0ab6a6396e INFO: 172.20.0.1:38338 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:29:35,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:29:36,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51420 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:30:37,226 - lava_callback - INFO - Received callback for node 69c81035123b47fd2377060f INFO: 172.20.0.1:51426 - "POST /node/69c81035123b47fd2377060f HTTP/1.0" 202 Accepted 2026-03-30 17:30:37,232 - lava_callback - INFO - Starting async job submit for node 69c81035123b47fd2377060f 2026-03-30 17:30:37,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:30:37,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81035123b47fd2377060f HTTP/1.1" 200 None 2026-03-30 17:30:37,248 - lava_callback - DEBUG - Processing node 69c81035123b47fd2377060f: baseline-arm64-baylibre 2026-03-30 17:30:37,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81035123b47fd2377060f 2026-03-30 17:30:37,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:30:37,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81035123b47fd2377060f HTTP/1.1" 200 None 2026-03-30 17:30:37,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:30:37,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:30:37,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:30:37,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81035123b47fd2377060f HTTP/1.1" 200 None 2026-03-30 17:30:37,299 - lava_callback - ERROR - Error processing callback for node 69c81035123b47fd2377060f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55990 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:32:06,846 - lava_callback - INFO - Received callback for node 69cab28e4b5e3e0ab6a6395d INFO: 172.20.0.1:56006 - "POST /node/69cab28e4b5e3e0ab6a6395d HTTP/1.0" 202 Accepted 2026-03-30 17:32:06,852 - lava_callback - INFO - Starting async job submit for node 69cab28e4b5e3e0ab6a6395d 2026-03-30 17:32:06,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:32:06,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab28e4b5e3e0ab6a6395d HTTP/1.1" 200 None 2026-03-30 17:32:06,904 - lava_callback - DEBUG - Processing node 69cab28e4b5e3e0ab6a6395d: baseline-arm64 2026-03-30 17:32:07,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:32:07,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:32:07,452 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab28e4b5e3e0ab6a6395d/log.txt.gz 2026-03-30 17:32:07,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:32:07,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:32:07,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab28e4b5e3e0ab6a6395d/lava-logs.yaml 2026-03-30 17:32:07,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:32:08,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:32:08,059 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab28e4b5e3e0ab6a6395d/lava_callback.json.gz 2026-03-30 17:32:08,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:32:08,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab28e4b5e3e0ab6a6395d HTTP/1.1" 200 None 2026-03-30 17:32:08,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:32:08,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:32:08,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:32:08,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab28e4b5e3e0ab6a6395d HTTP/1.1" 200 None 2026-03-30 17:32:08,137 - lava_callback - INFO - Completed processing callback for node 69cab28e4b5e3e0ab6a6395d INFO: 172.20.0.1:55776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38382 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:32:36,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:32:36,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50542 - "GET /node/69bbb7b6ec3f435d20d51c7c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50558 - "GET /node/698f87353013abef95d02362%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53794 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:33:57,345 - lava_callback - INFO - Received callback for node 69c810f9123b47fd2377063c INFO: 172.20.0.1:53808 - "POST /node/69c810f9123b47fd2377063c HTTP/1.0" 202 Accepted 2026-03-30 17:33:57,351 - lava_callback - INFO - Starting async job submit for node 69c810f9123b47fd2377063c 2026-03-30 17:33:57,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:33:57,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c810f9123b47fd2377063c HTTP/1.1" 200 None 2026-03-30 17:33:57,367 - lava_callback - DEBUG - Processing node 69c810f9123b47fd2377063c: baseline-arm64-baylibre 2026-03-30 17:33:57,367 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c810f9123b47fd2377063c 2026-03-30 17:33:57,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:33:57,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c810f9123b47fd2377063c HTTP/1.1" 200 None 2026-03-30 17:33:57,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:33:57,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:33:57,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:33:57,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c810f9123b47fd2377063c HTTP/1.1" 200 None 2026-03-30 17:33:57,424 - lava_callback - ERROR - Error processing callback for node 69c810f9123b47fd2377063c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50370 - "GET /node/68fb688cc65672e54ce8207b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50380 - "GET /node/6988c58d9fc35f969e1eead0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46690 - "GET /node/69876b96e31b58f834f1981b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46694 - "GET /node/698b34993b3beb19e761a213%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33306 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 17:36:15,245 - lava_callback - INFO - Received callback for node 69cab4874b5e3e0ab6a639d2 INFO: 172.20.0.1:33310 - "POST /node/69cab4874b5e3e0ab6a639d2 HTTP/1.0" 202 Accepted 2026-03-30 17:36:15,250 - lava_callback - INFO - Starting async job submit for node 69cab4874b5e3e0ab6a639d2 2026-03-30 17:36:15,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:36:15,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab4874b5e3e0ab6a639d2 HTTP/1.1" 200 None 2026-03-30 17:36:15,288 - lava_callback - DEBUG - Processing node 69cab4874b5e3e0ab6a639d2: baseline-nfs-arm64 2026-03-30 17:36:15,290 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:36:15,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:36:15,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:36:15,594 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab4874b5e3e0ab6a639d2/lava-logs.yaml 2026-03-30 17:36:15,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:36:15,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:36:15,737 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab4874b5e3e0ab6a639d2/lava_callback.json.gz 2026-03-30 17:36:15,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:36:15,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab4874b5e3e0ab6a639d2 HTTP/1.1" 200 None 2026-03-30 17:36:15,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:36:15,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:36:15,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:36:15,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab4874b5e3e0ab6a639d2 HTTP/1.1" 200 None 2026-03-30 17:36:15,794 - lava_callback - INFO - Completed processing callback for node 69cab4874b5e3e0ab6a639d2 INFO: 172.20.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57166 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:36:36,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:36:36,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57178 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:36:37,428 - lava_callback - INFO - Received callback for node 69c8119c123b47fd23770659 INFO: 172.20.0.1:57186 - "POST /node/69c8119c123b47fd23770659 HTTP/1.0" 202 Accepted 2026-03-30 17:36:37,434 - lava_callback - INFO - Starting async job submit for node 69c8119c123b47fd23770659 2026-03-30 17:36:37,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:36:37,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8119c123b47fd23770659 HTTP/1.1" 200 None 2026-03-30 17:36:37,455 - lava_callback - DEBUG - Processing node 69c8119c123b47fd23770659: baseline-arm64-baylibre 2026-03-30 17:36:37,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8119c123b47fd23770659 2026-03-30 17:36:37,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:36:37,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8119c123b47fd23770659 HTTP/1.1" 200 None 2026-03-30 17:36:37,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:36:37,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:36:37,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:36:37,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8119c123b47fd23770659 HTTP/1.1" 200 None 2026-03-30 17:36:37,514 - lava_callback - ERROR - Error processing callback for node 69c8119c123b47fd23770659: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51266 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:39:14,752 - lava_callback - INFO - Received callback for node 69cab3774b5e3e0ab6a6399b INFO: 172.20.0.1:53466 - "POST /node/69cab3774b5e3e0ab6a6399b HTTP/1.0" 202 Accepted 2026-03-30 17:39:14,760 - lava_callback - INFO - Starting async job submit for node 69cab3774b5e3e0ab6a6399b 2026-03-30 17:39:14,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:14,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab3774b5e3e0ab6a6399b HTTP/1.1" 200 None 2026-03-30 17:39:14,814 - lava_callback - DEBUG - Processing node 69cab3774b5e3e0ab6a6399b: baseline-arm64 INFO: 172.20.0.1:53480 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 17:39:15,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:39:15,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:39:15,390 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab3774b5e3e0ab6a6399b/log.txt.gz 2026-03-30 17:39:15,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:39:15,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:39:15,839 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab3774b5e3e0ab6a6399b/lava-logs.yaml 2026-03-30 17:39:15,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:39:16,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:39:16,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab3774b5e3e0ab6a6399b/lava_callback.json.gz DEBUG: Setup failed for 69cab3774b5e3e0ab6a6399b. Transitting job node result: incomplete -> fail 2026-03-30 17:39:16,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:16,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab3774b5e3e0ab6a6399b HTTP/1.1" 200 None 2026-03-30 17:39:16,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:16,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:39:16,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:16,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab3774b5e3e0ab6a6399b HTTP/1.1" 200 None 2026-03-30 17:39:16,243 - lava_callback - INFO - Completed processing callback for node 69cab3774b5e3e0ab6a6399b INFO: 172.20.0.1:53492 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:39:17,595 - lava_callback - INFO - Received callback for node 69c8123a123b47fd2377066b INFO: 172.20.0.1:53508 - "POST /node/69c8123a123b47fd2377066b HTTP/1.0" 202 Accepted 2026-03-30 17:39:17,601 - lava_callback - INFO - Starting async job submit for node 69c8123a123b47fd2377066b 2026-03-30 17:39:17,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:17,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8123a123b47fd2377066b HTTP/1.1" 200 None 2026-03-30 17:39:17,619 - lava_callback - DEBUG - Processing node 69c8123a123b47fd2377066b: baseline-arm64-baylibre 2026-03-30 17:39:17,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8123a123b47fd2377066b 2026-03-30 17:39:17,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:17,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8123a123b47fd2377066b HTTP/1.1" 200 None 2026-03-30 17:39:17,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:17,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:39:17,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:17,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8123a123b47fd2377066b HTTP/1.1" 200 None 2026-03-30 17:39:17,690 - lava_callback - ERROR - Error processing callback for node 69c8123a123b47fd2377066b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49788 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:39:36,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:36,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49804 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:39:38,189 - lava_callback - INFO - Received callback for node 69cab51c4b5e3e0ab6a639e9 INFO: 172.20.0.1:49816 - "POST /node/69cab51c4b5e3e0ab6a639e9 HTTP/1.0" 202 Accepted 2026-03-30 17:39:38,195 - lava_callback - INFO - Starting async job submit for node 69cab51c4b5e3e0ab6a639e9 2026-03-30 17:39:38,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:38,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab51c4b5e3e0ab6a639e9 HTTP/1.1" 200 None 2026-03-30 17:39:38,239 - lava_callback - DEBUG - Processing node 69cab51c4b5e3e0ab6a639e9: baseline-arm64 2026-03-30 17:39:38,379 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:39:38,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:39:38,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:39:38,632 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab51c4b5e3e0ab6a639e9/lava-logs.yaml 2026-03-30 17:39:38,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:39:38,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:39:38,747 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab51c4b5e3e0ab6a639e9/lava_callback.json.gz 2026-03-30 17:39:38,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:38,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab51c4b5e3e0ab6a639e9 HTTP/1.1" 200 None 2026-03-30 17:39:38,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:38,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:39:38,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:39:38,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab51c4b5e3e0ab6a639e9 HTTP/1.1" 200 None 2026-03-30 17:39:38,908 - lava_callback - INFO - Completed processing callback for node 69cab51c4b5e3e0ab6a639e9 INFO: 172.20.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40280 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:40:06,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:40:06,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33226 - "GET /node/693b3e4f4b47c3f87266e3cf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33234 - "GET /node/698aa9f3d9a1cfa777a25858%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48268 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:40:37,617 - lava_callback - INFO - Received callback for node 69c8128a123b47fd23770679 INFO: 172.20.0.1:48272 - "POST /node/69c8128a123b47fd23770679 HTTP/1.0" 202 Accepted 2026-03-30 17:40:37,623 - lava_callback - INFO - Starting async job submit for node 69c8128a123b47fd23770679 2026-03-30 17:40:37,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:40:37,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8128a123b47fd23770679 HTTP/1.1" 200 None 2026-03-30 17:40:37,665 - lava_callback - DEBUG - Processing node 69c8128a123b47fd23770679: baseline-arm64-baylibre 2026-03-30 17:40:37,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8128a123b47fd23770679 2026-03-30 17:40:37,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:40:37,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8128a123b47fd23770679 HTTP/1.1" 200 None 2026-03-30 17:40:37,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:40:37,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:40:37,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:40:37,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8128a123b47fd23770679 HTTP/1.1" 200 None 2026-03-30 17:40:37,750 - lava_callback - ERROR - Error processing callback for node 69c8128a123b47fd23770679: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52466 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:41:03,713 - lava_callback - INFO - Received callback for node 69caad944b5e3e0ab6a6360d INFO: 172.20.0.1:35672 - "POST /node/69caad944b5e3e0ab6a6360d HTTP/1.0" 202 Accepted 2026-03-30 17:41:03,719 - lava_callback - INFO - Starting async job submit for node 69caad944b5e3e0ab6a6360d 2026-03-30 17:41:03,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:41:03,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad944b5e3e0ab6a6360d HTTP/1.1" 200 None 2026-03-30 17:41:03,777 - lava_callback - DEBUG - Processing node 69caad944b5e3e0ab6a6360d: baseline-arm64-broonie 2026-03-30 17:41:04,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:41:04,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:41:04,507 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad944b5e3e0ab6a6360d/log.txt.gz 2026-03-30 17:41:04,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:41:05,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:41:05,281 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad944b5e3e0ab6a6360d/lava-logs.yaml 2026-03-30 17:41:05,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:41:05,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:41:05,643 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caad944b5e3e0ab6a6360d/lava_callback.json.gz DEBUG: 69caad944b5e3e0ab6a6360d Transitting job node result: pass -> incomplete 2026-03-30 17:41:05,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:41:05,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caad944b5e3e0ab6a6360d HTTP/1.1" 200 None 2026-03-30 17:41:05,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:41:05,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:41:05,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:41:05,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caad944b5e3e0ab6a6360d HTTP/1.1" 200 None 2026-03-30 17:41:05,740 - lava_callback - INFO - Completed processing callback for node 69caad944b5e3e0ab6a6360d 2026-03-30 17:41:06,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:41:06,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59382 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:41:26,080 - lava_callback - INFO - Received callback for node 69cab5694b5e3e0ab6a639ff INFO: 172.20.0.1:51142 - "POST /node/69cab5694b5e3e0ab6a639ff HTTP/1.0" 202 Accepted 2026-03-30 17:41:26,087 - lava_callback - INFO - Starting async job submit for node 69cab5694b5e3e0ab6a639ff 2026-03-30 17:41:26,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:41:26,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab5694b5e3e0ab6a639ff HTTP/1.1" 200 None 2026-03-30 17:41:26,131 - lava_callback - DEBUG - Processing node 69cab5694b5e3e0ab6a639ff: baseline-arm64 2026-03-30 17:41:26,323 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:41:26,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51148 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:41:26,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:41:26,613 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab5694b5e3e0ab6a639ff/lava-logs.yaml 2026-03-30 17:41:26,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:41:26,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:41:26,732 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab5694b5e3e0ab6a639ff/lava_callback.json.gz 2026-03-30 17:41:26,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:41:26,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab5694b5e3e0ab6a639ff HTTP/1.1" 200 None 2026-03-30 17:41:26,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:41:26,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:41:26,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:41:26,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab5694b5e3e0ab6a639ff HTTP/1.1" 200 None 2026-03-30 17:41:26,904 - lava_callback - INFO - Completed processing callback for node 69cab5694b5e3e0ab6a639ff INFO: 172.20.0.1:46802 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:41:36,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:41:36,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55026 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:42:08,538 - lava_callback - INFO - Received callback for node 69c812de123b47fd23770686 INFO: 172.20.0.1:55030 - "POST /node/69c812de123b47fd23770686 HTTP/1.0" 202 Accepted 2026-03-30 17:42:08,544 - lava_callback - INFO - Starting async job submit for node 69c812de123b47fd23770686 2026-03-30 17:42:08,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:42:08,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c812de123b47fd23770686 HTTP/1.1" 200 None 2026-03-30 17:42:08,563 - lava_callback - DEBUG - Processing node 69c812de123b47fd23770686: baseline-arm64-clabbe 2026-03-30 17:42:08,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c812de123b47fd23770686 2026-03-30 17:42:08,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:42:08,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c812de123b47fd23770686 HTTP/1.1" 200 None 2026-03-30 17:42:08,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:42:08,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:42:08,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:42:08,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c812de123b47fd23770686 HTTP/1.1" 200 None 2026-03-30 17:42:08,615 - lava_callback - ERROR - Error processing callback for node 69c812de123b47fd23770686: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58886 - "GET /node/694acae66c96ed51d316f5bc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58902 - "GET /node/6992d9ff31166481c8dd424c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53420 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:43:08,518 - lava_callback - INFO - Received callback for node 69c8131f123b47fd23770691 INFO: 172.20.0.1:53436 - "POST /node/69c8131f123b47fd23770691 HTTP/1.0" 202 Accepted 2026-03-30 17:43:08,524 - lava_callback - INFO - Starting async job submit for node 69c8131f123b47fd23770691 2026-03-30 17:43:08,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:43:08,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8131f123b47fd23770691 HTTP/1.1" 200 None 2026-03-30 17:43:08,540 - lava_callback - DEBUG - Processing node 69c8131f123b47fd23770691: baseline-arm-clabbe 2026-03-30 17:43:08,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8131f123b47fd23770691 2026-03-30 17:43:08,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:43:08,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8131f123b47fd23770691 HTTP/1.1" 200 None 2026-03-30 17:43:08,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:43:08,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-30 17:43:08,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:43:08,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8131f123b47fd23770691 HTTP/1.1" 200 None 2026-03-30 17:43:08,603 - lava_callback - ERROR - Error processing callback for node 69c8131f123b47fd23770691: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53844 - "GET /node/69846a653a8748f282086cce%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53854 - "GET /node/69a1babf1e6ce1d0b4747a28%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35542 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:44:08,494 - lava_callback - INFO - Received callback for node 69c81353123b47fd237706a3 INFO: 172.20.0.1:35546 - "POST /node/69c81353123b47fd237706a3 HTTP/1.0" 202 Accepted 2026-03-30 17:44:08,499 - lava_callback - INFO - Starting async job submit for node 69c81353123b47fd237706a3 2026-03-30 17:44:08,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:44:08,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81353123b47fd237706a3 HTTP/1.1" 200 None 2026-03-30 17:44:08,515 - lava_callback - DEBUG - Processing node 69c81353123b47fd237706a3: baseline-arm64-clabbe 2026-03-30 17:44:08,516 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81353123b47fd237706a3 2026-03-30 17:44:08,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:44:08,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81353123b47fd237706a3 HTTP/1.1" 200 None 2026-03-30 17:44:08,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:44:08,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:44:08,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:44:08,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81353123b47fd237706a3 HTTP/1.1" 200 None 2026-03-30 17:44:08,579 - lava_callback - ERROR - Error processing callback for node 69c81353123b47fd237706a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39462 - "GET /node/69876da9e31b58f834f19d84%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39474 - "GET /node/698ff10076d4b6342e9db6f2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52436 - "GET /node/694c1ac92f7ca341fdeb23a4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52452 - "GET /node/693e0f07407f32424eb565e6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39764 - "GET /node/6949e7a82060d3d84791d22e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58724 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:46:28,794 - lava_callback - INFO - Received callback for node 69c813ef123b47fd237706b9 INFO: 172.20.0.1:58730 - "POST /node/69c813ef123b47fd237706b9 HTTP/1.0" 202 Accepted 2026-03-30 17:46:28,799 - lava_callback - INFO - Starting async job submit for node 69c813ef123b47fd237706b9 2026-03-30 17:46:28,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:46:32,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c813ef123b47fd237706b9 HTTP/1.1" 200 None 2026-03-30 17:46:32,815 - lava_callback - DEBUG - Processing node 69c813ef123b47fd237706b9: baseline-arm64-clabbe 2026-03-30 17:46:32,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c813ef123b47fd237706b9 2026-03-30 17:46:32,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:46:32,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c813ef123b47fd237706b9 HTTP/1.1" 200 None 2026-03-30 17:46:32,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:46:32,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:46:32,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:46:32,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c813ef123b47fd237706b9 HTTP/1.1" 200 None 2026-03-30 17:46:32,889 - lava_callback - ERROR - Error processing callback for node 69c813ef123b47fd237706b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48660 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:46:37,133 - lava_callback - INFO - Received callback for node 69cab6e84b5e3e0ab6a63a45 INFO: 172.20.0.1:48662 - "POST /node/69cab6e84b5e3e0ab6a63a45 HTTP/1.0" 202 Accepted 2026-03-30 17:46:37,139 - lava_callback - INFO - Starting async job submit for node 69cab6e84b5e3e0ab6a63a45 2026-03-30 17:46:37,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:46:37,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab6e84b5e3e0ab6a63a45 HTTP/1.1" 200 None 2026-03-30 17:46:37,166 - lava_callback - DEBUG - Processing node 69cab6e84b5e3e0ab6a63a45: baseline-arm 2026-03-30 17:46:37,171 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:46:37,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:46:37,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:46:37,309 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69cab6e84b5e3e0ab6a63a45/lava-logs.yaml 2026-03-30 17:46:37,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:46:37,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:46:37,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69cab6e84b5e3e0ab6a63a45/lava_callback.json.gz 2026-03-30 17:46:37,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:46:37,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab6e84b5e3e0ab6a63a45 HTTP/1.1" 200 None 2026-03-30 17:46:37,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:46:37,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:46:37,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:46:37,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab6e84b5e3e0ab6a63a45 HTTP/1.1" 200 None 2026-03-30 17:46:37,524 - lava_callback - INFO - Completed processing callback for node 69cab6e84b5e3e0ab6a63a45 INFO: 172.20.0.1:47332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38716 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:47:06,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:47:06,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39630 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:49:08,777 - lava_callback - INFO - Received callback for node 69c8148b123b47fd237706df INFO: 172.20.0.1:39636 - "POST /node/69c8148b123b47fd237706df HTTP/1.0" 202 Accepted 2026-03-30 17:49:08,782 - lava_callback - INFO - Starting async job submit for node 69c8148b123b47fd237706df 2026-03-30 17:49:08,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:49:08,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8148b123b47fd237706df HTTP/1.1" 200 None 2026-03-30 17:49:08,799 - lava_callback - DEBUG - Processing node 69c8148b123b47fd237706df: baseline-arm64-clabbe 2026-03-30 17:49:08,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8148b123b47fd237706df 2026-03-30 17:49:08,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:49:08,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8148b123b47fd237706df HTTP/1.1" 200 None 2026-03-30 17:49:08,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:49:08,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:49:08,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:49:08,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8148b123b47fd237706df HTTP/1.1" 200 None 2026-03-30 17:49:08,855 - lava_callback - ERROR - Error processing callback for node 69c8148b123b47fd237706df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51600 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:49:28,808 - lava_callback - INFO - Received callback for node 69cab3e34b5e3e0ab6a639b6 INFO: 172.20.0.1:51606 - "POST /node/69cab3e34b5e3e0ab6a639b6 HTTP/1.0" 202 Accepted 2026-03-30 17:49:28,814 - lava_callback - INFO - Starting async job submit for node 69cab3e34b5e3e0ab6a639b6 2026-03-30 17:49:28,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:49:28,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab3e34b5e3e0ab6a639b6 HTTP/1.1" 200 None 2026-03-30 17:49:28,896 - lava_callback - DEBUG - Processing node 69cab3e34b5e3e0ab6a639b6: baseline-arm 2026-03-30 17:49:29,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:49:29,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:49:29,575 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69cab3e34b5e3e0ab6a639b6/log.txt.gz 2026-03-30 17:49:29,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:49:30,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:49:30,243 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69cab3e34b5e3e0ab6a639b6/lava-logs.yaml 2026-03-30 17:49:30,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:49:30,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:49:30,432 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69cab3e34b5e3e0ab6a639b6/lava_callback.json.gz DEBUG: Setup failed for 69cab3e34b5e3e0ab6a639b6. Transitting job node result: incomplete -> fail 2026-03-30 17:49:30,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:49:30,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab3e34b5e3e0ab6a639b6 HTTP/1.1" 200 None 2026-03-30 17:49:30,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:49:30,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 17:49:30,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:49:30,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab3e34b5e3e0ab6a639b6 HTTP/1.1" 200 None 2026-03-30 17:49:30,728 - lava_callback - INFO - Completed processing callback for node 69cab3e34b5e3e0ab6a639b6 INFO: 172.20.0.1:34668 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:49:36,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:49:36,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42800 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:51:48,851 - lava_callback - INFO - Received callback for node 69c81527123b47fd237706f8 INFO: 172.20.0.1:42816 - "POST /node/69c81527123b47fd237706f8 HTTP/1.0" 202 Accepted 2026-03-30 17:51:48,857 - lava_callback - INFO - Starting async job submit for node 69c81527123b47fd237706f8 2026-03-30 17:51:48,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:51:48,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81527123b47fd237706f8 HTTP/1.1" 200 None 2026-03-30 17:51:48,878 - lava_callback - DEBUG - Processing node 69c81527123b47fd237706f8: baseline-arm64-clabbe 2026-03-30 17:51:48,878 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81527123b47fd237706f8 2026-03-30 17:51:48,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:51:48,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81527123b47fd237706f8 HTTP/1.1" 200 None 2026-03-30 17:51:48,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:51:48,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:51:48,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:51:48,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81527123b47fd237706f8 HTTP/1.1" 200 None 2026-03-30 17:51:48,964 - lava_callback - ERROR - Error processing callback for node 69c81527123b47fd237706f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58258 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 17:52:16,007 - lava_callback - INFO - Received callback for node 69cab8484b5e3e0ab6a63a93 INFO: 172.20.0.1:58268 - "POST /node/69cab8484b5e3e0ab6a63a93 HTTP/1.0" 202 Accepted 2026-03-30 17:52:16,013 - lava_callback - INFO - Starting async job submit for node 69cab8484b5e3e0ab6a63a93 2026-03-30 17:52:16,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:52:16,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab8484b5e3e0ab6a63a93 HTTP/1.1" 200 None 2026-03-30 17:52:16,033 - lava_callback - DEBUG - Processing node 69cab8484b5e3e0ab6a63a93: baseline-nfs-arm64 2026-03-30 17:52:16,035 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:52:16,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:52:16,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:52:16,184 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab8484b5e3e0ab6a63a93/lava-logs.yaml 2026-03-30 17:52:16,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:52:16,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:52:16,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab8484b5e3e0ab6a63a93/lava_callback.json.gz 2026-03-30 17:52:16,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:58272 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:52:16,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab8484b5e3e0ab6a63a93 HTTP/1.1" 200 None 2026-03-30 17:52:16,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:52:16,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:52:16,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:52:16,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab8484b5e3e0ab6a63a93 HTTP/1.1" 200 None 2026-03-30 17:52:16,591 - lava_callback - INFO - Completed processing callback for node 69cab8484b5e3e0ab6a63a93 INFO: 172.20.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37998 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:52:36,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:52:36,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45932 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:53:08,908 - lava_callback - INFO - Received callback for node 69c81575123b47fd2377070f INFO: 172.20.0.1:45936 - "POST /node/69c81575123b47fd2377070f HTTP/1.0" 202 Accepted 2026-03-30 17:53:08,913 - lava_callback - INFO - Starting async job submit for node 69c81575123b47fd2377070f 2026-03-30 17:53:08,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:53:08,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81575123b47fd2377070f HTTP/1.1" 200 None 2026-03-30 17:53:08,929 - lava_callback - DEBUG - Processing node 69c81575123b47fd2377070f: baseline-arm64-clabbe 2026-03-30 17:53:08,929 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81575123b47fd2377070f 2026-03-30 17:53:08,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:53:08,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81575123b47fd2377070f HTTP/1.1" 200 None 2026-03-30 17:53:08,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:53:08,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 17:53:08,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:53:08,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81575123b47fd2377070f HTTP/1.1" 200 None 2026-03-30 17:53:08,986 - lava_callback - ERROR - Error processing callback for node 69c81575123b47fd2377070f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35538 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:54:56,657 - lava_callback - INFO - Received callback for node 69cab4354b5e3e0ab6a639cb INFO: 172.20.0.1:35546 - "POST /node/69cab4354b5e3e0ab6a639cb HTTP/1.0" 202 Accepted 2026-03-30 17:54:56,664 - lava_callback - INFO - Starting async job submit for node 69cab4354b5e3e0ab6a639cb 2026-03-30 17:54:56,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:54:56,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab4354b5e3e0ab6a639cb HTTP/1.1" 200 None 2026-03-30 17:54:56,707 - lava_callback - DEBUG - Processing node 69cab4354b5e3e0ab6a639cb: baseline-arm64 2026-03-30 17:54:57,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:54:57,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:54:57,361 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab4354b5e3e0ab6a639cb/log.txt.gz 2026-03-30 17:54:57,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:54:57,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:54:57,865 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab4354b5e3e0ab6a639cb/lava-logs.yaml 2026-03-30 17:54:57,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:54:58,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:54:58,032 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab4354b5e3e0ab6a639cb/lava_callback.json.gz 2026-03-30 17:54:58,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:54:58,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab4354b5e3e0ab6a639cb HTTP/1.1" 200 None 2026-03-30 17:54:58,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:54:58,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:54:58,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:54:58,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab4354b5e3e0ab6a639cb HTTP/1.1" 200 None 2026-03-30 17:54:58,176 - lava_callback - INFO - Completed processing callback for node 69cab4354b5e3e0ab6a639cb 2026-03-30 17:55:06,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:55:06,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49696 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:55:29,138 - lava_callback - INFO - Received callback for node 69c81601123b47fd23770728 INFO: 172.20.0.1:49704 - "POST /node/69c81601123b47fd23770728 HTTP/1.0" 202 Accepted 2026-03-30 17:55:29,143 - lava_callback - INFO - Starting async job submit for node 69c81601123b47fd23770728 2026-03-30 17:55:29,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:55:29,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81601123b47fd23770728 HTTP/1.1" 200 None 2026-03-30 17:55:29,158 - lava_callback - DEBUG - Processing node 69c81601123b47fd23770728: baseline-arm-clabbe 2026-03-30 17:55:29,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81601123b47fd23770728 2026-03-30 17:55:29,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:55:29,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81601123b47fd23770728 HTTP/1.1" 200 None 2026-03-30 17:55:29,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:55:29,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-30 17:55:29,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:55:29,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81601123b47fd23770728 HTTP/1.1" 200 None 2026-03-30 17:55:29,216 - lava_callback - ERROR - Error processing callback for node 69c81601123b47fd23770728: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39296 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:56:08,989 - lava_callback - INFO - Received callback for node 69c81626123b47fd23770738 INFO: 172.20.0.1:39308 - "POST /node/69c81626123b47fd23770738 HTTP/1.0" 202 Accepted 2026-03-30 17:56:08,994 - lava_callback - INFO - Starting async job submit for node 69c81626123b47fd23770738 2026-03-30 17:56:08,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:56:09,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81626123b47fd23770738 HTTP/1.1" 200 None 2026-03-30 17:56:09,010 - lava_callback - DEBUG - Processing node 69c81626123b47fd23770738: baseline-arm-clabbe 2026-03-30 17:56:09,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81626123b47fd23770738 2026-03-30 17:56:09,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:56:09,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81626123b47fd23770738 HTTP/1.1" 200 None 2026-03-30 17:56:09,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:56:09,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c01633c3d73288b0d052f0 HTTP/1.1" 200 None 2026-03-30 17:56:09,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:56:09,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81626123b47fd23770738 HTTP/1.1" 200 None 2026-03-30 17:56:09,093 - lava_callback - ERROR - Error processing callback for node 69c81626123b47fd23770738: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50390 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 17:57:16,140 - lava_callback - INFO - Received callback for node 69cab5674b5e3e0ab6a639fc INFO: 172.20.0.1:50402 - "POST /node/69cab5674b5e3e0ab6a639fc HTTP/1.0" 202 Accepted 2026-03-30 17:57:16,147 - lava_callback - INFO - Starting async job submit for node 69cab5674b5e3e0ab6a639fc 2026-03-30 17:57:16,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:57:16,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab5674b5e3e0ab6a639fc HTTP/1.1" 200 None 2026-03-30 17:57:16,221 - lava_callback - DEBUG - Processing node 69cab5674b5e3e0ab6a639fc: ltp-smoke INFO: 172.20.0.1:50404 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:57:16,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:57:17,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:57:17,003 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69cab5674b5e3e0ab6a639fc/log.txt.gz 2026-03-30 17:57:17,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:57:17,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:57:17,540 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69cab5674b5e3e0ab6a639fc/lava-logs.yaml 2026-03-30 17:57:17,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:57:17,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:57:17,742 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69cab5674b5e3e0ab6a639fc/lava_callback.json.gz 2026-03-30 17:57:17,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:57:17,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab5674b5e3e0ab6a639fc HTTP/1.1" 200 None 2026-03-30 17:57:17,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:57:17,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2504b5e3e0ab6a60b5d HTTP/1.1" 200 None 2026-03-30 17:57:17,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:57:17,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab5674b5e3e0ab6a639fc HTTP/1.1" 200 None 2026-03-30 17:57:18,046 - lava_callback - INFO - Completed processing callback for node 69cab5674b5e3e0ab6a639fc INFO: 172.20.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58052 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:57:36,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:57:36,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48714 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:59:17,856 - lava_callback - INFO - Received callback for node 69cab9bf4b5e3e0ab6a63adb INFO: 172.20.0.1:48720 - "POST /node/69cab9bf4b5e3e0ab6a63adb HTTP/1.0" 202 Accepted 2026-03-30 17:59:17,863 - lava_callback - INFO - Starting async job submit for node 69cab9bf4b5e3e0ab6a63adb 2026-03-30 17:59:17,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:59:17,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab9bf4b5e3e0ab6a63adb HTTP/1.1" 200 None 2026-03-30 17:59:17,908 - lava_callback - DEBUG - Processing node 69cab9bf4b5e3e0ab6a63adb: baseline-arm64 2026-03-30 17:59:18,051 - lava_callback - WARNING - Failed to upload log 2026-03-30 17:59:18,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:59:18,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:59:18,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab9bf4b5e3e0ab6a63adb/lava-logs.yaml 2026-03-30 17:59:18,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 17:59:18,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 17:59:18,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab9bf4b5e3e0ab6a63adb/lava_callback.json.gz 2026-03-30 17:59:18,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:59:18,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab9bf4b5e3e0ab6a63adb HTTP/1.1" 200 None 2026-03-30 17:59:18,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:59:18,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 17:59:18,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:59:18,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab9bf4b5e3e0ab6a63adb HTTP/1.1" 200 None 2026-03-30 17:59:18,679 - lava_callback - INFO - Completed processing callback for node 69cab9bf4b5e3e0ab6a63adb INFO: 172.20.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32780 - "GET / HTTP/1.0" 200 OK 2026-03-30 17:59:36,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 17:59:36,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59590 - "GET /node/69402d58575bc060ce155bc8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59596 - "GET /node/69a440626ebb1cc56c1e0232%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39524 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:01:30,745 - lava_callback - INFO - Received callback for node 69cab92c4b5e3e0ab6a63abc INFO: 172.20.0.1:55710 - "POST /node/69cab92c4b5e3e0ab6a63abc HTTP/1.0" 202 Accepted 2026-03-30 18:01:30,753 - lava_callback - INFO - Starting async job submit for node 69cab92c4b5e3e0ab6a63abc 2026-03-30 18:01:30,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:01:30,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab92c4b5e3e0ab6a63abc HTTP/1.1" 200 None 2026-03-30 18:01:30,806 - lava_callback - DEBUG - Processing node 69cab92c4b5e3e0ab6a63abc: baseline-arm64 2026-03-30 18:01:31,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:01:31,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:01:31,428 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab92c4b5e3e0ab6a63abc/log.txt.gz 2026-03-30 18:01:31,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:01:31,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:01:31,866 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab92c4b5e3e0ab6a63abc/lava-logs.yaml 2026-03-30 18:01:31,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:01:32,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:01:32,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cab92c4b5e3e0ab6a63abc/lava_callback.json.gz DEBUG: Setup failed for 69cab92c4b5e3e0ab6a63abc. Transitting job node result: incomplete -> fail 2026-03-30 18:01:32,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:01:32,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab92c4b5e3e0ab6a63abc HTTP/1.1" 200 None 2026-03-30 18:01:32,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:01:32,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:01:32,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:01:32,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab92c4b5e3e0ab6a63abc HTTP/1.1" 200 None 2026-03-30 18:01:32,283 - lava_callback - INFO - Completed processing callback for node 69cab92c4b5e3e0ab6a63abc INFO: 172.20.0.1:55716 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:01:36,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:01:36,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45236 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:02:03,188 - lava_callback - INFO - Received callback for node 69cab5e34b5e3e0ab6a63a1f INFO: 172.20.0.1:53784 - "POST /node/69cab5e34b5e3e0ab6a63a1f HTTP/1.0" 202 Accepted 2026-03-30 18:02:03,196 - lava_callback - INFO - Starting async job submit for node 69cab5e34b5e3e0ab6a63a1f 2026-03-30 18:02:03,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:02:03,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab5e34b5e3e0ab6a63a1f HTTP/1.1" 200 None 2026-03-30 18:02:03,262 - lava_callback - DEBUG - Processing node 69cab5e34b5e3e0ab6a63a1f: baseline-nfs-arm64 2026-03-30 18:02:04,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:02:04,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:02:04,661 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab5e34b5e3e0ab6a63a1f/log.txt.gz 2026-03-30 18:02:05,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:02:05,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:02:05,579 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab5e34b5e3e0ab6a63a1f/lava-logs.yaml 2026-03-30 18:02:05,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:02:05,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:02:05,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab5e34b5e3e0ab6a63a1f/lava_callback.json.gz DEBUG: Setup failed for 69cab5e34b5e3e0ab6a63a1f. Transitting job node result: incomplete -> fail 2026-03-30 18:02:05,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:02:05,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab5e34b5e3e0ab6a63a1f HTTP/1.1" 200 None 2026-03-30 18:02:05,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:02:05,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:02:05,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:02:05,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab5e34b5e3e0ab6a63a1f HTTP/1.1" 200 None 2026-03-30 18:02:06,044 - lava_callback - INFO - Completed processing callback for node 69cab5e34b5e3e0ab6a63a1f 2026-03-30 18:02:06,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:02:06,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43266 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:04:01,800 - lava_callback - INFO - Received callback for node 69cabaa54b5e3e0ab6a63b09 INFO: 172.20.0.1:50878 - "POST /node/69cabaa54b5e3e0ab6a63b09 HTTP/1.0" 202 Accepted 2026-03-30 18:04:01,812 - lava_callback - INFO - Starting async job submit for node 69cabaa54b5e3e0ab6a63b09 2026-03-30 18:04:01,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:04:01,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabaa54b5e3e0ab6a63b09 HTTP/1.1" 200 None 2026-03-30 18:04:01,896 - lava_callback - DEBUG - Processing node 69cabaa54b5e3e0ab6a63b09: baseline-arm64 2026-03-30 18:04:02,229 - lava_callback - WARNING - Failed to upload log 2026-03-30 18:04:02,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:04:02,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:04:02,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cabaa54b5e3e0ab6a63b09/lava-logs.yaml 2026-03-30 18:04:02,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:04:03,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:04:03,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cabaa54b5e3e0ab6a63b09/lava_callback.json.gz 2026-03-30 18:04:03,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:04:03,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabaa54b5e3e0ab6a63b09 HTTP/1.1" 200 None 2026-03-30 18:04:03,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:04:03,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:04:03,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:04:03,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabaa54b5e3e0ab6a63b09 HTTP/1.1" 200 None 2026-03-30 18:04:03,218 - lava_callback - INFO - Completed processing callback for node 69cabaa54b5e3e0ab6a63b09 2026-03-30 18:04:06,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:04:06,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51600 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:04:18,890 - lava_callback - INFO - Received callback for node 69c81814123b47fd237707b1 INFO: 172.20.0.1:51616 - "POST /node/69c81814123b47fd237707b1 HTTP/1.0" 202 Accepted 2026-03-30 18:04:18,898 - lava_callback - INFO - Starting async job submit for node 69c81814123b47fd237707b1 2026-03-30 18:04:18,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:04:18,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81814123b47fd237707b1 HTTP/1.1" 200 None 2026-03-30 18:04:18,931 - lava_callback - DEBUG - Processing node 69c81814123b47fd237707b1: baseline-arm64-baylibre 2026-03-30 18:04:18,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81814123b47fd237707b1 2026-03-30 18:04:18,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:04:18,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81814123b47fd237707b1 HTTP/1.1" 200 None 2026-03-30 18:04:18,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:04:19,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:04:19,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:04:19,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81814123b47fd237707b1 HTTP/1.1" 200 None 2026-03-30 18:04:19,045 - lava_callback - ERROR - Error processing callback for node 69c81814123b47fd237707b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46576 - "GET /node/6992f8b131166481c8ddd728%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46584 - "GET /node/698fcb2e76d4b6342e9d74ed%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60062 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:05:38,925 - lava_callback - INFO - Received callback for node 69c81861123b47fd237707b8 INFO: 172.20.0.1:60066 - "POST /node/69c81861123b47fd237707b8 HTTP/1.0" 202 Accepted 2026-03-30 18:05:38,934 - lava_callback - INFO - Starting async job submit for node 69c81861123b47fd237707b8 2026-03-30 18:05:38,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:05:38,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81861123b47fd237707b8 HTTP/1.1" 200 None 2026-03-30 18:05:38,968 - lava_callback - DEBUG - Processing node 69c81861123b47fd237707b8: baseline-arm64-baylibre 2026-03-30 18:05:38,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81861123b47fd237707b8 2026-03-30 18:05:38,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:05:38,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81861123b47fd237707b8 HTTP/1.1" 200 None 2026-03-30 18:05:38,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:05:39,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:05:39,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:05:39,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81861123b47fd237707b8 HTTP/1.1" 200 None 2026-03-30 18:05:39,063 - lava_callback - ERROR - Error processing callback for node 69c81861123b47fd237707b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55814 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:06:59,018 - lava_callback - INFO - Received callback for node 69c818ae123b47fd237707cc INFO: 172.20.0.1:55830 - "POST /node/69c818ae123b47fd237707cc HTTP/1.0" 202 Accepted 2026-03-30 18:06:59,023 - lava_callback - INFO - Starting async job submit for node 69c818ae123b47fd237707cc 2026-03-30 18:06:59,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:06:59,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c818ae123b47fd237707cc HTTP/1.1" 200 None 2026-03-30 18:06:59,042 - lava_callback - DEBUG - Processing node 69c818ae123b47fd237707cc: baseline-arm64-baylibre 2026-03-30 18:06:59,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c818ae123b47fd237707cc 2026-03-30 18:06:59,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:06:59,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c818ae123b47fd237707cc HTTP/1.1" 200 None 2026-03-30 18:06:59,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:06:59,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:06:59,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:06:59,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c818ae123b47fd237707cc HTTP/1.1" 200 None 2026-03-30 18:06:59,100 - lava_callback - ERROR - Error processing callback for node 69c818ae123b47fd237707cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43424 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:08:19,175 - lava_callback - INFO - Received callback for node 69c81900123b47fd237707da INFO: 172.20.0.1:43430 - "POST /node/69c81900123b47fd237707da HTTP/1.0" 202 Accepted 2026-03-30 18:08:19,184 - lava_callback - INFO - Starting async job submit for node 69c81900123b47fd237707da 2026-03-30 18:08:19,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:08:19,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81900123b47fd237707da HTTP/1.1" 200 None 2026-03-30 18:08:19,201 - lava_callback - DEBUG - Processing node 69c81900123b47fd237707da: baseline-arm64-baylibre 2026-03-30 18:08:19,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81900123b47fd237707da 2026-03-30 18:08:19,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:08:19,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81900123b47fd237707da HTTP/1.1" 200 None 2026-03-30 18:08:19,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:08:19,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:08:19,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:08:19,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81900123b47fd237707da HTTP/1.1" 200 None 2026-03-30 18:08:19,286 - lava_callback - ERROR - Error processing callback for node 69c81900123b47fd237707da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43236 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:09:39,256 - lava_callback - INFO - Received callback for node 69c8194f123b47fd237707e8 INFO: 172.20.0.1:43252 - "POST /node/69c8194f123b47fd237707e8 HTTP/1.0" 202 Accepted 2026-03-30 18:09:39,262 - lava_callback - INFO - Starting async job submit for node 69c8194f123b47fd237707e8 2026-03-30 18:09:39,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:09:39,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8194f123b47fd237707e8 HTTP/1.1" 200 None 2026-03-30 18:09:39,278 - lava_callback - DEBUG - Processing node 69c8194f123b47fd237707e8: baseline-arm64-baylibre 2026-03-30 18:09:39,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8194f123b47fd237707e8 2026-03-30 18:09:39,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:09:39,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8194f123b47fd237707e8 HTTP/1.1" 200 None 2026-03-30 18:09:39,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:09:39,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:09:39,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:09:39,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8194f123b47fd237707e8 HTTP/1.1" 200 None 2026-03-30 18:09:39,332 - lava_callback - ERROR - Error processing callback for node 69c8194f123b47fd237707e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48290 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:10:25,021 - lava_callback - INFO - Received callback for node 69caba6a4b5e3e0ab6a63af2 INFO: 172.20.0.1:35410 - "POST /node/69caba6a4b5e3e0ab6a63af2 HTTP/1.0" 202 Accepted 2026-03-30 18:10:25,028 - lava_callback - INFO - Starting async job submit for node 69caba6a4b5e3e0ab6a63af2 2026-03-30 18:10:25,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:10:25,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caba6a4b5e3e0ab6a63af2 HTTP/1.1" 200 None 2026-03-30 18:10:25,087 - lava_callback - DEBUG - Processing node 69caba6a4b5e3e0ab6a63af2: baseline-arm64-broonie 2026-03-30 18:10:25,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:10:25,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:10:25,958 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caba6a4b5e3e0ab6a63af2/log.txt.gz 2026-03-30 18:10:26,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:10:26,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:10:26,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caba6a4b5e3e0ab6a63af2/lava-logs.yaml 2026-03-30 18:10:26,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:35422 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:10:26,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:10:26,659 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69caba6a4b5e3e0ab6a63af2/lava_callback.json.gz DEBUG: 69caba6a4b5e3e0ab6a63af2 Transitting job node result: pass -> incomplete 2026-03-30 18:10:26,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:10:26,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caba6a4b5e3e0ab6a63af2 HTTP/1.1" 200 None 2026-03-30 18:10:26,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:10:26,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:10:26,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:10:26,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caba6a4b5e3e0ab6a63af2 HTTP/1.1" 200 None 2026-03-30 18:10:26,759 - lava_callback - INFO - Completed processing callback for node 69caba6a4b5e3e0ab6a63af2 INFO: 172.20.0.1:47516 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:10:36,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:10:36,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59484 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:11:19,263 - lava_callback - INFO - Received callback for node 69c819c2123b47fd23770804 INFO: 172.20.0.1:59492 - "POST /node/69c819c2123b47fd23770804 HTTP/1.0" 202 Accepted 2026-03-30 18:11:19,269 - lava_callback - INFO - Starting async job submit for node 69c819c2123b47fd23770804 2026-03-30 18:11:19,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:11:19,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c819c2123b47fd23770804 HTTP/1.1" 200 None 2026-03-30 18:11:19,292 - lava_callback - DEBUG - Processing node 69c819c2123b47fd23770804: baseline-arm64-baylibre 2026-03-30 18:11:19,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c819c2123b47fd23770804 2026-03-30 18:11:19,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:11:19,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c819c2123b47fd23770804 HTTP/1.1" 200 None 2026-03-30 18:11:19,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:11:19,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:11:19,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:11:19,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c819c2123b47fd23770804 HTTP/1.1" 200 None 2026-03-30 18:11:19,367 - lava_callback - ERROR - Error processing callback for node 69c819c2123b47fd23770804: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55242 - "GET /node/694abde383c67c43d1edf25b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55252 - "GET /node/698b77680a16aea5a0dc8320%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42136 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:12:49,692 - lava_callback - INFO - Received callback for node 69c81a13123b47fd23770815 INFO: 172.20.0.1:42146 - "POST /node/69c81a13123b47fd23770815 HTTP/1.0" 202 Accepted 2026-03-30 18:12:49,698 - lava_callback - INFO - Starting async job submit for node 69c81a13123b47fd23770815 2026-03-30 18:12:49,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:12:49,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81a13123b47fd23770815 HTTP/1.1" 200 None 2026-03-30 18:12:49,725 - lava_callback - DEBUG - Processing node 69c81a13123b47fd23770815: baseline-arm64-clabbe 2026-03-30 18:12:49,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81a13123b47fd23770815 2026-03-30 18:12:49,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:12:49,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81a13123b47fd23770815 HTTP/1.1" 200 None 2026-03-30 18:12:49,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:12:49,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:12:49,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:12:49,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81a13123b47fd23770815 HTTP/1.1" 200 None 2026-03-30 18:12:49,817 - lava_callback - ERROR - Error processing callback for node 69c81a13123b47fd23770815: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38846 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:14:09,741 - lava_callback - INFO - Received callback for node 69c81a60123b47fd23770823 INFO: 172.20.0.1:46124 - "POST /node/69c81a60123b47fd23770823 HTTP/1.0" 202 Accepted 2026-03-30 18:14:09,747 - lava_callback - INFO - Starting async job submit for node 69c81a60123b47fd23770823 2026-03-30 18:14:09,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:14:09,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81a60123b47fd23770823 HTTP/1.1" 200 None 2026-03-30 18:14:09,763 - lava_callback - DEBUG - Processing node 69c81a60123b47fd23770823: baseline-arm64-clabbe 2026-03-30 18:14:09,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81a60123b47fd23770823 2026-03-30 18:14:09,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:14:09,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81a60123b47fd23770823 HTTP/1.1" 200 None 2026-03-30 18:14:09,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:14:09,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:14:09,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:14:09,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81a60123b47fd23770823 HTTP/1.1" 200 None 2026-03-30 18:14:09,820 - lava_callback - ERROR - Error processing callback for node 69c81a60123b47fd23770823: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41184 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:15:09,730 - lava_callback - INFO - Received callback for node 69c81aab123b47fd2377083a INFO: 172.20.0.1:46120 - "POST /node/69c81aab123b47fd2377083a HTTP/1.0" 202 Accepted 2026-03-30 18:15:09,735 - lava_callback - INFO - Starting async job submit for node 69c81aab123b47fd2377083a 2026-03-30 18:15:09,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:15:09,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81aab123b47fd2377083a HTTP/1.1" 200 None 2026-03-30 18:15:09,752 - lava_callback - DEBUG - Processing node 69c81aab123b47fd2377083a: baseline-arm64-clabbe 2026-03-30 18:15:09,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81aab123b47fd2377083a 2026-03-30 18:15:09,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:15:09,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81aab123b47fd2377083a HTTP/1.1" 200 None 2026-03-30 18:15:09,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:15:09,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:15:09,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:15:09,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81aab123b47fd2377083a HTTP/1.1" 200 None 2026-03-30 18:15:09,806 - lava_callback - ERROR - Error processing callback for node 69c81aab123b47fd2377083a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37520 - "GET /node/693ae81ffee8383e92b65673%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37532 - "GET /node/694a3c1b2060d3d8479227b7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52474 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:16:29,827 - lava_callback - INFO - Received callback for node 69c81af8123b47fd23770842 INFO: 172.20.0.1:59380 - "POST /node/69c81af8123b47fd23770842 HTTP/1.0" 202 Accepted 2026-03-30 18:16:29,832 - lava_callback - INFO - Starting async job submit for node 69c81af8123b47fd23770842 2026-03-30 18:16:29,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:16:29,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81af8123b47fd23770842 HTTP/1.1" 200 None 2026-03-30 18:16:29,848 - lava_callback - DEBUG - Processing node 69c81af8123b47fd23770842: baseline-arm64-clabbe 2026-03-30 18:16:29,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81af8123b47fd23770842 2026-03-30 18:16:29,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:16:29,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81af8123b47fd23770842 HTTP/1.1" 200 None 2026-03-30 18:16:29,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:16:29,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:16:29,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:16:29,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81af8123b47fd23770842 HTTP/1.1" 200 None 2026-03-30 18:16:29,906 - lava_callback - ERROR - Error processing callback for node 69c81af8123b47fd23770842: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48262 - "GET /node/699383decebe99dd8e06f691%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48264 - "GET /node/698af3c53b3beb19e7616968%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48268 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:17:49,888 - lava_callback - INFO - Received callback for node 69c81b44123b47fd23770859 INFO: 172.20.0.1:41288 - "POST /node/69c81b44123b47fd23770859 HTTP/1.0" 202 Accepted 2026-03-30 18:17:49,894 - lava_callback - INFO - Starting async job submit for node 69c81b44123b47fd23770859 2026-03-30 18:17:49,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:17:49,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81b44123b47fd23770859 HTTP/1.1" 200 None 2026-03-30 18:17:49,909 - lava_callback - DEBUG - Processing node 69c81b44123b47fd23770859: baseline-arm64-clabbe 2026-03-30 18:17:49,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81b44123b47fd23770859 2026-03-30 18:17:49,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:17:49,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81b44123b47fd23770859 HTTP/1.1" 200 None 2026-03-30 18:17:49,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:17:49,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:17:49,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:17:49,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81b44123b47fd23770859 HTTP/1.1" 200 None 2026-03-30 18:17:49,972 - lava_callback - ERROR - Error processing callback for node 69c81b44123b47fd23770859: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41300 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:18:04,961 - lava_callback - INFO - Received callback for node 69cabde14b5e3e0ab6a63b8a INFO: 172.20.0.1:45538 - "POST /node/69cabde14b5e3e0ab6a63b8a HTTP/1.0" 202 Accepted 2026-03-30 18:18:04,967 - lava_callback - INFO - Starting async job submit for node 69cabde14b5e3e0ab6a63b8a 2026-03-30 18:18:04,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:05,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabde14b5e3e0ab6a63b8a HTTP/1.1" 200 None 2026-03-30 18:18:05,023 - lava_callback - DEBUG - Processing node 69cabde14b5e3e0ab6a63b8a: baseline-arm64-broonie 2026-03-30 18:18:05,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:18:05,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:18:05,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cabde14b5e3e0ab6a63b8a/log.txt.gz 2026-03-30 18:18:05,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:18:05,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:18:05,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cabde14b5e3e0ab6a63b8a/lava-logs.yaml 2026-03-30 18:18:05,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:18:06,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:18:06,092 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cabde14b5e3e0ab6a63b8a/lava_callback.json.gz 2026-03-30 18:18:06,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:06,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabde14b5e3e0ab6a63b8a HTTP/1.1" 200 None 2026-03-30 18:18:06,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:06,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:18:06,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:06,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabde14b5e3e0ab6a63b8a HTTP/1.1" 200 None 2026-03-30 18:18:06,175 - lava_callback - INFO - Completed processing callback for node 69cabde14b5e3e0ab6a63b8a 2026-03-30 18:18:06,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:06,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50110 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:18:50,059 - lava_callback - INFO - Received callback for node 69cabd3b4b5e3e0ab6a63b79 INFO: 172.20.0.1:39240 - "POST /node/69cabd3b4b5e3e0ab6a63b79 HTTP/1.0" 202 Accepted 2026-03-30 18:18:50,066 - lava_callback - INFO - Starting async job submit for node 69cabd3b4b5e3e0ab6a63b79 2026-03-30 18:18:50,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:50,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabd3b4b5e3e0ab6a63b79 HTTP/1.1" 200 None 2026-03-30 18:18:50,116 - lava_callback - DEBUG - Processing node 69cabd3b4b5e3e0ab6a63b79: baseline-arm64 2026-03-30 18:18:50,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:18:50,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:18:50,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69cabd3b4b5e3e0ab6a63b79/log.txt.gz 2026-03-30 18:18:50,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:18:51,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:18:51,045 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cabd3b4b5e3e0ab6a63b79/lava-logs.yaml 2026-03-30 18:18:51,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:18:51,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:18:51,246 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cabd3b4b5e3e0ab6a63b79/lava_callback.json.gz DEBUG: Setup failed for 69cabd3b4b5e3e0ab6a63b79. Transitting job node result: incomplete -> fail 2026-03-30 18:18:51,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:51,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabd3b4b5e3e0ab6a63b79 HTTP/1.1" 200 None 2026-03-30 18:18:51,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:51,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:18:51,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:51,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabd3b4b5e3e0ab6a63b79 HTTP/1.1" 200 None 2026-03-30 18:18:51,496 - lava_callback - INFO - Completed processing callback for node 69cabd3b4b5e3e0ab6a63b79 2026-03-30 18:18:53,678 - lava_callback - INFO - Received callback for node 69cab6314b5e3e0ab6a63a29 INFO: 172.20.0.1:39250 - "POST /node/69cab6314b5e3e0ab6a63a29 HTTP/1.0" 202 Accepted 2026-03-30 18:18:53,684 - lava_callback - INFO - Starting async job submit for node 69cab6314b5e3e0ab6a63a29 2026-03-30 18:18:53,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:53,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab6314b5e3e0ab6a63a29 HTTP/1.1" 200 None 2026-03-30 18:18:53,725 - lava_callback - DEBUG - Processing node 69cab6314b5e3e0ab6a63a29: baseline-nfs-arm64 2026-03-30 18:18:54,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:18:54,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:18:54,565 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab6314b5e3e0ab6a63a29/log.txt.gz 2026-03-30 18:18:54,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:18:55,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:18:55,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab6314b5e3e0ab6a63a29/lava-logs.yaml 2026-03-30 18:18:55,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:18:55,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:18:55,220 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cab6314b5e3e0ab6a63a29/lava_callback.json.gz 2026-03-30 18:18:55,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:55,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab6314b5e3e0ab6a63a29 HTTP/1.1" 200 None 2026-03-30 18:18:55,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:55,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:18:55,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:18:55,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab6314b5e3e0ab6a63a29 HTTP/1.1" 200 None 2026-03-30 18:18:55,359 - lava_callback - INFO - Completed processing callback for node 69cab6314b5e3e0ab6a63a29 INFO: 172.20.0.1:39264 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:19:06,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:19:06,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55074 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:20:30,038 - lava_callback - INFO - Received callback for node 69c81bdd123b47fd2377087a INFO: 172.20.0.1:35274 - "POST /node/69c81bdd123b47fd2377087a HTTP/1.0" 202 Accepted 2026-03-30 18:20:30,043 - lava_callback - INFO - Starting async job submit for node 69c81bdd123b47fd2377087a 2026-03-30 18:20:30,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:20:30,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81bdd123b47fd2377087a HTTP/1.1" 200 None 2026-03-30 18:20:30,060 - lava_callback - DEBUG - Processing node 69c81bdd123b47fd2377087a: baseline-arm64-clabbe 2026-03-30 18:20:30,060 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c81bdd123b47fd2377087a 2026-03-30 18:20:30,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:20:30,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c81bdd123b47fd2377087a HTTP/1.1" 200 None 2026-03-30 18:20:30,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:20:30,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c0163fc3d73288b0d05306 HTTP/1.1" 200 None 2026-03-30 18:20:30,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:20:30,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c81bdd123b47fd2377087a HTTP/1.1" 200 None 2026-03-30 18:20:30,115 - lava_callback - ERROR - Error processing callback for node 69c81bdd123b47fd2377087a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51702 - "GET /node/693f80ec0d8ce4018da9676e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49082 - "GET /node/69830f39409235c29c0de6f6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58196 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:22:38,067 - lava_callback - INFO - Received callback for node 69cabcec4b5e3e0ab6a63b68 INFO: 172.20.0.1:58210 - "POST /node/69cabcec4b5e3e0ab6a63b68 HTTP/1.0" 202 Accepted 2026-03-30 18:22:38,074 - lava_callback - INFO - Starting async job submit for node 69cabcec4b5e3e0ab6a63b68 2026-03-30 18:22:38,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:22:38,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabcec4b5e3e0ab6a63b68 HTTP/1.1" 200 None 2026-03-30 18:22:38,129 - lava_callback - DEBUG - Processing node 69cabcec4b5e3e0ab6a63b68: baseline-arm64 2026-03-30 18:22:38,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:22:38,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:22:38,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69cabcec4b5e3e0ab6a63b68/log.txt.gz 2026-03-30 18:22:39,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:22:39,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:22:39,310 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cabcec4b5e3e0ab6a63b68/lava-logs.yaml 2026-03-30 18:22:39,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:22:39,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:22:39,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cabcec4b5e3e0ab6a63b68/lava_callback.json.gz 2026-03-30 18:22:39,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:22:39,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabcec4b5e3e0ab6a63b68 HTTP/1.1" 200 None 2026-03-30 18:22:39,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:22:39,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:22:39,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:22:39,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabcec4b5e3e0ab6a63b68 HTTP/1.1" 200 None 2026-03-30 18:22:39,654 - lava_callback - INFO - Completed processing callback for node 69cabcec4b5e3e0ab6a63b68 INFO: 172.20.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41942 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:23:06,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:23:06,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57634 - "GET /node/693faffa0d8ce4018da9c09c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57642 - "GET /node/6937767c0c55536e7dddae4f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43896 - "GET /node/698af7753b3beb19e7617286%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43904 - "GET /node/69830d9e409235c29c0de558%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37974 - "GET /node/6986fb896e077e4126a7d476%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37988 - "GET /node/6940a9f91e3c24e95681a35c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34630 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:26:45,503 - lava_callback - INFO - Received callback for node 69cabc284b5e3e0ab6a63b44 INFO: 172.20.0.1:36344 - "POST /node/69cabc284b5e3e0ab6a63b44 HTTP/1.0" 202 Accepted 2026-03-30 18:26:45,509 - lava_callback - INFO - Starting async job submit for node 69cabc284b5e3e0ab6a63b44 2026-03-30 18:26:45,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:26:45,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabc284b5e3e0ab6a63b44 HTTP/1.1" 200 None 2026-03-30 18:26:45,577 - lava_callback - DEBUG - Processing node 69cabc284b5e3e0ab6a63b44: baseline-arm 2026-03-30 18:26:46,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:26:46,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:26:46,316 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69cabc284b5e3e0ab6a63b44/log.txt.gz INFO: 172.20.0.1:36358 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:26:46,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:26:46,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:26:46,957 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69cabc284b5e3e0ab6a63b44/lava-logs.yaml 2026-03-30 18:26:46,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:26:47,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:26:47,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69cabc284b5e3e0ab6a63b44/lava_callback.json.gz DEBUG: Setup failed for 69cabc284b5e3e0ab6a63b44. Transitting job node result: incomplete -> fail 2026-03-30 18:26:47,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:26:47,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabc284b5e3e0ab6a63b44 HTTP/1.1" 200 None 2026-03-30 18:26:47,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:26:47,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 18:26:47,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:26:47,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabc284b5e3e0ab6a63b44 HTTP/1.1" 200 None 2026-03-30 18:26:47,449 - lava_callback - INFO - Completed processing callback for node 69cabc284b5e3e0ab6a63b44 INFO: 172.20.0.1:58890 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:27:06,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:27:06,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47146 - "GET /node/693f11b724745582e399a30f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47174 - "GET /node/698847c4e408e9ea60fad06a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32812 - "GET /node/6985e80871989fb14149bf93%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47802 - "GET /node/69869ae82de8e2dea3666887%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42516 - "GET /node/6988c2bd9fc35f969e1ee11f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42530 - "GET /node/693b094cfee8383e92b71629%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42956 - "GET /node/694ac71c6c96ed51d316f3a9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59892 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:30:12,649 - lava_callback - INFO - Received callback for node 69c9c63a3c3aafdab4be9d55 INFO: 172.20.0.1:37928 - "POST /node/69c9c63a3c3aafdab4be9d55 HTTP/1.0" 202 Accepted 2026-03-30 18:30:12,655 - lava_callback - INFO - Starting async job submit for node 69c9c63a3c3aafdab4be9d55 2026-03-30 18:30:12,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:12,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c63a3c3aafdab4be9d55 HTTP/1.1" 200 None 2026-03-30 18:30:12,692 - lava_callback - DEBUG - Processing node 69c9c63a3c3aafdab4be9d55: baseline-x86 2026-03-30 18:30:12,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:30:13,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:30:13,154 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c9c63a3c3aafdab4be9d55/log.txt.gz 2026-03-30 18:30:13,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:30:13,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:30:13,546 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c9c63a3c3aafdab4be9d55/lava-logs.yaml 2026-03-30 18:30:13,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:30:13,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:30:13,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c9c63a3c3aafdab4be9d55/lava_callback.json.gz 2026-03-30 18:30:13,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:13,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c63a3c3aafdab4be9d55 HTTP/1.1" 200 None 2026-03-30 18:30:13,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:13,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c13f3c3aafdab4be7771 HTTP/1.1" 200 None 2026-03-30 18:30:13,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:13,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c9c63a3c3aafdab4be9d55 HTTP/1.1" 200 None 2026-03-30 18:30:13,788 - lava_callback - INFO - Completed processing callback for node 69c9c63a3c3aafdab4be9d55 INFO: 172.20.0.1:37934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37936 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:30:19,962 - lava_callback - INFO - Received callback for node 69ca1aef3c3aafdab4bead53 INFO: 172.20.0.1:35168 - "POST /node/69ca1aef3c3aafdab4bead53 HTTP/1.0" 202 Accepted 2026-03-30 18:30:19,968 - lava_callback - INFO - Starting async job submit for node 69ca1aef3c3aafdab4bead53 2026-03-30 18:30:19,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:20,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca1aef3c3aafdab4bead53 HTTP/1.1" 200 None 2026-03-30 18:30:20,000 - lava_callback - DEBUG - Processing node 69ca1aef3c3aafdab4bead53: baseline-x86 2026-03-30 18:30:20,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:30:20,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:30:20,469 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ca1aef3c3aafdab4bead53/log.txt.gz 2026-03-30 18:30:20,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:30:20,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:30:20,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ca1aef3c3aafdab4bead53/lava-logs.yaml 2026-03-30 18:30:20,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:30:21,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:30:21,014 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ca1aef3c3aafdab4bead53/lava_callback.json.gz 2026-03-30 18:30:21,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:21,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca1aef3c3aafdab4bead53 HTTP/1.1" 200 None 2026-03-30 18:30:21,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:21,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c13f3c3aafdab4be7771 HTTP/1.1" 200 None 2026-03-30 18:30:21,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:21,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca1aef3c3aafdab4bead53 HTTP/1.1" 200 None 2026-03-30 18:30:21,088 - lava_callback - INFO - Completed processing callback for node 69ca1aef3c3aafdab4bead53 INFO: 172.20.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53242 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:30:36,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:36,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46104 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:30:57,398 - lava_callback - INFO - Received callback for node 69cabd334b5e3e0ab6a63b72 INFO: 172.20.0.1:46114 - "POST /node/69cabd334b5e3e0ab6a63b72 HTTP/1.0" 202 Accepted 2026-03-30 18:30:57,404 - lava_callback - INFO - Starting async job submit for node 69cabd334b5e3e0ab6a63b72 2026-03-30 18:30:57,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:57,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabd334b5e3e0ab6a63b72 HTTP/1.1" 200 None 2026-03-30 18:30:57,497 - lava_callback - DEBUG - Processing node 69cabd334b5e3e0ab6a63b72: ltp-smoke 2026-03-30 18:30:57,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:30:58,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:30:58,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69cabd334b5e3e0ab6a63b72/log.txt.gz 2026-03-30 18:30:58,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:30:58,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:30:58,622 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69cabd334b5e3e0ab6a63b72/lava-logs.yaml 2026-03-30 18:30:58,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:30:58,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:30:58,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69cabd334b5e3e0ab6a63b72/lava_callback.json.gz 2026-03-30 18:30:58,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:58,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabd334b5e3e0ab6a63b72 HTTP/1.1" 200 None 2026-03-30 18:30:58,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:58,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2504b5e3e0ab6a60b5d HTTP/1.1" 200 None 2026-03-30 18:30:58,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:30:58,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabd334b5e3e0ab6a63b72 HTTP/1.1" 200 None 2026-03-30 18:30:59,077 - lava_callback - INFO - Completed processing callback for node 69cabd334b5e3e0ab6a63b72 2026-03-30 18:31:06,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:31:06,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56186 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:31:53,694 - lava_callback - INFO - Received callback for node 69cabe994b5e3e0ab6a63ba1 INFO: 172.20.0.1:59278 - "POST /node/69cabe994b5e3e0ab6a63ba1 HTTP/1.0" 202 Accepted 2026-03-30 18:31:53,702 - lava_callback - INFO - Starting async job submit for node 69cabe994b5e3e0ab6a63ba1 2026-03-30 18:31:53,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:31:53,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabe994b5e3e0ab6a63ba1 HTTP/1.1" 200 None 2026-03-30 18:31:53,770 - lava_callback - DEBUG - Processing node 69cabe994b5e3e0ab6a63ba1: baseline-nfs-arm64 2026-03-30 18:31:54,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:31:54,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:31:54,480 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cabe994b5e3e0ab6a63ba1/log.txt.gz 2026-03-30 18:31:54,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:31:54,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:31:54,981 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cabe994b5e3e0ab6a63ba1/lava-logs.yaml 2026-03-30 18:31:54,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:31:55,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:31:55,171 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cabe994b5e3e0ab6a63ba1/lava_callback.json.gz 2026-03-30 18:31:55,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:31:55,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabe994b5e3e0ab6a63ba1 HTTP/1.1" 200 None 2026-03-30 18:31:55,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:31:55,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:31:55,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:31:55,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabe994b5e3e0ab6a63ba1 HTTP/1.1" 200 None 2026-03-30 18:31:55,324 - lava_callback - INFO - Completed processing callback for node 69cabe994b5e3e0ab6a63ba1 INFO: 172.20.0.1:59288 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:32:06,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:32:06,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46640 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:32:11,237 - lava_callback - INFO - Received callback for node 69ca36970e33d030878a8865 INFO: 172.20.0.1:36970 - "POST /node/69ca36970e33d030878a8865 HTTP/1.0" 202 Accepted 2026-03-30 18:32:11,246 - lava_callback - INFO - Starting async job submit for node 69ca36970e33d030878a8865 2026-03-30 18:32:11,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:32:11,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca36970e33d030878a8865 HTTP/1.1" 200 None 2026-03-30 18:32:11,286 - lava_callback - DEBUG - Processing node 69ca36970e33d030878a8865: baseline-x86 2026-03-30 18:32:11,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:32:11,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:32:11,780 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ca36970e33d030878a8865/log.txt.gz 2026-03-30 18:32:11,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:32:12,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:32:12,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ca36970e33d030878a8865/lava-logs.yaml 2026-03-30 18:32:12,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:32:12,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:32:12,319 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ca36970e33d030878a8865/lava_callback.json.gz 2026-03-30 18:32:12,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:32:12,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca36970e33d030878a8865 HTTP/1.1" 200 None 2026-03-30 18:32:12,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:32:12,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca32150e33d030878a8819 HTTP/1.1" 200 None 2026-03-30 18:32:12,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:32:12,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca36970e33d030878a8865 HTTP/1.1" 200 None 2026-03-30 18:32:12,401 - lava_callback - INFO - Completed processing callback for node 69ca36970e33d030878a8865 INFO: 172.20.0.1:36982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37206 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:32:36,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:37214 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:32:36,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35042 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:34:02,250 - lava_callback - INFO - Received callback for node 69ca6f9f0e33d030878a9aee INFO: 172.20.0.1:57980 - "POST /node/69ca6f9f0e33d030878a9aee HTTP/1.0" 202 Accepted 2026-03-30 18:34:02,256 - lava_callback - INFO - Starting async job submit for node 69ca6f9f0e33d030878a9aee 2026-03-30 18:34:02,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:34:02,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca6f9f0e33d030878a9aee HTTP/1.1" 200 None 2026-03-30 18:34:02,289 - lava_callback - DEBUG - Processing node 69ca6f9f0e33d030878a9aee: baseline-x86 2026-03-30 18:34:02,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:34:02,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:34:02,875 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ca6f9f0e33d030878a9aee/log.txt.gz 2026-03-30 18:34:03,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:34:04,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:34:04,443 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ca6f9f0e33d030878a9aee/lava-logs.yaml 2026-03-30 18:34:04,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:34:04,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:34:04,602 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ca6f9f0e33d030878a9aee/lava_callback.json.gz 2026-03-30 18:34:04,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:34:04,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca6f9f0e33d030878a9aee HTTP/1.1" 200 None 2026-03-30 18:34:04,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:34:04,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c13f3c3aafdab4be7771 HTTP/1.1" 200 None 2026-03-30 18:34:04,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:34:04,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca6f9f0e33d030878a9aee HTTP/1.1" 200 None 2026-03-30 18:34:04,681 - lava_callback - INFO - Completed processing callback for node 69ca6f9f0e33d030878a9aee INFO: 172.20.0.1:57986 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:34:06,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:34:06,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60504 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:34:45,849 - lava_callback - INFO - Received callback for node 69cabd8a4b5e3e0ab6a63b7f INFO: 172.20.0.1:59270 - "POST /node/69cabd8a4b5e3e0ab6a63b7f HTTP/1.0" 202 Accepted 2026-03-30 18:34:45,857 - lava_callback - INFO - Starting async job submit for node 69cabd8a4b5e3e0ab6a63b7f 2026-03-30 18:34:45,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:34:45,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabd8a4b5e3e0ab6a63b7f HTTP/1.1" 200 None 2026-03-30 18:34:45,917 - lava_callback - DEBUG - Processing node 69cabd8a4b5e3e0ab6a63b7f: baseline-nfs-arm64 INFO: 172.20.0.1:59272 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:34:47,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:34:47,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:34:47,458 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cabd8a4b5e3e0ab6a63b7f/log.txt.gz 2026-03-30 18:34:48,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:34:48,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:34:48,364 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cabd8a4b5e3e0ab6a63b7f/lava-logs.yaml 2026-03-30 18:34:48,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:34:48,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:34:48,601 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cabd8a4b5e3e0ab6a63b7f/lava_callback.json.gz DEBUG: Setup failed for 69cabd8a4b5e3e0ab6a63b7f. Transitting job node result: incomplete -> fail 2026-03-30 18:34:48,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:34:48,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabd8a4b5e3e0ab6a63b7f HTTP/1.1" 200 None 2026-03-30 18:34:48,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:34:48,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:34:48,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:34:48,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabd8a4b5e3e0ab6a63b7f HTTP/1.1" 200 None 2026-03-30 18:34:48,841 - lava_callback - INFO - Completed processing callback for node 69cabd8a4b5e3e0ab6a63b7f INFO: 172.20.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53918 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:35:06,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:35:06,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35406 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:35:33,158 - lava_callback - INFO - Received callback for node 69ca8b5c0e33d030878aa05c INFO: 172.20.0.1:39132 - "POST /node/69ca8b5c0e33d030878aa05c HTTP/1.0" 202 Accepted 2026-03-30 18:35:33,164 - lava_callback - INFO - Starting async job submit for node 69ca8b5c0e33d030878aa05c 2026-03-30 18:35:33,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:35:33,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8b5c0e33d030878aa05c HTTP/1.1" 200 None 2026-03-30 18:35:33,199 - lava_callback - DEBUG - Processing node 69ca8b5c0e33d030878aa05c: baseline-x86 2026-03-30 18:35:33,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:35:33,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:35:33,663 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ca8b5c0e33d030878aa05c/log.txt.gz 2026-03-30 18:35:33,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:35:34,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:35:34,058 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ca8b5c0e33d030878aa05c/lava-logs.yaml 2026-03-30 18:35:34,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:39134 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:35:34,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:35:34,209 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ca8b5c0e33d030878aa05c/lava_callback.json.gz 2026-03-30 18:35:34,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:35:34,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8b5c0e33d030878aa05c HTTP/1.1" 200 None 2026-03-30 18:35:34,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:35:34,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca32150e33d030878a8819 HTTP/1.1" 200 None 2026-03-30 18:35:34,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:35:34,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8b5c0e33d030878aa05c HTTP/1.1" 200 None 2026-03-30 18:35:34,282 - lava_callback - INFO - Completed processing callback for node 69ca8b5c0e33d030878aa05c INFO: 172.20.0.1:39146 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:35:36,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:35:36,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51306 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:38:01,439 - lava_callback - INFO - Received callback for node 69cab4154b5e3e0ab6a639c1 INFO: 172.20.0.1:43134 - "POST /node/69cab4154b5e3e0ab6a639c1 HTTP/1.0" 202 Accepted 2026-03-30 18:38:01,486 - lava_callback - INFO - Starting async job submit for node 69cab4154b5e3e0ab6a639c1 2026-03-30 18:38:01,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:38:01,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab4154b5e3e0ab6a639c1 HTTP/1.1" 200 None 2026-03-30 18:38:01,537 - lava_callback - DEBUG - Processing node 69cab4154b5e3e0ab6a639c1: baseline-arm-pengutronix 2026-03-30 18:38:01,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:38:01,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:38:01,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cab4154b5e3e0ab6a639c1/log.txt.gz 2026-03-30 18:38:01,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:38:02,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:38:02,029 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cab4154b5e3e0ab6a639c1/lava-logs.yaml 2026-03-30 18:38:02,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:38:02,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:38:02,141 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cab4154b5e3e0ab6a639c1/lava_callback.json.gz DEBUG: Setup failed for 69cab4154b5e3e0ab6a639c1. Transitting job node result: incomplete -> fail 2026-03-30 18:38:02,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:38:02,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cab4154b5e3e0ab6a639c1 HTTP/1.1" 200 None 2026-03-30 18:38:02,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:38:02,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 18:38:02,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:38:02,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cab4154b5e3e0ab6a639c1 HTTP/1.1" 200 None 2026-03-30 18:38:02,302 - lava_callback - INFO - Completed processing callback for node 69cab4154b5e3e0ab6a639c1 INFO: 172.20.0.1:43146 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:38:06,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:38:06,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45260 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:38:29,541 - lava_callback - INFO - Received callback for node 69cabf744b5e3e0ab6a63baf INFO: 172.20.0.1:45272 - "POST /node/69cabf744b5e3e0ab6a63baf HTTP/1.0" 202 Accepted 2026-03-30 18:38:29,547 - lava_callback - INFO - Starting async job submit for node 69cabf744b5e3e0ab6a63baf 2026-03-30 18:38:29,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:38:29,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabf744b5e3e0ab6a63baf HTTP/1.1" 200 None 2026-03-30 18:38:29,587 - lava_callback - DEBUG - Processing node 69cabf744b5e3e0ab6a63baf: baseline-arm64 2026-03-30 18:38:29,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:38:30,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:38:30,092 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69cabf744b5e3e0ab6a63baf/log.txt.gz 2026-03-30 18:38:30,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:38:30,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:38:30,511 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cabf744b5e3e0ab6a63baf/lava-logs.yaml 2026-03-30 18:38:30,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:38:30,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:38:30,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cabf744b5e3e0ab6a63baf/lava_callback.json.gz 2026-03-30 18:38:30,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:38:30,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cabf744b5e3e0ab6a63baf HTTP/1.1" 200 None 2026-03-30 18:38:30,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:38:30,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:38:30,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:38:30,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cabf744b5e3e0ab6a63baf HTTP/1.1" 200 None 2026-03-30 18:38:30,830 - lava_callback - INFO - Completed processing callback for node 69cabf744b5e3e0ab6a63baf INFO: 172.20.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34792 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:38:36,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:38:36,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50712 - "GET /node/6940bd481e3c24e95681be6d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50726 - "GET /node/6992679998a8bdb31c39206d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50510 - "GET /node/69c24ece4a2c5046eb880023%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50516 - "GET /node/698ef48ef0e3ffbba67d2da1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55378 - "GET /node/69bcb051b4744551b27fd361%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50446 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:43:29,345 - lava_callback - INFO - Received callback for node 69cac0684b5e3e0ab6a63bbd INFO: 172.20.0.1:50448 - "POST /node/69cac0684b5e3e0ab6a63bbd HTTP/1.0" 202 Accepted 2026-03-30 18:43:29,352 - lava_callback - INFO - Starting async job submit for node 69cac0684b5e3e0ab6a63bbd 2026-03-30 18:43:29,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:43:29,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac0684b5e3e0ab6a63bbd HTTP/1.1" 200 None 2026-03-30 18:43:29,427 - lava_callback - DEBUG - Processing node 69cac0684b5e3e0ab6a63bbd: baseline-arm 2026-03-30 18:43:30,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:43:30,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:43:30,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69cac0684b5e3e0ab6a63bbd/log.txt.gz 2026-03-30 18:43:30,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:43:30,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:43:30,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69cac0684b5e3e0ab6a63bbd/lava-logs.yaml 2026-03-30 18:43:30,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:43:31,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:43:31,007 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69cac0684b5e3e0ab6a63bbd/lava_callback.json.gz DEBUG: Setup failed for 69cac0684b5e3e0ab6a63bbd. Transitting job node result: incomplete -> fail 2026-03-30 18:43:31,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:43:31,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac0684b5e3e0ab6a63bbd HTTP/1.1" 200 None 2026-03-30 18:43:31,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:43:31,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 18:43:31,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:43:31,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cac0684b5e3e0ab6a63bbd HTTP/1.1" 200 None 2026-03-30 18:43:31,290 - lava_callback - INFO - Completed processing callback for node 69cac0684b5e3e0ab6a63bbd INFO: 172.20.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37636 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:43:36,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:43:36,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36416 - "GET /node/69280d73b1b5e06bf6c04ccb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36420 - "GET /node/69865c6a177ca0f097bd4530%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54154 - "GET /node/698401d0969566dcb0d2b437%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54162 - "GET /node/69a2aa588020dd22eabedf07%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36360 - "GET /node/693e582d407f32424eb6327b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36372 - "GET /node/69933e4831166481c8dedc92%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44136 - "GET /node/6928c7ce3a49357e496c8a3d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44148 - "GET /node/6941ffccbb27571da24b05a7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40952 - "GET /node/693f5bf10d8ce4018da8ca96%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36720 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:55:05,441 - lava_callback - INFO - Received callback for node 69cac2504b5e3e0ab6a63bfb INFO: 172.20.0.1:33236 - "POST /node/69cac2504b5e3e0ab6a63bfb HTTP/1.0" 202 Accepted 2026-03-30 18:55:05,449 - lava_callback - INFO - Starting async job submit for node 69cac2504b5e3e0ab6a63bfb 2026-03-30 18:55:05,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:55:05,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac2504b5e3e0ab6a63bfb HTTP/1.1" 200 None 2026-03-30 18:55:05,520 - lava_callback - DEBUG - Processing node 69cac2504b5e3e0ab6a63bfb: baseline-nfs-arm64 INFO: 172.20.0.1:33246 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:55:06,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:55:06,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:55:06,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cac2504b5e3e0ab6a63bfb/log.txt.gz 2026-03-30 18:55:07,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:55:07,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:55:07,824 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cac2504b5e3e0ab6a63bfb/lava-logs.yaml 2026-03-30 18:55:07,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:55:08,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:55:08,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cac2504b5e3e0ab6a63bfb/lava_callback.json.gz DEBUG: Setup failed for 69cac2504b5e3e0ab6a63bfb. Transitting job node result: incomplete -> fail 2026-03-30 18:55:08,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:55:08,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac2504b5e3e0ab6a63bfb HTTP/1.1" 200 None 2026-03-30 18:55:08,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:55:08,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 18:55:08,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:55:08,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cac2504b5e3e0ab6a63bfb HTTP/1.1" 200 None 2026-03-30 18:55:08,268 - lava_callback - INFO - Completed processing callback for node 69cac2504b5e3e0ab6a63bfb INFO: 172.20.0.1:44702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60218 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:55:36,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:55:36,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50564 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:57:41,352 - lava_callback - INFO - Received callback for node 69cac3164b5e3e0ab6a63c12 INFO: 172.20.0.1:42824 - "POST /node/69cac3164b5e3e0ab6a63c12 HTTP/1.0" 202 Accepted 2026-03-30 18:57:41,401 - lava_callback - INFO - Starting async job submit for node 69cac3164b5e3e0ab6a63c12 2026-03-30 18:57:41,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:57:41,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac3164b5e3e0ab6a63c12 HTTP/1.1" 200 None 2026-03-30 18:57:41,455 - lava_callback - DEBUG - Processing node 69cac3164b5e3e0ab6a63c12: baseline-arm-pengutronix 2026-03-30 18:57:41,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:57:41,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:57:41,717 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cac3164b5e3e0ab6a63c12/log.txt.gz 2026-03-30 18:57:41,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:57:41,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:57:41,992 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cac3164b5e3e0ab6a63c12/lava-logs.yaml 2026-03-30 18:57:41,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 18:57:42,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 18:57:42,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cac3164b5e3e0ab6a63c12/lava_callback.json.gz DEBUG: Setup failed for 69cac3164b5e3e0ab6a63c12. Transitting job node result: incomplete -> fail 2026-03-30 18:57:42,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:57:42,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac3164b5e3e0ab6a63c12 HTTP/1.1" 200 None 2026-03-30 18:57:42,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:57:42,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 18:57:42,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:57:42,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cac3164b5e3e0ab6a63c12 HTTP/1.1" 200 None 2026-03-30 18:57:42,492 - lava_callback - INFO - Completed processing callback for node 69cac3164b5e3e0ab6a63c12 INFO: 172.20.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56520 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:58:06,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:58:06,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57896 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:58:31,595 - lava_callback - INFO - Received callback for node 69c824cc123b47fd23770944 INFO: 172.20.0.1:40042 - "POST /node/69c824cc123b47fd23770944 HTTP/1.0" 202 Accepted 2026-03-30 18:58:31,603 - lava_callback - INFO - Starting async job submit for node 69c824cc123b47fd23770944 2026-03-30 18:58:31,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:58:31,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c824cc123b47fd23770944 HTTP/1.1" 200 None 2026-03-30 18:58:31,620 - lava_callback - DEBUG - Processing node 69c824cc123b47fd23770944: baseline-arm-clabbe 2026-03-30 18:58:31,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c824cc123b47fd23770944 2026-03-30 18:58:31,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:58:31,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c824cc123b47fd23770944 HTTP/1.1" 200 None 2026-03-30 18:58:31,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:58:31,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-03-30 18:58:31,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:58:31,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c824cc123b47fd23770944 HTTP/1.1" 200 None 2026-03-30 18:58:31,688 - lava_callback - ERROR - Error processing callback for node 69c824cc123b47fd23770944: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56570 - "GET /node/6927a0444e6fb3232e2724b3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56580 - "GET /node/6990a4fbc45febfe44520441%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36212 - "GET / HTTP/1.0" 200 OK 2026-03-30 18:59:31,613 - lava_callback - INFO - Received callback for node 69c82508123b47fd23770959 INFO: 172.20.0.1:40114 - "POST /node/69c82508123b47fd23770959 HTTP/1.0" 202 Accepted 2026-03-30 18:59:31,618 - lava_callback - INFO - Starting async job submit for node 69c82508123b47fd23770959 2026-03-30 18:59:31,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:59:31,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82508123b47fd23770959 HTTP/1.1" 200 None 2026-03-30 18:59:31,634 - lava_callback - DEBUG - Processing node 69c82508123b47fd23770959: baseline-arm-clabbe 2026-03-30 18:59:31,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c82508123b47fd23770959 2026-03-30 18:59:31,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:59:31,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82508123b47fd23770959 HTTP/1.1" 200 None 2026-03-30 18:59:31,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:59:31,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-03-30 18:59:31,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 18:59:31,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c82508123b47fd23770959 HTTP/1.1" 200 None 2026-03-30 18:59:31,700 - lava_callback - ERROR - Error processing callback for node 69c82508123b47fd23770959: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39086 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:00:11,751 - lava_callback - INFO - Received callback for node 69c8252d123b47fd2377096a INFO: 172.20.0.1:38032 - "POST /node/69c8252d123b47fd2377096a HTTP/1.0" 202 Accepted 2026-03-30 19:00:11,757 - lava_callback - INFO - Starting async job submit for node 69c8252d123b47fd2377096a 2026-03-30 19:00:11,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:00:11,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8252d123b47fd2377096a HTTP/1.1" 200 None 2026-03-30 19:00:11,772 - lava_callback - DEBUG - Processing node 69c8252d123b47fd2377096a: baseline-arm-clabbe 2026-03-30 19:00:11,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8252d123b47fd2377096a 2026-03-30 19:00:11,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:00:11,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8252d123b47fd2377096a HTTP/1.1" 200 None 2026-03-30 19:00:11,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:00:11,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-03-30 19:00:11,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:00:11,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8252d123b47fd2377096a HTTP/1.1" 200 None 2026-03-30 19:00:11,832 - lava_callback - ERROR - Error processing callback for node 69c8252d123b47fd2377096a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47308 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:00:51,701 - lava_callback - INFO - Received callback for node 69c82551123b47fd23770982 INFO: 172.20.0.1:33898 - "POST /node/69c82551123b47fd23770982 HTTP/1.0" 202 Accepted 2026-03-30 19:00:51,710 - lava_callback - INFO - Starting async job submit for node 69c82551123b47fd23770982 2026-03-30 19:00:51,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:00:51,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82551123b47fd23770982 HTTP/1.1" 200 None 2026-03-30 19:00:51,733 - lava_callback - DEBUG - Processing node 69c82551123b47fd23770982: baseline-arm-clabbe 2026-03-30 19:00:51,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c82551123b47fd23770982 2026-03-30 19:00:51,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:00:51,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82551123b47fd23770982 HTTP/1.1" 200 None 2026-03-30 19:00:51,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:00:51,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-03-30 19:00:51,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:00:51,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c82551123b47fd23770982 HTTP/1.1" 200 None 2026-03-30 19:00:51,797 - lava_callback - ERROR - Error processing callback for node 69c82551123b47fd23770982: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55828 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:01:31,699 - lava_callback - INFO - Received callback for node 69c82576123b47fd2377098e INFO: 172.20.0.1:46316 - "POST /node/69c82576123b47fd2377098e HTTP/1.0" 202 Accepted 2026-03-30 19:01:31,705 - lava_callback - INFO - Starting async job submit for node 69c82576123b47fd2377098e 2026-03-30 19:01:31,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:01:31,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82576123b47fd2377098e HTTP/1.1" 200 None 2026-03-30 19:01:31,728 - lava_callback - DEBUG - Processing node 69c82576123b47fd2377098e: baseline-arm-clabbe 2026-03-30 19:01:31,729 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c82576123b47fd2377098e 2026-03-30 19:01:31,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:01:31,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82576123b47fd2377098e HTTP/1.1" 200 None 2026-03-30 19:01:31,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:01:31,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-03-30 19:01:31,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:01:31,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c82576123b47fd2377098e HTTP/1.1" 200 None 2026-03-30 19:01:31,805 - lava_callback - ERROR - Error processing callback for node 69c82576123b47fd2377098e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41876 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.20.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51960 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:11:02,200 - lava_callback - INFO - Received callback for node 69cac1a64b5e3e0ab6a63be0 INFO: 172.20.0.1:47982 - "POST /node/69cac1a64b5e3e0ab6a63be0 HTTP/1.0" 202 Accepted 2026-03-30 19:11:02,207 - lava_callback - INFO - Starting async job submit for node 69cac1a64b5e3e0ab6a63be0 2026-03-30 19:11:02,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:11:02,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac1a64b5e3e0ab6a63be0 HTTP/1.1" 200 None 2026-03-30 19:11:02,249 - lava_callback - DEBUG - Processing node 69cac1a64b5e3e0ab6a63be0: baseline-nfs-arm64 2026-03-30 19:11:02,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 19:11:02,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 19:11:02,933 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cac1a64b5e3e0ab6a63be0/log.txt.gz 2026-03-30 19:11:03,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 19:11:03,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 19:11:03,430 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cac1a64b5e3e0ab6a63be0/lava-logs.yaml 2026-03-30 19:11:03,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 19:11:03,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 19:11:03,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cac1a64b5e3e0ab6a63be0/lava_callback.json.gz 2026-03-30 19:11:03,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:11:03,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac1a64b5e3e0ab6a63be0 HTTP/1.1" 200 None 2026-03-30 19:11:03,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:11:03,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-03-30 19:11:03,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:11:03,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cac1a64b5e3e0ab6a63be0 HTTP/1.1" 200 None 2026-03-30 19:11:03,722 - lava_callback - INFO - Completed processing callback for node 69cac1a64b5e3e0ab6a63be0 INFO: 172.20.0.1:47996 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:11:06,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:11:06,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40702 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:17:22,384 - lava_callback - INFO - Received callback for node 69cac7b34b5e3e0ab6a63cbf INFO: 172.20.0.1:53002 - "POST /node/69cac7b34b5e3e0ab6a63cbf HTTP/1.0" 202 Accepted 2026-03-30 19:17:22,433 - lava_callback - INFO - Starting async job submit for node 69cac7b34b5e3e0ab6a63cbf 2026-03-30 19:17:22,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:17:22,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac7b34b5e3e0ab6a63cbf HTTP/1.1" 200 None 2026-03-30 19:17:22,473 - lava_callback - DEBUG - Processing node 69cac7b34b5e3e0ab6a63cbf: baseline-arm-pengutronix 2026-03-30 19:17:22,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 19:17:22,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 19:17:22,709 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cac7b34b5e3e0ab6a63cbf/log.txt.gz 2026-03-30 19:17:22,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 19:17:22,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 19:17:22,949 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cac7b34b5e3e0ab6a63cbf/lava-logs.yaml 2026-03-30 19:17:22,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-30 19:17:23,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-30 19:17:23,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cac7b34b5e3e0ab6a63cbf/lava_callback.json.gz DEBUG: Setup failed for 69cac7b34b5e3e0ab6a63cbf. Transitting job node result: incomplete -> fail 2026-03-30 19:17:23,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:17:23,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cac7b34b5e3e0ab6a63cbf HTTP/1.1" 200 None 2026-03-30 19:17:23,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:17:23,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-03-30 19:17:23,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:17:23,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cac7b34b5e3e0ab6a63cbf HTTP/1.1" 200 None 2026-03-30 19:17:23,226 - lava_callback - INFO - Completed processing callback for node 69cac7b34b5e3e0ab6a63cbf INFO: 172.20.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48436 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:17:36,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:17:36,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56094 - "GET /node/693f5b660d8ce4018da8c7cd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45740 - "GET /node/694ab94783c67c43d1edefbe%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45746 - "GET /node/6985bc7f71989fb141497592%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56564 - "GET /node/69b20deab0f5558b5d7ccb38%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56578 - "GET /node/69865d34177ca0f097bd45f6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41554 - "GET /node/69876c8ae31b58f834f19967%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41560 - "GET /node/693f593e0d8ce4018da8bb91%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42254 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:31:43,832 - lava_callback - INFO - Received callback for node 69c82c91123b47fd237709f7 INFO: 172.20.0.1:37550 - "POST /node/69c82c91123b47fd237709f7 HTTP/1.0" 202 Accepted 2026-03-30 19:31:43,842 - lava_callback - INFO - Starting async job submit for node 69c82c91123b47fd237709f7 2026-03-30 19:31:43,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:31:43,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82c91123b47fd237709f7 HTTP/1.1" 200 None 2026-03-30 19:31:43,861 - lava_callback - DEBUG - Processing node 69c82c91123b47fd237709f7: baseline-arm64-baylibre 2026-03-30 19:31:43,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c82c91123b47fd237709f7 2026-03-30 19:31:43,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:31:43,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82c91123b47fd237709f7 HTTP/1.1" 200 None 2026-03-30 19:31:43,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:31:43,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-03-30 19:31:43,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:31:43,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c82c91123b47fd237709f7 HTTP/1.1" 200 None 2026-03-30 19:31:43,933 - lava_callback - ERROR - Error processing callback for node 69c82c91123b47fd237709f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60150 - "GET /node/69376d4f0c55536e7ddd9f6e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46888 - "GET /node/693f94d90d8ce4018da97ddc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46902 - "GET /node/699268a098a8bdb31c392257%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46916 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:36:03,876 - lava_callback - INFO - Received callback for node 69c82d91123b47fd23770a18 INFO: 172.20.0.1:59636 - "POST /node/69c82d91123b47fd23770a18 HTTP/1.0" 202 Accepted 2026-03-30 19:36:03,881 - lava_callback - INFO - Starting async job submit for node 69c82d91123b47fd23770a18 2026-03-30 19:36:03,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:36:03,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82d91123b47fd23770a18 HTTP/1.1" 200 None 2026-03-30 19:36:03,923 - lava_callback - DEBUG - Processing node 69c82d91123b47fd23770a18: baseline-arm64-baylibre 2026-03-30 19:36:03,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c82d91123b47fd23770a18 2026-03-30 19:36:03,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:36:03,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82d91123b47fd23770a18 HTTP/1.1" 200 None 2026-03-30 19:36:03,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:36:03,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-03-30 19:36:03,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:36:03,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c82d91123b47fd23770a18 HTTP/1.1" 200 None 2026-03-30 19:36:03,985 - lava_callback - ERROR - Error processing callback for node 69c82d91123b47fd23770a18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44828 - "GET /node/693771f80c55536e7dddab79%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44834 - "GET /node/69418bd5ecc59770562e7264%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55872 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:39:44,104 - lava_callback - INFO - Received callback for node 69c82e74123b47fd23770a3a INFO: 172.20.0.1:40684 - "POST /node/69c82e74123b47fd23770a3a HTTP/1.0" 202 Accepted 2026-03-30 19:39:44,110 - lava_callback - INFO - Starting async job submit for node 69c82e74123b47fd23770a3a 2026-03-30 19:39:44,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:39:44,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82e74123b47fd23770a3a HTTP/1.1" 200 None 2026-03-30 19:39:44,126 - lava_callback - DEBUG - Processing node 69c82e74123b47fd23770a3a: baseline-arm64-baylibre 2026-03-30 19:39:44,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c82e74123b47fd23770a3a 2026-03-30 19:39:44,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:39:44,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82e74123b47fd23770a3a HTTP/1.1" 200 None 2026-03-30 19:39:44,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:39:44,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-03-30 19:39:44,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:39:44,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c82e74123b47fd23770a3a HTTP/1.1" 200 None 2026-03-30 19:39:44,186 - lava_callback - ERROR - Error processing callback for node 69c82e74123b47fd23770a3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43614 - "GET /node/699fd594f53f50eff99c7e30%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43624 - "GET /node/69936db8cebe99dd8e068055%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33350 - "GET /node/694ac4af6c96ed51d316f0f3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40690 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:44:53,604 - lava_callback - INFO - Received callback for node 69c82fa8123b47fd23770a50 INFO: 172.20.0.1:45562 - "POST /node/69c82fa8123b47fd23770a50 HTTP/1.0" 202 Accepted 2026-03-30 19:44:53,610 - lava_callback - INFO - Starting async job submit for node 69c82fa8123b47fd23770a50 2026-03-30 19:44:53,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:44:53,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82fa8123b47fd23770a50 HTTP/1.1" 200 None 2026-03-30 19:44:53,631 - lava_callback - DEBUG - Processing node 69c82fa8123b47fd23770a50: baseline-arm64-clabbe 2026-03-30 19:44:53,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c82fa8123b47fd23770a50 2026-03-30 19:44:53,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:44:53,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82fa8123b47fd23770a50 HTTP/1.1" 200 None 2026-03-30 19:44:53,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:44:53,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-03-30 19:44:53,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:44:53,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c82fa8123b47fd23770a50 HTTP/1.1" 200 None 2026-03-30 19:44:53,687 - lava_callback - ERROR - Error processing callback for node 69c82fa8123b47fd23770a50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37262 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:46:13,580 - lava_callback - INFO - Received callback for node 69c82ff9123b47fd23770a64 INFO: 172.20.0.1:56804 - "POST /node/69c82ff9123b47fd23770a64 HTTP/1.0" 202 Accepted 2026-03-30 19:46:13,587 - lava_callback - INFO - Starting async job submit for node 69c82ff9123b47fd23770a64 2026-03-30 19:46:13,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:46:13,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82ff9123b47fd23770a64 HTTP/1.1" 200 None 2026-03-30 19:46:13,607 - lava_callback - DEBUG - Processing node 69c82ff9123b47fd23770a64: baseline-arm64-clabbe 2026-03-30 19:46:13,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c82ff9123b47fd23770a64 2026-03-30 19:46:13,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:46:13,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c82ff9123b47fd23770a64 HTTP/1.1" 200 None 2026-03-30 19:46:13,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:46:13,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-03-30 19:46:13,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:46:13,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c82ff9123b47fd23770a64 HTTP/1.1" 200 None 2026-03-30 19:46:13,660 - lava_callback - ERROR - Error processing callback for node 69c82ff9123b47fd23770a64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44050 - "GET /node/6988c2569fc35f969e1edfc0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44056 - "GET /node/698fd70a76d4b6342e9d8f23%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41070 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:47:53,657 - lava_callback - INFO - Received callback for node 69c8305c123b47fd23770a70 INFO: 172.20.0.1:33726 - "POST /node/69c8305c123b47fd23770a70 HTTP/1.0" 202 Accepted 2026-03-30 19:47:53,666 - lava_callback - INFO - Starting async job submit for node 69c8305c123b47fd23770a70 2026-03-30 19:47:53,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:47:53,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8305c123b47fd23770a70 HTTP/1.1" 200 None 2026-03-30 19:47:53,683 - lava_callback - DEBUG - Processing node 69c8305c123b47fd23770a70: baseline-arm64-clabbe 2026-03-30 19:47:53,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8305c123b47fd23770a70 2026-03-30 19:47:53,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:47:53,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8305c123b47fd23770a70 HTTP/1.1" 200 None 2026-03-30 19:47:53,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:47:53,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-03-30 19:47:53,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:47:53,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8305c123b47fd23770a70 HTTP/1.1" 200 None 2026-03-30 19:47:53,744 - lava_callback - ERROR - Error processing callback for node 69c8305c123b47fd23770a70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40220 - "GET /node/698ead1bdb401c547d571e2e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40222 - "GET /node/69861d35177ca0f097bd172a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40226 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:49:54,001 - lava_callback - INFO - Received callback for node 69c830d4123b47fd23770a82 INFO: 172.20.0.1:35536 - "POST /node/69c830d4123b47fd23770a82 HTTP/1.0" 202 Accepted 2026-03-30 19:49:54,007 - lava_callback - INFO - Starting async job submit for node 69c830d4123b47fd23770a82 2026-03-30 19:49:54,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:49:54,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c830d4123b47fd23770a82 HTTP/1.1" 200 None 2026-03-30 19:49:54,026 - lava_callback - DEBUG - Processing node 69c830d4123b47fd23770a82: baseline-arm64-clabbe 2026-03-30 19:49:54,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c830d4123b47fd23770a82 2026-03-30 19:49:54,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:49:54,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c830d4123b47fd23770a82 HTTP/1.1" 200 None 2026-03-30 19:49:54,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:49:54,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-03-30 19:49:54,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:49:54,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c830d4123b47fd23770a82 HTTP/1.1" 200 None 2026-03-30 19:49:54,077 - lava_callback - ERROR - Error processing callback for node 69c830d4123b47fd23770a82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39764 - "GET /login HTTP/1.0" 404 Not Found INFO: 172.20.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51936 - "GET /node/6992671198a8bdb31c391f89%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51944 - "GET /node/69295cc2f7abe3da4c22a511%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60482 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:51:13,808 - lava_callback - INFO - Received callback for node 69c83123123b47fd23770a8e INFO: 172.20.0.1:45528 - "POST /node/69c83123123b47fd23770a8e HTTP/1.0" 202 Accepted 2026-03-30 19:51:13,814 - lava_callback - INFO - Starting async job submit for node 69c83123123b47fd23770a8e 2026-03-30 19:51:13,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:51:13,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83123123b47fd23770a8e HTTP/1.1" 200 None 2026-03-30 19:51:13,830 - lava_callback - DEBUG - Processing node 69c83123123b47fd23770a8e: baseline-arm64-clabbe 2026-03-30 19:51:13,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83123123b47fd23770a8e 2026-03-30 19:51:13,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:51:13,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83123123b47fd23770a8e HTTP/1.1" 200 None 2026-03-30 19:51:13,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:51:13,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-03-30 19:51:13,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:51:13,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83123123b47fd23770a8e HTTP/1.1" 200 None 2026-03-30 19:51:13,897 - lava_callback - ERROR - Error processing callback for node 69c83123123b47fd23770a8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50148 - "GET /node/693796390c55536e7dddc667%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56264 - "GET / HTTP/1.0" 200 OK 2026-03-30 19:53:53,919 - lava_callback - INFO - Received callback for node 69c831c4123b47fd23770aa2 INFO: 172.20.0.1:33844 - "POST /node/69c831c4123b47fd23770aa2 HTTP/1.0" 202 Accepted 2026-03-30 19:53:53,924 - lava_callback - INFO - Starting async job submit for node 69c831c4123b47fd23770aa2 2026-03-30 19:53:53,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:53:53,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c831c4123b47fd23770aa2 HTTP/1.1" 200 None 2026-03-30 19:53:53,940 - lava_callback - DEBUG - Processing node 69c831c4123b47fd23770aa2: baseline-arm64-clabbe 2026-03-30 19:53:53,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c831c4123b47fd23770aa2 2026-03-30 19:53:53,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:53:53,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c831c4123b47fd23770aa2 HTTP/1.1" 200 None 2026-03-30 19:53:53,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:53:53,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-03-30 19:53:53,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 19:53:53,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c831c4123b47fd23770aa2 HTTP/1.1" 200 None 2026-03-30 19:53:53,996 - lava_callback - ERROR - Error processing callback for node 69c831c4123b47fd23770aa2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48058 - "GET /node/698a40ca22b4cc0f227b05ce%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48060 - "GET /node/69498cd2d45a0a86fbe25cb3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54724 - "GET /node/6992ea2431166481c8dd8b92%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44178 - "GET /node/69101cc5f4a91d81a0ec24b9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44180 - "GET /node/69936fd9cebe99dd8e068b33%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56896 - "GET /node/694bd23ec19e09af58d48084%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52094 - "GET /node/693b040afee8383e92b6f68b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52110 - "GET /node/693060b7bbee432adda3b7de%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42940 - "GET /node/69402b7e575bc060ce15545a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42954 - "GET /node/69a40a126ebb1cc56c1df4fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60324 - "GET /node/6928ed8ea7fbd8958ccef7dc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60326 - "GET /node/693e74dc3c8f1be6d3cef8e3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49842 - "GET /node/698401d0969566dcb0d2b43c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49856 - "GET /node/69c1dcb50efaf21d93103625%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37524 - "GET /node/694cdf53cb0ae69445cb2d28%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37536 - "GET /node/698ff20076d4b6342e9db91e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49942 - "GET /node/693f73910d8ce4018da93b2a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49946 - "GET /node/698a5acf22b4cc0f227b1a46%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47644 - "GET /node/69a46c6ca327b9815668ffa6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47658 - "GET /node/6992671098a8bdb31c391f81%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42376 - "GET /node/69bc986eb4744551b27fa0ea%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42378 - "GET /node/6993424d31166481c8dee45a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43908 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 20:43:16,088 - lava_callback - INFO - Received callback for node 69c83d5a123b47fd23770b10 INFO: 172.20.0.1:43918 - "POST /node/69c83d5a123b47fd23770b10 HTTP/1.0" 202 Accepted 2026-03-30 20:43:16,093 - lava_callback - INFO - Starting async job submit for node 69c83d5a123b47fd23770b10 2026-03-30 20:43:16,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:43:16,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83d5a123b47fd23770b10 HTTP/1.1" 200 None 2026-03-30 20:43:16,112 - lava_callback - DEBUG - Processing node 69c83d5a123b47fd23770b10: baseline-arm-clabbe 2026-03-30 20:43:16,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83d5a123b47fd23770b10 2026-03-30 20:43:16,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:43:16,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83d5a123b47fd23770b10 HTTP/1.1" 200 None 2026-03-30 20:43:16,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:43:16,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-03-30 20:43:16,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:43:16,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83d5a123b47fd23770b10 HTTP/1.1" 200 None 2026-03-30 20:43:16,172 - lava_callback - ERROR - Error processing callback for node 69c83d5a123b47fd23770b10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53694 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:43:56,029 - lava_callback - INFO - Received callback for node 69c83d7f123b47fd23770b20 INFO: 172.20.0.1:58474 - "POST /node/69c83d7f123b47fd23770b20 HTTP/1.0" 202 Accepted 2026-03-30 20:43:56,035 - lava_callback - INFO - Starting async job submit for node 69c83d7f123b47fd23770b20 2026-03-30 20:43:56,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:43:56,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83d7f123b47fd23770b20 HTTP/1.1" 200 None 2026-03-30 20:43:56,051 - lava_callback - DEBUG - Processing node 69c83d7f123b47fd23770b20: baseline-arm-clabbe 2026-03-30 20:43:56,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83d7f123b47fd23770b20 2026-03-30 20:43:56,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:43:56,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83d7f123b47fd23770b20 HTTP/1.1" 200 None 2026-03-30 20:43:56,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:43:56,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-03-30 20:43:56,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:43:56,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83d7f123b47fd23770b20 HTTP/1.1" 200 None 2026-03-30 20:43:56,108 - lava_callback - ERROR - Error processing callback for node 69c83d7f123b47fd23770b20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35364 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:44:36,080 - lava_callback - INFO - Received callback for node 69c83daf123b47fd23770b3d INFO: 172.20.0.1:35378 - "POST /node/69c83daf123b47fd23770b3d HTTP/1.0" 202 Accepted 2026-03-30 20:44:36,086 - lava_callback - INFO - Starting async job submit for node 69c83daf123b47fd23770b3d 2026-03-30 20:44:36,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:44:36,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83daf123b47fd23770b3d HTTP/1.1" 200 None 2026-03-30 20:44:36,273 - lava_callback - DEBUG - Processing node 69c83daf123b47fd23770b3d: baseline-arm-clabbe 2026-03-30 20:44:36,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83daf123b47fd23770b3d 2026-03-30 20:44:36,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:44:36,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83daf123b47fd23770b3d HTTP/1.1" 200 None 2026-03-30 20:44:36,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:44:36,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-03-30 20:44:36,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:44:36,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83daf123b47fd23770b3d HTTP/1.1" 200 None 2026-03-30 20:44:36,330 - lava_callback - ERROR - Error processing callback for node 69c83daf123b47fd23770b3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55822 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 20:45:16,083 - lava_callback - INFO - Received callback for node 69c83dd5123b47fd23770b44 INFO: 172.20.0.1:55838 - "POST /node/69c83dd5123b47fd23770b44 HTTP/1.0" 202 Accepted 2026-03-30 20:45:16,088 - lava_callback - INFO - Starting async job submit for node 69c83dd5123b47fd23770b44 2026-03-30 20:45:16,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:45:16,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83dd5123b47fd23770b44 HTTP/1.1" 200 None 2026-03-30 20:45:16,104 - lava_callback - DEBUG - Processing node 69c83dd5123b47fd23770b44: baseline-arm-clabbe 2026-03-30 20:45:16,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83dd5123b47fd23770b44 2026-03-30 20:45:16,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:45:16,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83dd5123b47fd23770b44 HTTP/1.1" 200 None 2026-03-30 20:45:16,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:45:16,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-03-30 20:45:16,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:45:16,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83dd5123b47fd23770b44 HTTP/1.1" 200 None 2026-03-30 20:45:16,170 - lava_callback - ERROR - Error processing callback for node 69c83dd5123b47fd23770b44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47426 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:45:56,164 - lava_callback - INFO - Received callback for node 69c83dfa123b47fd23770b58 INFO: 172.20.0.1:50288 - "POST /node/69c83dfa123b47fd23770b58 HTTP/1.0" 202 Accepted 2026-03-30 20:45:56,170 - lava_callback - INFO - Starting async job submit for node 69c83dfa123b47fd23770b58 2026-03-30 20:45:56,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:45:56,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83dfa123b47fd23770b58 HTTP/1.1" 200 None 2026-03-30 20:45:56,186 - lava_callback - DEBUG - Processing node 69c83dfa123b47fd23770b58: baseline-arm-clabbe 2026-03-30 20:45:56,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83dfa123b47fd23770b58 2026-03-30 20:45:56,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:45:56,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83dfa123b47fd23770b58 HTTP/1.1" 200 None 2026-03-30 20:45:56,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:45:56,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-03-30 20:45:56,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:45:56,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83dfa123b47fd23770b58 HTTP/1.1" 200 None 2026-03-30 20:45:56,237 - lava_callback - ERROR - Error processing callback for node 69c83dfa123b47fd23770b58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58436 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:46:36,147 - lava_callback - INFO - Received callback for node 69c83e1f123b47fd23770b6a INFO: 172.20.0.1:58448 - "POST /node/69c83e1f123b47fd23770b6a HTTP/1.0" 202 Accepted 2026-03-30 20:46:36,152 - lava_callback - INFO - Starting async job submit for node 69c83e1f123b47fd23770b6a 2026-03-30 20:46:36,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:46:36,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83e1f123b47fd23770b6a HTTP/1.1" 200 None 2026-03-30 20:46:36,168 - lava_callback - DEBUG - Processing node 69c83e1f123b47fd23770b6a: baseline-arm-clabbe 2026-03-30 20:46:36,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83e1f123b47fd23770b6a 2026-03-30 20:46:36,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:46:36,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83e1f123b47fd23770b6a HTTP/1.1" 200 None 2026-03-30 20:46:36,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:46:36,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:46:36,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:46:36,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83e1f123b47fd23770b6a HTTP/1.1" 200 None 2026-03-30 20:46:36,234 - lava_callback - ERROR - Error processing callback for node 69c83e1f123b47fd23770b6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55296 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 20:47:16,250 - lava_callback - INFO - Received callback for node 69c83e44123b47fd23770b7e INFO: 172.20.0.1:55298 - "POST /node/69c83e44123b47fd23770b7e HTTP/1.0" 202 Accepted 2026-03-30 20:47:16,255 - lava_callback - INFO - Starting async job submit for node 69c83e44123b47fd23770b7e 2026-03-30 20:47:16,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:47:16,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83e44123b47fd23770b7e HTTP/1.1" 200 None 2026-03-30 20:47:16,270 - lava_callback - DEBUG - Processing node 69c83e44123b47fd23770b7e: baseline-arm-clabbe 2026-03-30 20:47:16,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83e44123b47fd23770b7e 2026-03-30 20:47:16,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:47:16,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83e44123b47fd23770b7e HTTP/1.1" 200 None 2026-03-30 20:47:16,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:47:16,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:47:16,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:47:16,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83e44123b47fd23770b7e HTTP/1.1" 200 None 2026-03-30 20:47:16,327 - lava_callback - ERROR - Error processing callback for node 69c83e44123b47fd23770b7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36362 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:47:56,199 - lava_callback - INFO - Received callback for node 69c83e68123b47fd23770b92 INFO: 172.20.0.1:35994 - "POST /node/69c83e68123b47fd23770b92 HTTP/1.0" 202 Accepted 2026-03-30 20:47:56,205 - lava_callback - INFO - Starting async job submit for node 69c83e68123b47fd23770b92 2026-03-30 20:47:56,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:47:56,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83e68123b47fd23770b92 HTTP/1.1" 200 None 2026-03-30 20:47:56,225 - lava_callback - DEBUG - Processing node 69c83e68123b47fd23770b92: baseline-arm-clabbe 2026-03-30 20:47:56,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83e68123b47fd23770b92 2026-03-30 20:47:56,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:47:56,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83e68123b47fd23770b92 HTTP/1.1" 200 None 2026-03-30 20:47:56,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:47:56,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:47:56,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:47:56,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83e68123b47fd23770b92 HTTP/1.1" 200 None 2026-03-30 20:47:56,276 - lava_callback - ERROR - Error processing callback for node 69c83e68123b47fd23770b92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36464 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 20:48:16,285 - lava_callback - INFO - Received callback for node 69c83e8d123b47fd23770ba0 INFO: 172.20.0.1:36476 - "POST /node/69c83e8d123b47fd23770ba0 HTTP/1.0" 202 Accepted 2026-03-30 20:48:16,294 - lava_callback - INFO - Starting async job submit for node 69c83e8d123b47fd23770ba0 2026-03-30 20:48:16,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:48:16,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83e8d123b47fd23770ba0 HTTP/1.1" 200 None 2026-03-30 20:48:16,311 - lava_callback - DEBUG - Processing node 69c83e8d123b47fd23770ba0: baseline-arm-clabbe 2026-03-30 20:48:16,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83e8d123b47fd23770ba0 2026-03-30 20:48:16,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:48:16,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83e8d123b47fd23770ba0 HTTP/1.1" 200 None 2026-03-30 20:48:16,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:48:16,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:48:16,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:48:16,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83e8d123b47fd23770ba0 HTTP/1.1" 200 None 2026-03-30 20:48:16,372 - lava_callback - ERROR - Error processing callback for node 69c83e8d123b47fd23770ba0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42732 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:48:56,227 - lava_callback - INFO - Received callback for node 69c83eb1123b47fd23770bb3 INFO: 172.20.0.1:53290 - "POST /node/69c83eb1123b47fd23770bb3 HTTP/1.0" 202 Accepted 2026-03-30 20:48:56,233 - lava_callback - INFO - Starting async job submit for node 69c83eb1123b47fd23770bb3 2026-03-30 20:48:56,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:48:56,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83eb1123b47fd23770bb3 HTTP/1.1" 200 None 2026-03-30 20:48:56,253 - lava_callback - DEBUG - Processing node 69c83eb1123b47fd23770bb3: baseline-arm-clabbe 2026-03-30 20:48:56,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83eb1123b47fd23770bb3 2026-03-30 20:48:56,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:48:56,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83eb1123b47fd23770bb3 HTTP/1.1" 200 None 2026-03-30 20:48:56,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:48:56,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:48:56,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:48:56,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83eb1123b47fd23770bb3 HTTP/1.1" 200 None 2026-03-30 20:48:56,309 - lava_callback - ERROR - Error processing callback for node 69c83eb1123b47fd23770bb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40154 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:49:36,359 - lava_callback - INFO - Received callback for node 69c83ed6123b47fd23770bc5 INFO: 172.20.0.1:40162 - "POST /node/69c83ed6123b47fd23770bc5 HTTP/1.0" 202 Accepted 2026-03-30 20:49:36,365 - lava_callback - INFO - Starting async job submit for node 69c83ed6123b47fd23770bc5 2026-03-30 20:49:36,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:49:36,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83ed6123b47fd23770bc5 HTTP/1.1" 200 None 2026-03-30 20:49:36,382 - lava_callback - DEBUG - Processing node 69c83ed6123b47fd23770bc5: baseline-arm-clabbe 2026-03-30 20:49:36,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83ed6123b47fd23770bc5 2026-03-30 20:49:36,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:49:36,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83ed6123b47fd23770bc5 HTTP/1.1" 200 None 2026-03-30 20:49:36,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:49:36,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:49:36,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:49:36,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83ed6123b47fd23770bc5 HTTP/1.1" 200 None 2026-03-30 20:49:36,446 - lava_callback - ERROR - Error processing callback for node 69c83ed6123b47fd23770bc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46582 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 20:50:16,262 - lava_callback - INFO - Received callback for node 69c83efb123b47fd23770bd7 INFO: 172.20.0.1:46598 - "POST /node/69c83efb123b47fd23770bd7 HTTP/1.0" 202 Accepted 2026-03-30 20:50:16,267 - lava_callback - INFO - Starting async job submit for node 69c83efb123b47fd23770bd7 2026-03-30 20:50:16,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:50:16,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83efb123b47fd23770bd7 HTTP/1.1" 200 None 2026-03-30 20:50:16,283 - lava_callback - DEBUG - Processing node 69c83efb123b47fd23770bd7: baseline-arm-clabbe 2026-03-30 20:50:16,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83efb123b47fd23770bd7 2026-03-30 20:50:16,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:50:16,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83efb123b47fd23770bd7 HTTP/1.1" 200 None 2026-03-30 20:50:16,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:50:16,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:50:16,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:50:16,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83efb123b47fd23770bd7 HTTP/1.1" 200 None 2026-03-30 20:50:16,337 - lava_callback - ERROR - Error processing callback for node 69c83efb123b47fd23770bd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36402 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:50:56,370 - lava_callback - INFO - Received callback for node 69c83f20123b47fd23770be6 INFO: 172.20.0.1:53372 - "POST /node/69c83f20123b47fd23770be6 HTTP/1.0" 202 Accepted 2026-03-30 20:50:56,376 - lava_callback - INFO - Starting async job submit for node 69c83f20123b47fd23770be6 2026-03-30 20:50:56,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:50:56,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83f20123b47fd23770be6 HTTP/1.1" 200 None 2026-03-30 20:50:56,392 - lava_callback - DEBUG - Processing node 69c83f20123b47fd23770be6: baseline-arm-clabbe 2026-03-30 20:50:56,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83f20123b47fd23770be6 2026-03-30 20:50:56,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:50:56,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83f20123b47fd23770be6 HTTP/1.1" 200 None 2026-03-30 20:50:56,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:50:56,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:50:56,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:50:56,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83f20123b47fd23770be6 HTTP/1.1" 200 None 2026-03-30 20:50:56,479 - lava_callback - ERROR - Error processing callback for node 69c83f20123b47fd23770be6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56878 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:51:36,395 - lava_callback - INFO - Received callback for node 69c83f45123b47fd23770bf5 INFO: 172.20.0.1:56882 - "POST /node/69c83f45123b47fd23770bf5 HTTP/1.0" 202 Accepted 2026-03-30 20:51:36,400 - lava_callback - INFO - Starting async job submit for node 69c83f45123b47fd23770bf5 2026-03-30 20:51:36,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:51:36,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83f45123b47fd23770bf5 HTTP/1.1" 200 None 2026-03-30 20:51:36,415 - lava_callback - DEBUG - Processing node 69c83f45123b47fd23770bf5: baseline-arm-clabbe 2026-03-30 20:51:36,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83f45123b47fd23770bf5 2026-03-30 20:51:36,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:51:36,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83f45123b47fd23770bf5 HTTP/1.1" 200 None 2026-03-30 20:51:36,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:51:36,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:51:36,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:51:36,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83f45123b47fd23770bf5 HTTP/1.1" 200 None 2026-03-30 20:51:36,466 - lava_callback - ERROR - Error processing callback for node 69c83f45123b47fd23770bf5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39264 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:51:56,413 - lava_callback - INFO - Received callback for node 69c83f6a123b47fd23770c06 INFO: 172.20.0.1:36940 - "POST /node/69c83f6a123b47fd23770c06 HTTP/1.0" 202 Accepted 2026-03-30 20:51:56,418 - lava_callback - INFO - Starting async job submit for node 69c83f6a123b47fd23770c06 2026-03-30 20:51:56,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:51:56,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83f6a123b47fd23770c06 HTTP/1.1" 200 None 2026-03-30 20:51:56,434 - lava_callback - DEBUG - Processing node 69c83f6a123b47fd23770c06: baseline-arm-clabbe 2026-03-30 20:51:56,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83f6a123b47fd23770c06 2026-03-30 20:51:56,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:51:56,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83f6a123b47fd23770c06 HTTP/1.1" 200 None 2026-03-30 20:51:56,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:51:56,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:51:56,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:51:56,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83f6a123b47fd23770c06 HTTP/1.1" 200 None 2026-03-30 20:51:56,504 - lava_callback - ERROR - Error processing callback for node 69c83f6a123b47fd23770c06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35272 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:52:36,442 - lava_callback - INFO - Received callback for node 69c83f8e123b47fd23770c14 INFO: 172.20.0.1:35286 - "POST /node/69c83f8e123b47fd23770c14 HTTP/1.0" 202 Accepted 2026-03-30 20:52:36,447 - lava_callback - INFO - Starting async job submit for node 69c83f8e123b47fd23770c14 2026-03-30 20:52:36,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:52:36,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83f8e123b47fd23770c14 HTTP/1.1" 200 None 2026-03-30 20:52:36,463 - lava_callback - DEBUG - Processing node 69c83f8e123b47fd23770c14: baseline-arm-clabbe 2026-03-30 20:52:36,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83f8e123b47fd23770c14 2026-03-30 20:52:36,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:52:36,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83f8e123b47fd23770c14 HTTP/1.1" 200 None 2026-03-30 20:52:36,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:52:36,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:52:36,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:35296 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:52:36,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83f8e123b47fd23770c14 HTTP/1.1" 200 None 2026-03-30 20:52:36,531 - lava_callback - ERROR - Error processing callback for node 69c83f8e123b47fd23770c14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49462 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:53:16,514 - lava_callback - INFO - Received callback for node 69c83fb3123b47fd23770c1d INFO: 172.20.0.1:49468 - "POST /node/69c83fb3123b47fd23770c1d HTTP/1.0" 202 Accepted 2026-03-30 20:53:16,519 - lava_callback - INFO - Starting async job submit for node 69c83fb3123b47fd23770c1d 2026-03-30 20:53:16,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:53:16,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83fb3123b47fd23770c1d HTTP/1.1" 200 None 2026-03-30 20:53:16,536 - lava_callback - DEBUG - Processing node 69c83fb3123b47fd23770c1d: baseline-arm-clabbe 2026-03-30 20:53:16,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83fb3123b47fd23770c1d 2026-03-30 20:53:16,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:53:16,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83fb3123b47fd23770c1d HTTP/1.1" 200 None 2026-03-30 20:53:16,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:53:16,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:53:16,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:53:16,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83fb3123b47fd23770c1d HTTP/1.1" 200 None 2026-03-30 20:53:16,600 - lava_callback - ERROR - Error processing callback for node 69c83fb3123b47fd23770c1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60348 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:53:56,516 - lava_callback - INFO - Received callback for node 69c83fd7123b47fd23770c2b INFO: 172.20.0.1:60360 - "POST /node/69c83fd7123b47fd23770c2b HTTP/1.0" 202 Accepted 2026-03-30 20:53:56,522 - lava_callback - INFO - Starting async job submit for node 69c83fd7123b47fd23770c2b 2026-03-30 20:53:56,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:53:56,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83fd7123b47fd23770c2b HTTP/1.1" 200 None 2026-03-30 20:53:56,537 - lava_callback - DEBUG - Processing node 69c83fd7123b47fd23770c2b: baseline-arm-clabbe 2026-03-30 20:53:56,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83fd7123b47fd23770c2b 2026-03-30 20:53:56,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:53:56,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83fd7123b47fd23770c2b HTTP/1.1" 200 None 2026-03-30 20:53:56,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:53:56,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:53:56,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:53:56,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83fd7123b47fd23770c2b HTTP/1.1" 200 None 2026-03-30 20:53:56,603 - lava_callback - ERROR - Error processing callback for node 69c83fd7123b47fd23770c2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33514 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:54:36,533 - lava_callback - INFO - Received callback for node 69c83ffc123b47fd23770c36 INFO: 172.20.0.1:33530 - "POST /node/69c83ffc123b47fd23770c36 HTTP/1.0" 202 Accepted 2026-03-30 20:54:36,539 - lava_callback - INFO - Starting async job submit for node 69c83ffc123b47fd23770c36 2026-03-30 20:54:36,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:54:36,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83ffc123b47fd23770c36 HTTP/1.1" 200 None 2026-03-30 20:54:36,555 - lava_callback - DEBUG - Processing node 69c83ffc123b47fd23770c36: baseline-arm-clabbe 2026-03-30 20:54:36,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c83ffc123b47fd23770c36 2026-03-30 20:54:36,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:54:36,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c83ffc123b47fd23770c36 HTTP/1.1" 200 None 2026-03-30 20:54:36,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:54:36,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:54:36,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:54:36,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c83ffc123b47fd23770c36 HTTP/1.1" 200 None 2026-03-30 20:54:36,611 - lava_callback - ERROR - Error processing callback for node 69c83ffc123b47fd23770c36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40974 - "GET / HTTP/1.0" 200 OK 2026-03-30 20:55:16,583 - lava_callback - INFO - Received callback for node 69c84020123b47fd23770c42 INFO: 172.20.0.1:40976 - "POST /node/69c84020123b47fd23770c42 HTTP/1.0" 202 Accepted 2026-03-30 20:55:16,588 - lava_callback - INFO - Starting async job submit for node 69c84020123b47fd23770c42 2026-03-30 20:55:16,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:55:16,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84020123b47fd23770c42 HTTP/1.1" 200 None 2026-03-30 20:55:16,604 - lava_callback - DEBUG - Processing node 69c84020123b47fd23770c42: baseline-arm-clabbe 2026-03-30 20:55:16,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84020123b47fd23770c42 2026-03-30 20:55:16,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:55:16,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84020123b47fd23770c42 HTTP/1.1" 200 None 2026-03-30 20:55:16,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:55:16,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-03-30 20:55:16,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 20:55:16,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84020123b47fd23770c42 HTTP/1.1" 200 None 2026-03-30 20:55:16,656 - lava_callback - ERROR - Error processing callback for node 69c84020123b47fd23770c42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54986 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55972 - "GET /node/69981da6e4d71f8580ba2da9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50732 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:08:29,012 - lava_callback - INFO - Received callback for node 69c84338123b47fd23770cd0 INFO: 172.20.0.1:50746 - "POST /node/69c84338123b47fd23770cd0 HTTP/1.0" 202 Accepted 2026-03-30 21:08:29,018 - lava_callback - INFO - Starting async job submit for node 69c84338123b47fd23770cd0 2026-03-30 21:08:29,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:08:29,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84338123b47fd23770cd0 HTTP/1.1" 200 None 2026-03-30 21:08:29,034 - lava_callback - DEBUG - Processing node 69c84338123b47fd23770cd0: baseline-arm64-baylibre 2026-03-30 21:08:29,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84338123b47fd23770cd0 2026-03-30 21:08:29,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:08:29,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84338123b47fd23770cd0 HTTP/1.1" 200 None 2026-03-30 21:08:29,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:08:29,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-03-30 21:08:29,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:08:29,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84338123b47fd23770cd0 HTTP/1.1" 200 None 2026-03-30 21:08:29,089 - lava_callback - ERROR - Error processing callback for node 69c84338123b47fd23770cd0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34352 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:10:49,015 - lava_callback - INFO - Received callback for node 69c843d1123b47fd23770cea INFO: 172.20.0.1:34354 - "POST /node/69c843d1123b47fd23770cea HTTP/1.0" 202 Accepted 2026-03-30 21:10:49,020 - lava_callback - INFO - Starting async job submit for node 69c843d1123b47fd23770cea 2026-03-30 21:10:49,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:10:49,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c843d1123b47fd23770cea HTTP/1.1" 200 None 2026-03-30 21:10:49,037 - lava_callback - DEBUG - Processing node 69c843d1123b47fd23770cea: baseline-arm64-baylibre 2026-03-30 21:10:49,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c843d1123b47fd23770cea 2026-03-30 21:10:49,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:10:49,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c843d1123b47fd23770cea HTTP/1.1" 200 None 2026-03-30 21:10:49,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:10:49,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-03-30 21:10:49,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:10:49,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c843d1123b47fd23770cea HTTP/1.1" 200 None 2026-03-30 21:10:49,089 - lava_callback - ERROR - Error processing callback for node 69c843d1123b47fd23770cea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37864 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:12:57,330 - lava_callback - INFO - Received callback for node 69c84450123b47fd23770cfc INFO: 172.20.0.1:37870 - "POST /node/69c84450123b47fd23770cfc HTTP/1.0" 202 Accepted 2026-03-30 21:12:57,335 - lava_callback - INFO - Starting async job submit for node 69c84450123b47fd23770cfc 2026-03-30 21:12:57,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:12:57,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84450123b47fd23770cfc HTTP/1.1" 200 None 2026-03-30 21:12:57,350 - lava_callback - DEBUG - Processing node 69c84450123b47fd23770cfc: baseline-arm64-clabbe 2026-03-30 21:12:57,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84450123b47fd23770cfc 2026-03-30 21:12:57,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:12:57,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84450123b47fd23770cfc HTTP/1.1" 200 None 2026-03-30 21:12:57,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:12:57,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-03-30 21:12:57,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:12:57,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84450123b47fd23770cfc HTTP/1.1" 200 None 2026-03-30 21:12:57,405 - lava_callback - ERROR - Error processing callback for node 69c84450123b47fd23770cfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59096 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:14:17,407 - lava_callback - INFO - Received callback for node 69c8449e123b47fd23770d13 INFO: 172.20.0.1:59110 - "POST /node/69c8449e123b47fd23770d13 HTTP/1.0" 202 Accepted 2026-03-30 21:14:17,412 - lava_callback - INFO - Starting async job submit for node 69c8449e123b47fd23770d13 2026-03-30 21:14:17,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:14:17,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8449e123b47fd23770d13 HTTP/1.1" 200 None 2026-03-30 21:14:17,442 - lava_callback - DEBUG - Processing node 69c8449e123b47fd23770d13: baseline-arm64-clabbe 2026-03-30 21:14:17,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8449e123b47fd23770d13 2026-03-30 21:14:17,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:14:17,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8449e123b47fd23770d13 HTTP/1.1" 200 None 2026-03-30 21:14:17,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:14:17,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-03-30 21:14:17,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:14:17,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8449e123b47fd23770d13 HTTP/1.1" 200 None 2026-03-30 21:14:17,522 - lava_callback - ERROR - Error processing callback for node 69c8449e123b47fd23770d13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43044 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:15:37,425 - lava_callback - INFO - Received callback for node 69c844ec123b47fd23770d1c INFO: 172.20.0.1:43048 - "POST /node/69c844ec123b47fd23770d1c HTTP/1.0" 202 Accepted 2026-03-30 21:15:37,430 - lava_callback - INFO - Starting async job submit for node 69c844ec123b47fd23770d1c 2026-03-30 21:15:37,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:15:37,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c844ec123b47fd23770d1c HTTP/1.1" 200 None 2026-03-30 21:15:37,446 - lava_callback - DEBUG - Processing node 69c844ec123b47fd23770d1c: baseline-arm64-clabbe 2026-03-30 21:15:37,446 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c844ec123b47fd23770d1c 2026-03-30 21:15:37,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:15:37,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c844ec123b47fd23770d1c HTTP/1.1" 200 None 2026-03-30 21:15:37,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:15:37,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-03-30 21:15:37,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:15:37,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c844ec123b47fd23770d1c HTTP/1.1" 200 None 2026-03-30 21:15:37,506 - lava_callback - ERROR - Error processing callback for node 69c844ec123b47fd23770d1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51450 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:16:57,498 - lava_callback - INFO - Received callback for node 69c84539123b47fd23770d2e INFO: 172.20.0.1:51462 - "POST /node/69c84539123b47fd23770d2e HTTP/1.0" 202 Accepted 2026-03-30 21:16:57,504 - lava_callback - INFO - Starting async job submit for node 69c84539123b47fd23770d2e 2026-03-30 21:16:57,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:16:57,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84539123b47fd23770d2e HTTP/1.1" 200 None 2026-03-30 21:16:57,521 - lava_callback - DEBUG - Processing node 69c84539123b47fd23770d2e: baseline-arm64-clabbe 2026-03-30 21:16:57,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84539123b47fd23770d2e 2026-03-30 21:16:57,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:16:57,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84539123b47fd23770d2e HTTP/1.1" 200 None 2026-03-30 21:16:57,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:16:57,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-03-30 21:16:57,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:16:57,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84539123b47fd23770d2e HTTP/1.1" 200 None 2026-03-30 21:16:57,583 - lava_callback - ERROR - Error processing callback for node 69c84539123b47fd23770d2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40890 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:18:17,583 - lava_callback - INFO - Received callback for node 69c84586123b47fd23770d3d INFO: 172.20.0.1:40906 - "POST /node/69c84586123b47fd23770d3d HTTP/1.0" 202 Accepted 2026-03-30 21:18:17,589 - lava_callback - INFO - Starting async job submit for node 69c84586123b47fd23770d3d 2026-03-30 21:18:17,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:18:17,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84586123b47fd23770d3d HTTP/1.1" 200 None 2026-03-30 21:18:17,607 - lava_callback - DEBUG - Processing node 69c84586123b47fd23770d3d: baseline-arm64-clabbe 2026-03-30 21:18:17,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84586123b47fd23770d3d 2026-03-30 21:18:17,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:18:17,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84586123b47fd23770d3d HTTP/1.1" 200 None 2026-03-30 21:18:17,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:18:17,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-03-30 21:18:17,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:18:17,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84586123b47fd23770d3d HTTP/1.1" 200 None 2026-03-30 21:18:17,668 - lava_callback - ERROR - Error processing callback for node 69c84586123b47fd23770d3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35442 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:19:09,676 - lava_callback - INFO - Received callback for node 69c845c9123b47fd23770d50 INFO: 172.20.0.1:35456 - "POST /node/69c845c9123b47fd23770d50 HTTP/1.0" 202 Accepted 2026-03-30 21:19:09,682 - lava_callback - INFO - Starting async job submit for node 69c845c9123b47fd23770d50 2026-03-30 21:19:09,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:19:09,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c845c9123b47fd23770d50 HTTP/1.1" 200 None 2026-03-30 21:19:09,698 - lava_callback - DEBUG - Processing node 69c845c9123b47fd23770d50: baseline-arm64-baylibre 2026-03-30 21:19:09,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c845c9123b47fd23770d50 2026-03-30 21:19:09,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:19:09,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c845c9123b47fd23770d50 HTTP/1.1" 200 None 2026-03-30 21:19:09,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:19:09,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:19:09,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:19:09,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c845c9123b47fd23770d50 HTTP/1.1" 200 None 2026-03-30 21:19:09,751 - lava_callback - ERROR - Error processing callback for node 69c845c9123b47fd23770d50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46026 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:20:37,636 - lava_callback - INFO - Received callback for node 69c8461e123b47fd23770d5e INFO: 172.20.0.1:46038 - "POST /node/69c8461e123b47fd23770d5e HTTP/1.0" 202 Accepted 2026-03-30 21:20:37,642 - lava_callback - INFO - Starting async job submit for node 69c8461e123b47fd23770d5e 2026-03-30 21:20:37,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:20:37,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8461e123b47fd23770d5e HTTP/1.1" 200 None 2026-03-30 21:20:37,670 - lava_callback - DEBUG - Processing node 69c8461e123b47fd23770d5e: baseline-arm64-clabbe 2026-03-30 21:20:37,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8461e123b47fd23770d5e 2026-03-30 21:20:37,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:20:37,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8461e123b47fd23770d5e HTTP/1.1" 200 None 2026-03-30 21:20:37,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:20:37,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-03-30 21:20:37,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:20:37,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8461e123b47fd23770d5e HTTP/1.1" 200 None 2026-03-30 21:20:37,723 - lava_callback - ERROR - Error processing callback for node 69c8461e123b47fd23770d5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39402 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:21:49,647 - lava_callback - INFO - Received callback for node 69c84662123b47fd23770d70 INFO: 172.20.0.1:39408 - "POST /node/69c84662123b47fd23770d70 HTTP/1.0" 202 Accepted 2026-03-30 21:21:49,654 - lava_callback - INFO - Starting async job submit for node 69c84662123b47fd23770d70 2026-03-30 21:21:49,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:21:49,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84662123b47fd23770d70 HTTP/1.1" 200 None 2026-03-30 21:21:49,672 - lava_callback - DEBUG - Processing node 69c84662123b47fd23770d70: baseline-arm64-baylibre 2026-03-30 21:21:49,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84662123b47fd23770d70 2026-03-30 21:21:49,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:21:49,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84662123b47fd23770d70 HTTP/1.1" 200 None 2026-03-30 21:21:49,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:21:49,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:21:49,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:21:49,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84662123b47fd23770d70 HTTP/1.1" 200 None 2026-03-30 21:21:49,732 - lava_callback - ERROR - Error processing callback for node 69c84662123b47fd23770d70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45618 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:23:49,846 - lava_callback - INFO - Received callback for node 69c846e4123b47fd23770d83 INFO: 172.20.0.1:42204 - "POST /node/69c846e4123b47fd23770d83 HTTP/1.0" 202 Accepted 2026-03-30 21:23:49,852 - lava_callback - INFO - Starting async job submit for node 69c846e4123b47fd23770d83 2026-03-30 21:23:49,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:23:49,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c846e4123b47fd23770d83 HTTP/1.1" 200 None 2026-03-30 21:23:49,875 - lava_callback - DEBUG - Processing node 69c846e4123b47fd23770d83: baseline-arm64-baylibre 2026-03-30 21:23:49,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c846e4123b47fd23770d83 2026-03-30 21:23:49,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:23:49,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c846e4123b47fd23770d83 HTTP/1.1" 200 None 2026-03-30 21:23:49,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:23:49,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:23:49,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:23:49,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c846e4123b47fd23770d83 HTTP/1.1" 200 None 2026-03-30 21:23:49,943 - lava_callback - ERROR - Error processing callback for node 69c846e4123b47fd23770d83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51198 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:25:30,124 - lava_callback - INFO - Received callback for node 69c84735123b47fd23770d97 INFO: 172.20.0.1:36762 - "POST /node/69c84735123b47fd23770d97 HTTP/1.0" 202 Accepted 2026-03-30 21:25:30,130 - lava_callback - INFO - Starting async job submit for node 69c84735123b47fd23770d97 2026-03-30 21:25:30,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:25:30,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84735123b47fd23770d97 HTTP/1.1" 200 None 2026-03-30 21:25:30,145 - lava_callback - DEBUG - Processing node 69c84735123b47fd23770d97: baseline-arm64-baylibre 2026-03-30 21:25:30,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84735123b47fd23770d97 2026-03-30 21:25:30,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:25:30,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84735123b47fd23770d97 HTTP/1.1" 200 None 2026-03-30 21:25:30,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:25:30,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:25:30,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:25:30,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84735123b47fd23770d97 HTTP/1.1" 200 None 2026-03-30 21:25:30,209 - lava_callback - ERROR - Error processing callback for node 69c84735123b47fd23770d97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49322 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:27:09,929 - lava_callback - INFO - Received callback for node 69c8479a123b47fd23770da5 INFO: 172.20.0.1:59872 - "POST /node/69c8479a123b47fd23770da5 HTTP/1.0" 202 Accepted 2026-03-30 21:27:09,935 - lava_callback - INFO - Starting async job submit for node 69c8479a123b47fd23770da5 2026-03-30 21:27:09,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:27:09,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8479a123b47fd23770da5 HTTP/1.1" 200 None 2026-03-30 21:27:09,954 - lava_callback - DEBUG - Processing node 69c8479a123b47fd23770da5: baseline-arm64-baylibre 2026-03-30 21:27:09,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8479a123b47fd23770da5 2026-03-30 21:27:09,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:27:09,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8479a123b47fd23770da5 HTTP/1.1" 200 None 2026-03-30 21:27:09,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:27:09,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:27:09,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:27:10,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8479a123b47fd23770da5 HTTP/1.1" 200 None 2026-03-30 21:27:10,025 - lava_callback - ERROR - Error processing callback for node 69c8479a123b47fd23770da5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58896 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:28:29,962 - lava_callback - INFO - Received callback for node 69c847ea123b47fd23770db9 INFO: 172.20.0.1:57720 - "POST /node/69c847ea123b47fd23770db9 HTTP/1.0" 202 Accepted 2026-03-30 21:28:29,968 - lava_callback - INFO - Starting async job submit for node 69c847ea123b47fd23770db9 2026-03-30 21:28:29,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:28:29,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c847ea123b47fd23770db9 HTTP/1.1" 200 None 2026-03-30 21:28:29,983 - lava_callback - DEBUG - Processing node 69c847ea123b47fd23770db9: baseline-arm64-baylibre 2026-03-30 21:28:29,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c847ea123b47fd23770db9 2026-03-30 21:28:29,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:28:30,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c847ea123b47fd23770db9 HTTP/1.1" 200 None 2026-03-30 21:28:30,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:28:30,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:28:30,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:28:30,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c847ea123b47fd23770db9 HTTP/1.1" 200 None 2026-03-30 21:28:30,049 - lava_callback - ERROR - Error processing callback for node 69c847ea123b47fd23770db9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44670 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:29:57,953 - lava_callback - INFO - Received callback for node 69c84842123b47fd23770dcd INFO: 172.20.0.1:44684 - "POST /node/69c84842123b47fd23770dcd HTTP/1.0" 202 Accepted 2026-03-30 21:29:57,959 - lava_callback - INFO - Starting async job submit for node 69c84842123b47fd23770dcd 2026-03-30 21:29:57,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:29:57,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84842123b47fd23770dcd HTTP/1.1" 200 None 2026-03-30 21:29:57,976 - lava_callback - DEBUG - Processing node 69c84842123b47fd23770dcd: baseline-arm64-clabbe 2026-03-30 21:29:57,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84842123b47fd23770dcd 2026-03-30 21:29:57,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:29:57,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84842123b47fd23770dcd HTTP/1.1" 200 None 2026-03-30 21:29:57,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:29:58,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:29:58,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:29:58,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84842123b47fd23770dcd HTTP/1.1" 200 None 2026-03-30 21:29:58,038 - lava_callback - ERROR - Error processing callback for node 69c84842123b47fd23770dcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48596 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:31:38,050 - lava_callback - INFO - Received callback for node 69c848a6123b47fd23770ddc INFO: 172.20.0.1:48602 - "POST /node/69c848a6123b47fd23770ddc HTTP/1.0" 202 Accepted 2026-03-30 21:31:38,056 - lava_callback - INFO - Starting async job submit for node 69c848a6123b47fd23770ddc 2026-03-30 21:31:38,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:31:38,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c848a6123b47fd23770ddc HTTP/1.1" 200 None 2026-03-30 21:31:38,072 - lava_callback - DEBUG - Processing node 69c848a6123b47fd23770ddc: baseline-arm64-clabbe 2026-03-30 21:31:38,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c848a6123b47fd23770ddc 2026-03-30 21:31:38,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:31:38,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c848a6123b47fd23770ddc HTTP/1.1" 200 None 2026-03-30 21:31:38,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:31:38,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:31:38,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:31:38,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c848a6123b47fd23770ddc HTTP/1.1" 200 None 2026-03-30 21:31:38,131 - lava_callback - ERROR - Error processing callback for node 69c848a6123b47fd23770ddc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36236 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:33:50,397 - lava_callback - INFO - Received callback for node 69c84934123b47fd23770dfe INFO: 172.20.0.1:36962 - "POST /node/69c84934123b47fd23770dfe HTTP/1.0" 202 Accepted 2026-03-30 21:33:50,403 - lava_callback - INFO - Starting async job submit for node 69c84934123b47fd23770dfe 2026-03-30 21:33:50,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:33:50,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84934123b47fd23770dfe HTTP/1.1" 200 None 2026-03-30 21:33:50,427 - lava_callback - DEBUG - Processing node 69c84934123b47fd23770dfe: baseline-arm64-baylibre 2026-03-30 21:33:50,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84934123b47fd23770dfe 2026-03-30 21:33:50,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:33:50,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84934123b47fd23770dfe HTTP/1.1" 200 None 2026-03-30 21:33:50,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:33:50,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:33:50,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:33:50,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84934123b47fd23770dfe HTTP/1.1" 200 None 2026-03-30 21:33:50,480 - lava_callback - ERROR - Error processing callback for node 69c84934123b47fd23770dfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52854 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:35:10,292 - lava_callback - INFO - Received callback for node 69c84982123b47fd23770e0b INFO: 172.20.0.1:55600 - "POST /node/69c84982123b47fd23770e0b HTTP/1.0" 202 Accepted 2026-03-30 21:35:10,298 - lava_callback - INFO - Starting async job submit for node 69c84982123b47fd23770e0b 2026-03-30 21:35:10,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:35:10,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84982123b47fd23770e0b HTTP/1.1" 200 None 2026-03-30 21:35:10,314 - lava_callback - DEBUG - Processing node 69c84982123b47fd23770e0b: baseline-arm64-baylibre 2026-03-30 21:35:10,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84982123b47fd23770e0b 2026-03-30 21:35:10,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:35:10,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84982123b47fd23770e0b HTTP/1.1" 200 None 2026-03-30 21:35:10,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:35:10,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:35:10,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:35:10,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84982123b47fd23770e0b HTTP/1.1" 200 None 2026-03-30 21:35:10,373 - lava_callback - ERROR - Error processing callback for node 69c84982123b47fd23770e0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34132 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:37:58,378 - lava_callback - INFO - Received callback for node 69c84a25123b47fd23770e29 INFO: 172.20.0.1:34142 - "POST /node/69c84a25123b47fd23770e29 HTTP/1.0" 202 Accepted 2026-03-30 21:37:58,383 - lava_callback - INFO - Starting async job submit for node 69c84a25123b47fd23770e29 2026-03-30 21:37:58,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:37:58,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84a25123b47fd23770e29 HTTP/1.1" 200 None 2026-03-30 21:37:58,399 - lava_callback - DEBUG - Processing node 69c84a25123b47fd23770e29: baseline-arm64-clabbe 2026-03-30 21:37:58,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84a25123b47fd23770e29 2026-03-30 21:37:58,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:37:58,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84a25123b47fd23770e29 HTTP/1.1" 200 None 2026-03-30 21:37:58,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:37:58,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:37:58,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:37:58,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84a25123b47fd23770e29 HTTP/1.1" 200 None 2026-03-30 21:37:58,451 - lava_callback - ERROR - Error processing callback for node 69c84a25123b47fd23770e29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59538 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:40:38,417 - lava_callback - INFO - Received callback for node 69c84ac2123b47fd23770e46 INFO: 172.20.0.1:59550 - "POST /node/69c84ac2123b47fd23770e46 HTTP/1.0" 202 Accepted 2026-03-30 21:40:38,422 - lava_callback - INFO - Starting async job submit for node 69c84ac2123b47fd23770e46 2026-03-30 21:40:38,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:40:38,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84ac2123b47fd23770e46 HTTP/1.1" 200 None 2026-03-30 21:40:38,438 - lava_callback - DEBUG - Processing node 69c84ac2123b47fd23770e46: baseline-arm64-clabbe 2026-03-30 21:40:38,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84ac2123b47fd23770e46 2026-03-30 21:40:38,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:40:38,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84ac2123b47fd23770e46 HTTP/1.1" 200 None 2026-03-30 21:40:38,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:40:38,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:40:38,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:40:38,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84ac2123b47fd23770e46 HTTP/1.1" 200 None 2026-03-30 21:40:38,496 - lava_callback - ERROR - Error processing callback for node 69c84ac2123b47fd23770e46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60892 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:41:50,801 - lava_callback - INFO - Received callback for node 69c84b0b123b47fd23770e53 INFO: 172.20.0.1:57518 - "POST /node/69c84b0b123b47fd23770e53 HTTP/1.0" 202 Accepted 2026-03-30 21:41:50,807 - lava_callback - INFO - Starting async job submit for node 69c84b0b123b47fd23770e53 2026-03-30 21:41:50,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:41:50,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84b0b123b47fd23770e53 HTTP/1.1" 200 None 2026-03-30 21:41:50,823 - lava_callback - DEBUG - Processing node 69c84b0b123b47fd23770e53: baseline-arm64-baylibre 2026-03-30 21:41:50,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84b0b123b47fd23770e53 2026-03-30 21:41:50,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:41:50,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84b0b123b47fd23770e53 HTTP/1.1" 200 None 2026-03-30 21:41:50,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:41:50,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:41:50,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:41:50,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84b0b123b47fd23770e53 HTTP/1.1" 200 None 2026-03-30 21:41:50,878 - lava_callback - ERROR - Error processing callback for node 69c84b0b123b47fd23770e53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60316 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:42:58,523 - lava_callback - INFO - Received callback for node 69c84b5f123b47fd23770e66 INFO: 172.20.0.1:60320 - "POST /node/69c84b5f123b47fd23770e66 HTTP/1.0" 202 Accepted 2026-03-30 21:42:58,528 - lava_callback - INFO - Starting async job submit for node 69c84b5f123b47fd23770e66 2026-03-30 21:42:58,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:42:58,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84b5f123b47fd23770e66 HTTP/1.1" 200 None 2026-03-30 21:42:58,554 - lava_callback - DEBUG - Processing node 69c84b5f123b47fd23770e66: baseline-arm64-clabbe 2026-03-30 21:42:58,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84b5f123b47fd23770e66 2026-03-30 21:42:58,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:42:58,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84b5f123b47fd23770e66 HTTP/1.1" 200 None 2026-03-30 21:42:58,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:42:58,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:42:58,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:42:58,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84b5f123b47fd23770e66 HTTP/1.1" 200 None 2026-03-30 21:42:58,615 - lava_callback - ERROR - Error processing callback for node 69c84b5f123b47fd23770e66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38642 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:44:10,813 - lava_callback - INFO - Received callback for node 69c84ba8123b47fd23770e79 INFO: 172.20.0.1:60052 - "POST /node/69c84ba8123b47fd23770e79 HTTP/1.0" 202 Accepted 2026-03-30 21:44:10,819 - lava_callback - INFO - Starting async job submit for node 69c84ba8123b47fd23770e79 2026-03-30 21:44:10,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:44:10,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84ba8123b47fd23770e79 HTTP/1.1" 200 None 2026-03-30 21:44:10,835 - lava_callback - DEBUG - Processing node 69c84ba8123b47fd23770e79: baseline-arm64-baylibre 2026-03-30 21:44:10,835 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84ba8123b47fd23770e79 2026-03-30 21:44:10,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:44:10,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84ba8123b47fd23770e79 HTTP/1.1" 200 None 2026-03-30 21:44:10,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:44:10,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:44:10,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:44:10,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84ba8123b47fd23770e79 HTTP/1.1" 200 None 2026-03-30 21:44:10,889 - lava_callback - ERROR - Error processing callback for node 69c84ba8123b47fd23770e79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52280 - "GET /node/693f253024745582e399c205%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52286 - "GET /node/6983f224969566dcb0d2a7cf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48506 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:46:58,707 - lava_callback - INFO - Received callback for node 69c84c45123b47fd23770e93 INFO: 172.20.0.1:48522 - "POST /node/69c84c45123b47fd23770e93 HTTP/1.0" 202 Accepted 2026-03-30 21:46:58,715 - lava_callback - INFO - Starting async job submit for node 69c84c45123b47fd23770e93 2026-03-30 21:46:58,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:46:58,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84c45123b47fd23770e93 HTTP/1.1" 200 None 2026-03-30 21:46:58,734 - lava_callback - DEBUG - Processing node 69c84c45123b47fd23770e93: baseline-arm64-clabbe 2026-03-30 21:46:58,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84c45123b47fd23770e93 2026-03-30 21:46:58,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:46:58,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84c45123b47fd23770e93 HTTP/1.1" 200 None 2026-03-30 21:46:58,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:46:58,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:46:58,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:46:58,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84c45123b47fd23770e93 HTTP/1.1" 200 None 2026-03-30 21:46:58,792 - lava_callback - ERROR - Error processing callback for node 69c84c45123b47fd23770e93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50340 - "GET /node/69c02896c3d73288b0d08119%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58446 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:48:18,711 - lava_callback - INFO - Received callback for node 69c84c94123b47fd23770ea8 INFO: 172.20.0.1:58454 - "POST /node/69c84c94123b47fd23770ea8 HTTP/1.0" 202 Accepted 2026-03-30 21:48:18,718 - lava_callback - INFO - Starting async job submit for node 69c84c94123b47fd23770ea8 2026-03-30 21:48:18,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:48:18,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84c94123b47fd23770ea8 HTTP/1.1" 200 None 2026-03-30 21:48:18,738 - lava_callback - DEBUG - Processing node 69c84c94123b47fd23770ea8: baseline-arm64-clabbe 2026-03-30 21:48:18,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84c94123b47fd23770ea8 2026-03-30 21:48:18,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:48:18,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84c94123b47fd23770ea8 HTTP/1.1" 200 None 2026-03-30 21:48:18,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:48:18,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:48:18,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:48:18,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84c94123b47fd23770ea8 HTTP/1.1" 200 None 2026-03-30 21:48:18,831 - lava_callback - ERROR - Error processing callback for node 69c84c94123b47fd23770ea8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37322 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:50:31,146 - lava_callback - INFO - Received callback for node 69c84d24123b47fd23770ebb INFO: 172.20.0.1:43726 - "POST /node/69c84d24123b47fd23770ebb HTTP/1.0" 202 Accepted 2026-03-30 21:50:31,152 - lava_callback - INFO - Starting async job submit for node 69c84d24123b47fd23770ebb 2026-03-30 21:50:31,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:50:31,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84d24123b47fd23770ebb HTTP/1.1" 200 None 2026-03-30 21:50:31,182 - lava_callback - DEBUG - Processing node 69c84d24123b47fd23770ebb: baseline-arm64-baylibre 2026-03-30 21:50:31,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84d24123b47fd23770ebb 2026-03-30 21:50:31,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:50:31,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84d24123b47fd23770ebb HTTP/1.1" 200 None 2026-03-30 21:50:31,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:50:31,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:50:31,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:50:31,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84d24123b47fd23770ebb HTTP/1.1" 200 None 2026-03-30 21:50:31,233 - lava_callback - ERROR - Error processing callback for node 69c84d24123b47fd23770ebb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48466 - "GET /node/6985d90971989fb14149a892%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48472 - "GET /node/694ac4b06c96ed51d316f0fb%5Cn HTTP/1.0" 405 Method Not Allowed 2026-03-30 21:51:58,934 - lava_callback - INFO - Received callback for node 69c84d76123b47fd23770ecd INFO: 172.20.0.1:48488 - "POST /node/69c84d76123b47fd23770ecd HTTP/1.0" 202 Accepted 2026-03-30 21:51:58,939 - lava_callback - INFO - Starting async job submit for node 69c84d76123b47fd23770ecd 2026-03-30 21:51:58,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:51:58,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84d76123b47fd23770ecd HTTP/1.1" 200 None 2026-03-30 21:51:58,956 - lava_callback - DEBUG - Processing node 69c84d76123b47fd23770ecd: baseline-arm64-clabbe 2026-03-30 21:51:58,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84d76123b47fd23770ecd 2026-03-30 21:51:58,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:51:58,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84d76123b47fd23770ecd HTTP/1.1" 200 None 2026-03-30 21:51:58,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:51:58,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:51:58,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:51:59,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84d76123b47fd23770ecd HTTP/1.1" 200 None 2026-03-30 21:51:59,025 - lava_callback - ERROR - Error processing callback for node 69c84d76123b47fd23770ecd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53834 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:53:18,935 - lava_callback - INFO - Received callback for node 69c84dc4123b47fd23770ee1 INFO: 172.20.0.1:53850 - "POST /node/69c84dc4123b47fd23770ee1 HTTP/1.0" 202 Accepted 2026-03-30 21:53:18,940 - lava_callback - INFO - Starting async job submit for node 69c84dc4123b47fd23770ee1 2026-03-30 21:53:18,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:53:18,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84dc4123b47fd23770ee1 HTTP/1.1" 200 None 2026-03-30 21:53:18,957 - lava_callback - DEBUG - Processing node 69c84dc4123b47fd23770ee1: baseline-arm64-clabbe 2026-03-30 21:53:18,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84dc4123b47fd23770ee1 2026-03-30 21:53:18,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:53:18,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84dc4123b47fd23770ee1 HTTP/1.1" 200 None 2026-03-30 21:53:18,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:53:18,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:53:18,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:53:19,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84dc4123b47fd23770ee1 HTTP/1.1" 200 None 2026-03-30 21:53:19,016 - lava_callback - ERROR - Error processing callback for node 69c84dc4123b47fd23770ee1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49764 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:55:59,042 - lava_callback - INFO - Received callback for node 69c84e5d123b47fd23770ef6 INFO: 172.20.0.1:49780 - "POST /node/69c84e5d123b47fd23770ef6 HTTP/1.0" 202 Accepted 2026-03-30 21:55:59,048 - lava_callback - INFO - Starting async job submit for node 69c84e5d123b47fd23770ef6 2026-03-30 21:55:59,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:55:59,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84e5d123b47fd23770ef6 HTTP/1.1" 200 None 2026-03-30 21:55:59,063 - lava_callback - DEBUG - Processing node 69c84e5d123b47fd23770ef6: baseline-arm64-clabbe 2026-03-30 21:55:59,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84e5d123b47fd23770ef6 2026-03-30 21:55:59,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:55:59,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84e5d123b47fd23770ef6 HTTP/1.1" 200 None 2026-03-30 21:55:59,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:55:59,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:55:59,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:55:59,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84e5d123b47fd23770ef6 HTTP/1.1" 200 None 2026-03-30 21:55:59,124 - lava_callback - ERROR - Error processing callback for node 69c84e5d123b47fd23770ef6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53310 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:57:11,534 - lava_callback - INFO - Received callback for node 69c84ea2123b47fd23770f01 INFO: 172.20.0.1:46858 - "POST /node/69c84ea2123b47fd23770f01 HTTP/1.0" 202 Accepted 2026-03-30 21:57:11,540 - lava_callback - INFO - Starting async job submit for node 69c84ea2123b47fd23770f01 2026-03-30 21:57:11,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:57:11,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84ea2123b47fd23770f01 HTTP/1.1" 200 None 2026-03-30 21:57:11,556 - lava_callback - DEBUG - Processing node 69c84ea2123b47fd23770f01: baseline-arm64-baylibre 2026-03-30 21:57:11,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84ea2123b47fd23770f01 2026-03-30 21:57:11,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:57:11,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84ea2123b47fd23770f01 HTTP/1.1" 200 None 2026-03-30 21:57:11,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:57:11,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:57:11,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:57:11,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84ea2123b47fd23770f01 HTTP/1.1" 200 None 2026-03-30 21:57:11,621 - lava_callback - ERROR - Error processing callback for node 69c84ea2123b47fd23770f01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36916 - "GET /node/698c5088755d7811a41414da%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33192 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:58:19,201 - lava_callback - INFO - Received callback for node 69c84ef2123b47fd23770f15 INFO: 172.20.0.1:33204 - "POST /node/69c84ef2123b47fd23770f15 HTTP/1.0" 202 Accepted 2026-03-30 21:58:19,207 - lava_callback - INFO - Starting async job submit for node 69c84ef2123b47fd23770f15 2026-03-30 21:58:19,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:58:19,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84ef2123b47fd23770f15 HTTP/1.1" 200 None 2026-03-30 21:58:19,225 - lava_callback - DEBUG - Processing node 69c84ef2123b47fd23770f15: baseline-arm64-clabbe 2026-03-30 21:58:19,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84ef2123b47fd23770f15 2026-03-30 21:58:19,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:58:19,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84ef2123b47fd23770f15 HTTP/1.1" 200 None 2026-03-30 21:58:19,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:58:19,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:58:19,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:58:19,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84ef2123b47fd23770f15 HTTP/1.1" 200 None 2026-03-30 21:58:19,277 - lava_callback - ERROR - Error processing callback for node 69c84ef2123b47fd23770f15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51366 - "GET /node/69bd094405e4bbd6ba635694%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51370 - "GET /node/691111b4699dbc4cda8e820f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52798 - "GET / HTTP/1.0" 200 OK 2026-03-30 21:59:39,254 - lava_callback - INFO - Received callback for node 69c84f3e123b47fd23770f20 INFO: 172.20.0.1:52802 - "POST /node/69c84f3e123b47fd23770f20 HTTP/1.0" 202 Accepted 2026-03-30 21:59:39,262 - lava_callback - INFO - Starting async job submit for node 69c84f3e123b47fd23770f20 2026-03-30 21:59:39,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:59:39,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84f3e123b47fd23770f20 HTTP/1.1" 200 None 2026-03-30 21:59:39,283 - lava_callback - DEBUG - Processing node 69c84f3e123b47fd23770f20: baseline-arm64-clabbe 2026-03-30 21:59:39,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84f3e123b47fd23770f20 2026-03-30 21:59:39,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:59:39,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84f3e123b47fd23770f20 HTTP/1.1" 200 None 2026-03-30 21:59:39,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:59:39,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 21:59:39,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 21:59:39,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84f3e123b47fd23770f20 HTTP/1.1" 200 None 2026-03-30 21:59:39,357 - lava_callback - ERROR - Error processing callback for node 69c84f3e123b47fd23770f20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56984 - "GET /node/69278e7097dccbdf516a6acf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:56996 - "GET /node/6985d6f771989fb14149a714%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45670 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:00:59,326 - lava_callback - INFO - Received callback for node 69c84f8c123b47fd23770f32 INFO: 172.20.0.1:45684 - "POST /node/69c84f8c123b47fd23770f32 HTTP/1.0" 202 Accepted 2026-03-30 22:00:59,332 - lava_callback - INFO - Starting async job submit for node 69c84f8c123b47fd23770f32 2026-03-30 22:00:59,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:00:59,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84f8c123b47fd23770f32 HTTP/1.1" 200 None 2026-03-30 22:00:59,348 - lava_callback - DEBUG - Processing node 69c84f8c123b47fd23770f32: baseline-arm64-clabbe 2026-03-30 22:00:59,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84f8c123b47fd23770f32 2026-03-30 22:00:59,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:00:59,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84f8c123b47fd23770f32 HTTP/1.1" 200 None 2026-03-30 22:00:59,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:00:59,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 22:00:59,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:00:59,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84f8c123b47fd23770f32 HTTP/1.1" 200 None 2026-03-30 22:00:59,400 - lava_callback - ERROR - Error processing callback for node 69c84f8c123b47fd23770f32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53762 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:02:19,381 - lava_callback - INFO - Received callback for node 69c84fd9123b47fd23770f3f INFO: 172.20.0.1:53768 - "POST /node/69c84fd9123b47fd23770f3f HTTP/1.0" 202 Accepted 2026-03-30 22:02:19,386 - lava_callback - INFO - Starting async job submit for node 69c84fd9123b47fd23770f3f 2026-03-30 22:02:19,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:02:19,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84fd9123b47fd23770f3f HTTP/1.1" 200 None 2026-03-30 22:02:19,403 - lava_callback - DEBUG - Processing node 69c84fd9123b47fd23770f3f: baseline-arm64-clabbe 2026-03-30 22:02:19,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c84fd9123b47fd23770f3f 2026-03-30 22:02:19,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:02:19,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c84fd9123b47fd23770f3f HTTP/1.1" 200 None 2026-03-30 22:02:19,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:02:19,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 22:02:19,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:02:19,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c84fd9123b47fd23770f3f HTTP/1.1" 200 None 2026-03-30 22:02:19,455 - lava_callback - ERROR - Error processing callback for node 69c84fd9123b47fd23770f3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52062 - "GET /node/693ae816fee8383e92b65648%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52072 - "GET /node/694aaf5383c67c43d1ede80b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34452 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:03:39,492 - lava_callback - INFO - Received callback for node 69c85027123b47fd23770f50 INFO: 172.20.0.1:34458 - "POST /node/69c85027123b47fd23770f50 HTTP/1.0" 202 Accepted 2026-03-30 22:03:39,497 - lava_callback - INFO - Starting async job submit for node 69c85027123b47fd23770f50 2026-03-30 22:03:39,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:03:39,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85027123b47fd23770f50 HTTP/1.1" 200 None 2026-03-30 22:03:39,522 - lava_callback - DEBUG - Processing node 69c85027123b47fd23770f50: baseline-arm64-clabbe 2026-03-30 22:03:39,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85027123b47fd23770f50 2026-03-30 22:03:39,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:03:39,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85027123b47fd23770f50 HTTP/1.1" 200 None 2026-03-30 22:03:39,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:03:39,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 22:03:39,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:03:39,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85027123b47fd23770f50 HTTP/1.1" 200 None 2026-03-30 22:03:39,578 - lava_callback - ERROR - Error processing callback for node 69c85027123b47fd23770f50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58462 - "GET /node/6929991509677735f68af9eb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58478 - "GET /node/693f02fc24745582e399592f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58364 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:04:39,456 - lava_callback - INFO - Received callback for node 69c85074123b47fd23770f66 INFO: 172.20.0.1:58378 - "POST /node/69c85074123b47fd23770f66 HTTP/1.0" 202 Accepted 2026-03-30 22:04:39,462 - lava_callback - INFO - Starting async job submit for node 69c85074123b47fd23770f66 2026-03-30 22:04:39,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:04:39,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85074123b47fd23770f66 HTTP/1.1" 200 None 2026-03-30 22:04:39,487 - lava_callback - DEBUG - Processing node 69c85074123b47fd23770f66: baseline-arm64-clabbe 2026-03-30 22:04:39,487 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85074123b47fd23770f66 2026-03-30 22:04:39,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:04:39,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85074123b47fd23770f66 HTTP/1.1" 200 None 2026-03-30 22:04:39,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:04:39,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 22:04:39,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:04:39,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85074123b47fd23770f66 HTTP/1.1" 200 None 2026-03-30 22:04:39,549 - lava_callback - ERROR - Error processing callback for node 69c85074123b47fd23770f66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53488 - "GET /node/69a762735a0c0e10c481dcfb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:53504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40474 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:05:59,552 - lava_callback - INFO - Received callback for node 69c850c0123b47fd23770f6f INFO: 172.20.0.1:40478 - "POST /node/69c850c0123b47fd23770f6f HTTP/1.0" 202 Accepted 2026-03-30 22:05:59,560 - lava_callback - INFO - Starting async job submit for node 69c850c0123b47fd23770f6f 2026-03-30 22:05:59,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:05:59,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c850c0123b47fd23770f6f HTTP/1.1" 200 None 2026-03-30 22:05:59,579 - lava_callback - DEBUG - Processing node 69c850c0123b47fd23770f6f: baseline-arm64-clabbe 2026-03-30 22:05:59,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c850c0123b47fd23770f6f 2026-03-30 22:05:59,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:05:59,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c850c0123b47fd23770f6f HTTP/1.1" 200 None 2026-03-30 22:05:59,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:05:59,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 22:05:59,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:05:59,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c850c0123b47fd23770f6f HTTP/1.1" 200 None 2026-03-30 22:05:59,632 - lava_callback - ERROR - Error processing callback for node 69c850c0123b47fd23770f6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47178 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:07:19,574 - lava_callback - INFO - Received callback for node 69c8510c123b47fd23770f84 INFO: 172.20.0.1:47194 - "POST /node/69c8510c123b47fd23770f84 HTTP/1.0" 202 Accepted 2026-03-30 22:07:19,580 - lava_callback - INFO - Starting async job submit for node 69c8510c123b47fd23770f84 2026-03-30 22:07:19,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:07:19,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8510c123b47fd23770f84 HTTP/1.1" 200 None 2026-03-30 22:07:19,597 - lava_callback - DEBUG - Processing node 69c8510c123b47fd23770f84: baseline-arm64-clabbe 2026-03-30 22:07:19,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8510c123b47fd23770f84 2026-03-30 22:07:19,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:07:19,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8510c123b47fd23770f84 HTTP/1.1" 200 None 2026-03-30 22:07:19,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:07:19,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-03-30 22:07:19,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:07:19,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8510c123b47fd23770f84 HTTP/1.1" 200 None 2026-03-30 22:07:19,653 - lava_callback - ERROR - Error processing callback for node 69c8510c123b47fd23770f84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44696 - "GET /node/6993709ccebe99dd8e068ff7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44698 - "GET /node/693e78d93c8f1be6d3cf05fc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42090 - "GET /node/69903652985e4efca431cb80%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42106 - "GET /node/6949e6eb2060d3d84791d125%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51086 - "GET /node/698a8238d9a1cfa777a235d6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51096 - "GET /node/693b7b3241fb4c9509762d0c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:57950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52244 - "GET /node/6940b6d21e3c24e95681b056%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39760 - "GET /node/698a2b0e22b4cc0f227afca0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39774 - "GET /node/6992e36631166481c8dd6a53%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42808 - "GET /node/6991163785f550420785e3d8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42810 - "GET /node/693f95150d8ce4018da97e03%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51038 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:44:21,404 - lava_callback - INFO - Received callback for node 69c859b9123b47fd23770fe6 INFO: 172.20.0.1:35746 - "POST /node/69c859b9123b47fd23770fe6 HTTP/1.0" 202 Accepted 2026-03-30 22:44:21,410 - lava_callback - INFO - Starting async job submit for node 69c859b9123b47fd23770fe6 2026-03-30 22:44:21,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:44:21,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c859b9123b47fd23770fe6 HTTP/1.1" 200 None 2026-03-30 22:44:21,426 - lava_callback - DEBUG - Processing node 69c859b9123b47fd23770fe6: baseline-arm-clabbe 2026-03-30 22:44:21,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c859b9123b47fd23770fe6 2026-03-30 22:44:21,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:44:21,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c859b9123b47fd23770fe6 HTTP/1.1" 200 None 2026-03-30 22:44:21,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:44:21,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-30 22:44:21,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:44:21,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c859b9123b47fd23770fe6 HTTP/1.1" 200 None 2026-03-30 22:44:21,478 - lava_callback - ERROR - Error processing callback for node 69c859b9123b47fd23770fe6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33662 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:45:01,084 - lava_callback - INFO - Received callback for node 69c859de123b47fd23770fed INFO: 172.20.0.1:34834 - "POST /node/69c859de123b47fd23770fed HTTP/1.0" 202 Accepted 2026-03-30 22:45:01,089 - lava_callback - INFO - Starting async job submit for node 69c859de123b47fd23770fed 2026-03-30 22:45:01,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:45:01,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c859de123b47fd23770fed HTTP/1.1" 200 None 2026-03-30 22:45:01,111 - lava_callback - DEBUG - Processing node 69c859de123b47fd23770fed: baseline-arm-clabbe 2026-03-30 22:45:01,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c859de123b47fd23770fed 2026-03-30 22:45:01,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:45:01,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c859de123b47fd23770fed HTTP/1.1" 200 None 2026-03-30 22:45:01,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:45:01,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-30 22:45:01,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:45:01,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c859de123b47fd23770fed HTTP/1.1" 200 None 2026-03-30 22:45:01,185 - lava_callback - ERROR - Error processing callback for node 69c859de123b47fd23770fed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46256 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:45:41,166 - lava_callback - INFO - Received callback for node 69c85a03123b47fd23770ff6 INFO: 172.20.0.1:40066 - "POST /node/69c85a03123b47fd23770ff6 HTTP/1.0" 202 Accepted 2026-03-30 22:45:41,171 - lava_callback - INFO - Starting async job submit for node 69c85a03123b47fd23770ff6 2026-03-30 22:45:41,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:45:41,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85a03123b47fd23770ff6 HTTP/1.1" 200 None 2026-03-30 22:45:41,187 - lava_callback - DEBUG - Processing node 69c85a03123b47fd23770ff6: baseline-arm-clabbe 2026-03-30 22:45:41,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85a03123b47fd23770ff6 2026-03-30 22:45:41,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:45:41,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85a03123b47fd23770ff6 HTTP/1.1" 200 None 2026-03-30 22:45:41,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:45:41,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-30 22:45:41,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:45:41,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85a03123b47fd23770ff6 HTTP/1.1" 200 None 2026-03-30 22:45:41,253 - lava_callback - ERROR - Error processing callback for node 69c85a03123b47fd23770ff6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47940 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:46:21,122 - lava_callback - INFO - Received callback for node 69c85a27123b47fd23771001 INFO: 172.20.0.1:42044 - "POST /node/69c85a27123b47fd23771001 HTTP/1.0" 202 Accepted 2026-03-30 22:46:21,127 - lava_callback - INFO - Starting async job submit for node 69c85a27123b47fd23771001 2026-03-30 22:46:21,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:46:21,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85a27123b47fd23771001 HTTP/1.1" 200 None 2026-03-30 22:46:21,144 - lava_callback - DEBUG - Processing node 69c85a27123b47fd23771001: baseline-arm-clabbe 2026-03-30 22:46:21,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85a27123b47fd23771001 2026-03-30 22:46:21,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:46:21,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85a27123b47fd23771001 HTTP/1.1" 200 None 2026-03-30 22:46:21,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:46:21,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-30 22:46:21,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:46:21,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85a27123b47fd23771001 HTTP/1.1" 200 None 2026-03-30 22:46:21,203 - lava_callback - ERROR - Error processing callback for node 69c85a27123b47fd23771001: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38552 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:46:41,156 - lava_callback - INFO - Received callback for node 69c85a4b123b47fd2377100c INFO: 172.20.0.1:47072 - "POST /node/69c85a4b123b47fd2377100c HTTP/1.0" 202 Accepted 2026-03-30 22:46:41,162 - lava_callback - INFO - Starting async job submit for node 69c85a4b123b47fd2377100c 2026-03-30 22:46:41,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:46:41,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85a4b123b47fd2377100c HTTP/1.1" 200 None 2026-03-30 22:46:41,189 - lava_callback - DEBUG - Processing node 69c85a4b123b47fd2377100c: baseline-arm-clabbe 2026-03-30 22:46:41,189 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85a4b123b47fd2377100c 2026-03-30 22:46:41,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:46:41,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85a4b123b47fd2377100c HTTP/1.1" 200 None 2026-03-30 22:46:41,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:46:41,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff43123b47fd2376d74b HTTP/1.1" 200 None 2026-03-30 22:46:41,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:46:41,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85a4b123b47fd2377100c HTTP/1.1" 200 None 2026-03-30 22:46:41,259 - lava_callback - ERROR - Error processing callback for node 69c85a4b123b47fd2377100c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59332 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:47:14,379 - lava_callback - INFO - Received callback for node 69c85a6a123b47fd23771013 INFO: 172.20.0.1:52712 - "POST /node/69c85a6a123b47fd23771013 HTTP/1.0" 202 Accepted 2026-03-30 22:47:14,384 - lava_callback - INFO - Starting async job submit for node 69c85a6a123b47fd23771013 2026-03-30 22:47:14,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:47:14,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85a6a123b47fd23771013 HTTP/1.1" 200 None 2026-03-30 22:47:14,404 - lava_callback - DEBUG - Processing node 69c85a6a123b47fd23771013: baseline-arm-baylibre 2026-03-30 22:47:14,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85a6a123b47fd23771013 2026-03-30 22:47:14,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:47:14,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85a6a123b47fd23771013 HTTP/1.1" 200 None 2026-03-30 22:47:14,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:47:14,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:47:14,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:47:14,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85a6a123b47fd23771013 HTTP/1.1" 200 None 2026-03-30 22:47:14,457 - lava_callback - ERROR - Error processing callback for node 69c85a6a123b47fd23771013: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47614 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:47:54,182 - lava_callback - INFO - Received callback for node 69c85a8e123b47fd23771020 INFO: 172.20.0.1:43214 - "POST /node/69c85a8e123b47fd23771020 HTTP/1.0" 202 Accepted 2026-03-30 22:47:54,187 - lava_callback - INFO - Starting async job submit for node 69c85a8e123b47fd23771020 2026-03-30 22:47:54,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:47:54,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85a8e123b47fd23771020 HTTP/1.1" 200 None 2026-03-30 22:47:54,203 - lava_callback - DEBUG - Processing node 69c85a8e123b47fd23771020: baseline-arm-baylibre 2026-03-30 22:47:54,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85a8e123b47fd23771020 2026-03-30 22:47:54,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:47:54,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85a8e123b47fd23771020 HTTP/1.1" 200 None 2026-03-30 22:47:54,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:47:54,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:47:54,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:47:54,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85a8e123b47fd23771020 HTTP/1.1" 200 None 2026-03-30 22:47:54,256 - lava_callback - ERROR - Error processing callback for node 69c85a8e123b47fd23771020: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56872 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:48:34,288 - lava_callback - INFO - Received callback for node 69c85ab2123b47fd2377102c INFO: 172.20.0.1:43172 - "POST /node/69c85ab2123b47fd2377102c HTTP/1.0" 202 Accepted 2026-03-30 22:48:34,294 - lava_callback - INFO - Starting async job submit for node 69c85ab2123b47fd2377102c 2026-03-30 22:48:34,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:48:34,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85ab2123b47fd2377102c HTTP/1.1" 200 None 2026-03-30 22:48:34,311 - lava_callback - DEBUG - Processing node 69c85ab2123b47fd2377102c: baseline-arm-baylibre 2026-03-30 22:48:34,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85ab2123b47fd2377102c 2026-03-30 22:48:34,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:48:34,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85ab2123b47fd2377102c HTTP/1.1" 200 None 2026-03-30 22:48:34,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:48:34,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:48:34,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:48:34,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85ab2123b47fd2377102c HTTP/1.1" 200 None 2026-03-30 22:48:34,372 - lava_callback - ERROR - Error processing callback for node 69c85ab2123b47fd2377102c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38138 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:49:14,280 - lava_callback - INFO - Received callback for node 69c85ad5123b47fd23771039 INFO: 172.20.0.1:41020 - "POST /node/69c85ad5123b47fd23771039 HTTP/1.0" 202 Accepted 2026-03-30 22:49:14,285 - lava_callback - INFO - Starting async job submit for node 69c85ad5123b47fd23771039 2026-03-30 22:49:14,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:49:14,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85ad5123b47fd23771039 HTTP/1.1" 200 None 2026-03-30 22:49:14,303 - lava_callback - DEBUG - Processing node 69c85ad5123b47fd23771039: baseline-arm-baylibre 2026-03-30 22:49:14,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85ad5123b47fd23771039 2026-03-30 22:49:14,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:49:14,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85ad5123b47fd23771039 HTTP/1.1" 200 None 2026-03-30 22:49:14,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:49:14,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:49:14,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:49:14,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85ad5123b47fd23771039 HTTP/1.1" 200 None 2026-03-30 22:49:14,357 - lava_callback - ERROR - Error processing callback for node 69c85ad5123b47fd23771039: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38742 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:49:34,276 - lava_callback - INFO - Received callback for node 69c85af7123b47fd23771045 INFO: 172.20.0.1:56886 - "POST /node/69c85af7123b47fd23771045 HTTP/1.0" 202 Accepted 2026-03-30 22:49:34,282 - lava_callback - INFO - Starting async job submit for node 69c85af7123b47fd23771045 2026-03-30 22:49:34,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:49:34,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85af7123b47fd23771045 HTTP/1.1" 200 None 2026-03-30 22:49:34,299 - lava_callback - DEBUG - Processing node 69c85af7123b47fd23771045: baseline-arm-baylibre 2026-03-30 22:49:34,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85af7123b47fd23771045 2026-03-30 22:49:34,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:49:34,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85af7123b47fd23771045 HTTP/1.1" 200 None 2026-03-30 22:49:34,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:49:34,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:49:34,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:49:34,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85af7123b47fd23771045 HTTP/1.1" 200 None 2026-03-30 22:49:34,354 - lava_callback - ERROR - Error processing callback for node 69c85af7123b47fd23771045: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39174 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:50:14,517 - lava_callback - INFO - Received callback for node 69c85b1c123b47fd23771056 INFO: 172.20.0.1:36592 - "POST /node/69c85b1c123b47fd23771056 HTTP/1.0" 202 Accepted 2026-03-30 22:50:14,523 - lava_callback - INFO - Starting async job submit for node 69c85b1c123b47fd23771056 2026-03-30 22:50:14,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:50:14,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85b1c123b47fd23771056 HTTP/1.1" 200 None 2026-03-30 22:50:14,539 - lava_callback - DEBUG - Processing node 69c85b1c123b47fd23771056: baseline-arm-baylibre 2026-03-30 22:50:14,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85b1c123b47fd23771056 2026-03-30 22:50:14,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:50:14,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85b1c123b47fd23771056 HTTP/1.1" 200 None 2026-03-30 22:50:14,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:50:14,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:50:14,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:50:14,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85b1c123b47fd23771056 HTTP/1.1" 200 None 2026-03-30 22:50:14,596 - lava_callback - ERROR - Error processing callback for node 69c85b1c123b47fd23771056: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35146 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:50:54,344 - lava_callback - INFO - Received callback for node 69c85b3f123b47fd23771063 INFO: 172.20.0.1:49194 - "POST /node/69c85b3f123b47fd23771063 HTTP/1.0" 202 Accepted 2026-03-30 22:50:54,352 - lava_callback - INFO - Starting async job submit for node 69c85b3f123b47fd23771063 2026-03-30 22:50:54,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:50:54,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85b3f123b47fd23771063 HTTP/1.1" 200 None 2026-03-30 22:50:54,369 - lava_callback - DEBUG - Processing node 69c85b3f123b47fd23771063: baseline-arm-baylibre 2026-03-30 22:50:54,369 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85b3f123b47fd23771063 2026-03-30 22:50:54,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:50:54,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85b3f123b47fd23771063 HTTP/1.1" 200 None 2026-03-30 22:50:54,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:50:54,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:50:54,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:50:54,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85b3f123b47fd23771063 HTTP/1.1" 200 None 2026-03-30 22:50:54,547 - lava_callback - ERROR - Error processing callback for node 69c85b3f123b47fd23771063: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42932 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:51:34,431 - lava_callback - INFO - Received callback for node 69c85b64123b47fd23771071 INFO: 172.20.0.1:53684 - "POST /node/69c85b64123b47fd23771071 HTTP/1.0" 202 Accepted 2026-03-30 22:51:34,437 - lava_callback - INFO - Starting async job submit for node 69c85b64123b47fd23771071 2026-03-30 22:51:34,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:51:34,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85b64123b47fd23771071 HTTP/1.1" 200 None 2026-03-30 22:51:34,491 - lava_callback - DEBUG - Processing node 69c85b64123b47fd23771071: baseline-arm-baylibre 2026-03-30 22:51:34,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85b64123b47fd23771071 2026-03-30 22:51:34,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:51:34,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85b64123b47fd23771071 HTTP/1.1" 200 None 2026-03-30 22:51:34,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:51:34,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:51:34,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:51:34,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85b64123b47fd23771071 HTTP/1.1" 200 None 2026-03-30 22:51:34,543 - lava_callback - ERROR - Error processing callback for node 69c85b64123b47fd23771071: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35736 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:51:54,373 - lava_callback - INFO - Received callback for node 69c85b87123b47fd2377107e INFO: 172.20.0.1:51284 - "POST /node/69c85b87123b47fd2377107e HTTP/1.0" 202 Accepted 2026-03-30 22:51:54,378 - lava_callback - INFO - Starting async job submit for node 69c85b87123b47fd2377107e 2026-03-30 22:51:54,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:51:54,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85b87123b47fd2377107e HTTP/1.1" 200 None 2026-03-30 22:51:54,407 - lava_callback - DEBUG - Processing node 69c85b87123b47fd2377107e: baseline-arm-baylibre 2026-03-30 22:51:54,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85b87123b47fd2377107e 2026-03-30 22:51:54,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:51:54,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85b87123b47fd2377107e HTTP/1.1" 200 None 2026-03-30 22:51:54,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:51:54,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:51:54,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:51:54,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85b87123b47fd2377107e HTTP/1.1" 200 None 2026-03-30 22:51:54,467 - lava_callback - ERROR - Error processing callback for node 69c85b87123b47fd2377107e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48360 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:52:34,529 - lava_callback - INFO - Received callback for node 69c85ba7123b47fd23771091 INFO: 172.20.0.1:58960 - "POST /node/69c85ba7123b47fd23771091 HTTP/1.0" 202 Accepted 2026-03-30 22:52:34,538 - lava_callback - INFO - Starting async job submit for node 69c85ba7123b47fd23771091 2026-03-30 22:52:34,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:52:34,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85ba7123b47fd23771091 HTTP/1.1" 200 None 2026-03-30 22:52:34,555 - lava_callback - DEBUG - Processing node 69c85ba7123b47fd23771091: baseline-arm-baylibre 2026-03-30 22:52:34,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85ba7123b47fd23771091 2026-03-30 22:52:34,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:52:34,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85ba7123b47fd23771091 HTTP/1.1" 200 None 2026-03-30 22:52:34,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:52:34,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:52:34,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:52:34,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85ba7123b47fd23771091 HTTP/1.1" 200 None 2026-03-30 22:52:34,612 - lava_callback - ERROR - Error processing callback for node 69c85ba7123b47fd23771091: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48700 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:53:14,599 - lava_callback - INFO - Received callback for node 69c85bcc123b47fd237710b7 INFO: 172.20.0.1:45708 - "POST /node/69c85bcc123b47fd237710b7 HTTP/1.0" 202 Accepted 2026-03-30 22:53:14,605 - lava_callback - INFO - Starting async job submit for node 69c85bcc123b47fd237710b7 2026-03-30 22:53:14,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:53:14,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85bcc123b47fd237710b7 HTTP/1.1" 200 None 2026-03-30 22:53:14,621 - lava_callback - DEBUG - Processing node 69c85bcc123b47fd237710b7: baseline-arm-baylibre 2026-03-30 22:53:14,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85bcc123b47fd237710b7 2026-03-30 22:53:14,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:53:14,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85bcc123b47fd237710b7 HTTP/1.1" 200 None 2026-03-30 22:53:14,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:53:14,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:53:14,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:53:14,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85bcc123b47fd237710b7 HTTP/1.1" 200 None 2026-03-30 22:53:14,688 - lava_callback - ERROR - Error processing callback for node 69c85bcc123b47fd237710b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38802 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:53:54,480 - lava_callback - INFO - Received callback for node 69c85bf1123b47fd237710d8 INFO: 172.20.0.1:57910 - "POST /node/69c85bf1123b47fd237710d8 HTTP/1.0" 202 Accepted 2026-03-30 22:53:54,485 - lava_callback - INFO - Starting async job submit for node 69c85bf1123b47fd237710d8 2026-03-30 22:53:54,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:53:54,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85bf1123b47fd237710d8 HTTP/1.1" 200 None 2026-03-30 22:53:54,502 - lava_callback - DEBUG - Processing node 69c85bf1123b47fd237710d8: baseline-arm-baylibre 2026-03-30 22:53:54,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85bf1123b47fd237710d8 2026-03-30 22:53:54,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:53:54,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85bf1123b47fd237710d8 HTTP/1.1" 200 None 2026-03-30 22:53:54,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:53:54,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:53:54,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:53:54,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85bf1123b47fd237710d8 HTTP/1.1" 200 None 2026-03-30 22:53:54,554 - lava_callback - ERROR - Error processing callback for node 69c85bf1123b47fd237710d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58004 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:54:14,503 - lava_callback - INFO - Received callback for node 69c85c13123b47fd237710f3 INFO: 172.20.0.1:50450 - "POST /node/69c85c13123b47fd237710f3 HTTP/1.0" 202 Accepted 2026-03-30 22:54:14,509 - lava_callback - INFO - Starting async job submit for node 69c85c13123b47fd237710f3 2026-03-30 22:54:14,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:54:14,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85c13123b47fd237710f3 HTTP/1.1" 200 None 2026-03-30 22:54:14,525 - lava_callback - DEBUG - Processing node 69c85c13123b47fd237710f3: baseline-arm-baylibre 2026-03-30 22:54:14,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85c13123b47fd237710f3 2026-03-30 22:54:14,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:54:14,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85c13123b47fd237710f3 HTTP/1.1" 200 None 2026-03-30 22:54:14,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:54:14,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:54:14,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:54:14,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85c13123b47fd237710f3 HTTP/1.1" 200 None 2026-03-30 22:54:14,576 - lava_callback - ERROR - Error processing callback for node 69c85c13123b47fd237710f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47092 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:55:01,506 - lava_callback - INFO - Received callback for node 69c85c3a123b47fd23771102 INFO: 172.20.0.1:42948 - "POST /node/69c85c3a123b47fd23771102 HTTP/1.0" 202 Accepted 2026-03-30 22:55:01,511 - lava_callback - INFO - Starting async job submit for node 69c85c3a123b47fd23771102 2026-03-30 22:55:01,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:55:01,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85c3a123b47fd23771102 HTTP/1.1" 200 None 2026-03-30 22:55:01,529 - lava_callback - DEBUG - Processing node 69c85c3a123b47fd23771102: baseline-arm-clabbe 2026-03-30 22:55:01,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85c3a123b47fd23771102 2026-03-30 22:55:01,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:55:01,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85c3a123b47fd23771102 HTTP/1.1" 200 None 2026-03-30 22:55:01,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:55:01,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:55:01,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:55:01,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85c3a123b47fd23771102 HTTP/1.1" 200 None 2026-03-30 22:55:01,612 - lava_callback - ERROR - Error processing callback for node 69c85c3a123b47fd23771102: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49212 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:55:41,571 - lava_callback - INFO - Received callback for node 69c85c5e123b47fd2377110e INFO: 172.20.0.1:36906 - "POST /node/69c85c5e123b47fd2377110e HTTP/1.0" 202 Accepted 2026-03-30 22:55:41,576 - lava_callback - INFO - Starting async job submit for node 69c85c5e123b47fd2377110e 2026-03-30 22:55:41,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:55:41,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85c5e123b47fd2377110e HTTP/1.1" 200 None 2026-03-30 22:55:41,600 - lava_callback - DEBUG - Processing node 69c85c5e123b47fd2377110e: baseline-arm-clabbe 2026-03-30 22:55:41,600 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85c5e123b47fd2377110e 2026-03-30 22:55:41,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:55:41,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85c5e123b47fd2377110e HTTP/1.1" 200 None 2026-03-30 22:55:41,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:55:41,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 22:55:41,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:55:41,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85c5e123b47fd2377110e HTTP/1.1" 200 None 2026-03-30 22:55:41,655 - lava_callback - ERROR - Error processing callback for node 69c85c5e123b47fd2377110e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57850 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:56:14,689 - lava_callback - INFO - Received callback for node 69c85c89123b47fd2377111e INFO: 172.20.0.1:41298 - "POST /node/69c85c89123b47fd2377111e HTTP/1.0" 202 Accepted 2026-03-30 22:56:14,695 - lava_callback - INFO - Starting async job submit for node 69c85c89123b47fd2377111e 2026-03-30 22:56:14,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:56:14,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85c89123b47fd2377111e HTTP/1.1" 200 None 2026-03-30 22:56:14,712 - lava_callback - DEBUG - Processing node 69c85c89123b47fd2377111e: baseline-arm64-baylibre 2026-03-30 22:56:14,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85c89123b47fd2377111e 2026-03-30 22:56:14,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:56:14,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85c89123b47fd2377111e HTTP/1.1" 200 None 2026-03-30 22:56:14,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:56:14,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-30 22:56:14,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:56:14,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85c89123b47fd2377111e HTTP/1.1" 200 None 2026-03-30 22:56:14,772 - lava_callback - ERROR - Error processing callback for node 69c85c89123b47fd2377111e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54048 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:57:34,759 - lava_callback - INFO - Received callback for node 69c85cd3123b47fd2377112a INFO: 172.20.0.1:45024 - "POST /node/69c85cd3123b47fd2377112a HTTP/1.0" 202 Accepted 2026-03-30 22:57:34,765 - lava_callback - INFO - Starting async job submit for node 69c85cd3123b47fd2377112a 2026-03-30 22:57:34,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:57:34,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85cd3123b47fd2377112a HTTP/1.1" 200 None 2026-03-30 22:57:34,783 - lava_callback - DEBUG - Processing node 69c85cd3123b47fd2377112a: baseline-arm64-baylibre 2026-03-30 22:57:34,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85cd3123b47fd2377112a 2026-03-30 22:57:34,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:57:34,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85cd3123b47fd2377112a HTTP/1.1" 200 None 2026-03-30 22:57:34,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:57:34,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-30 22:57:34,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:57:34,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85cd3123b47fd2377112a HTTP/1.1" 200 None 2026-03-30 22:57:34,850 - lava_callback - ERROR - Error processing callback for node 69c85cd3123b47fd2377112a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56470 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:58:54,785 - lava_callback - INFO - Received callback for node 69c85d1f123b47fd23771141 INFO: 172.20.0.1:51790 - "POST /node/69c85d1f123b47fd23771141 HTTP/1.0" 202 Accepted 2026-03-30 22:58:54,790 - lava_callback - INFO - Starting async job submit for node 69c85d1f123b47fd23771141 2026-03-30 22:58:54,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:58:54,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85d1f123b47fd23771141 HTTP/1.1" 200 None 2026-03-30 22:58:54,805 - lava_callback - DEBUG - Processing node 69c85d1f123b47fd23771141: baseline-arm64-baylibre 2026-03-30 22:58:54,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85d1f123b47fd23771141 2026-03-30 22:58:54,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:58:54,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85d1f123b47fd23771141 HTTP/1.1" 200 None 2026-03-30 22:58:54,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:58:54,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-30 22:58:54,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:58:54,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85d1f123b47fd23771141 HTTP/1.1" 200 None 2026-03-30 22:58:54,860 - lava_callback - ERROR - Error processing callback for node 69c85d1f123b47fd23771141: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49162 - "GET / HTTP/1.0" 200 OK 2026-03-30 22:59:54,788 - lava_callback - INFO - Received callback for node 69c85d66123b47fd23771150 INFO: 172.20.0.1:52366 - "POST /node/69c85d66123b47fd23771150 HTTP/1.0" 202 Accepted 2026-03-30 22:59:54,794 - lava_callback - INFO - Starting async job submit for node 69c85d66123b47fd23771150 2026-03-30 22:59:54,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:59:54,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85d66123b47fd23771150 HTTP/1.1" 200 None 2026-03-30 22:59:54,813 - lava_callback - DEBUG - Processing node 69c85d66123b47fd23771150: baseline-arm64-baylibre 2026-03-30 22:59:54,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85d66123b47fd23771150 2026-03-30 22:59:54,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:59:54,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85d66123b47fd23771150 HTTP/1.1" 200 None 2026-03-30 22:59:54,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:59:54,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-30 22:59:54,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 22:59:54,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85d66123b47fd23771150 HTTP/1.1" 200 None 2026-03-30 22:59:54,867 - lava_callback - ERROR - Error processing callback for node 69c85d66123b47fd23771150: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52912 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:01:14,938 - lava_callback - INFO - Received callback for node 69c85da8123b47fd23771162 INFO: 172.20.0.1:60456 - "POST /node/69c85da8123b47fd23771162 HTTP/1.0" 202 Accepted 2026-03-30 23:01:14,943 - lava_callback - INFO - Starting async job submit for node 69c85da8123b47fd23771162 2026-03-30 23:01:14,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:01:14,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85da8123b47fd23771162 HTTP/1.1" 200 None 2026-03-30 23:01:14,959 - lava_callback - DEBUG - Processing node 69c85da8123b47fd23771162: baseline-arm-baylibre 2026-03-30 23:01:14,960 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85da8123b47fd23771162 2026-03-30 23:01:14,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:01:14,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85da8123b47fd23771162 HTTP/1.1" 200 None 2026-03-30 23:01:14,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:01:14,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:01:14,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:01:15,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85da8123b47fd23771162 HTTP/1.1" 200 None 2026-03-30 23:01:15,016 - lava_callback - ERROR - Error processing callback for node 69c85da8123b47fd23771162: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55492 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:07:02,128 - lava_callback - INFO - Received callback for node 69c85f07123b47fd237711c6 INFO: 172.20.0.1:49382 - "POST /node/69c85f07123b47fd237711c6 HTTP/1.0" 202 Accepted 2026-03-30 23:07:02,134 - lava_callback - INFO - Starting async job submit for node 69c85f07123b47fd237711c6 2026-03-30 23:07:02,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:07:02,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85f07123b47fd237711c6 HTTP/1.1" 200 None 2026-03-30 23:07:02,149 - lava_callback - DEBUG - Processing node 69c85f07123b47fd237711c6: baseline-arm64-clabbe 2026-03-30 23:07:02,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85f07123b47fd237711c6 2026-03-30 23:07:02,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:07:02,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85f07123b47fd237711c6 HTTP/1.1" 200 None 2026-03-30 23:07:02,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:07:02,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-30 23:07:02,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:07:02,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85f07123b47fd237711c6 HTTP/1.1" 200 None 2026-03-30 23:07:02,205 - lava_callback - ERROR - Error processing callback for node 69c85f07123b47fd237711c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46108 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:08:22,204 - lava_callback - INFO - Received callback for node 69c85f52123b47fd237711d0 INFO: 172.20.0.1:53486 - "POST /node/69c85f52123b47fd237711d0 HTTP/1.0" 202 Accepted 2026-03-30 23:08:22,210 - lava_callback - INFO - Starting async job submit for node 69c85f52123b47fd237711d0 2026-03-30 23:08:22,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:08:22,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85f52123b47fd237711d0 HTTP/1.1" 200 None 2026-03-30 23:08:22,226 - lava_callback - DEBUG - Processing node 69c85f52123b47fd237711d0: baseline-arm64-clabbe 2026-03-30 23:08:22,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85f52123b47fd237711d0 2026-03-30 23:08:22,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:08:22,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85f52123b47fd237711d0 HTTP/1.1" 200 None 2026-03-30 23:08:22,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:08:22,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-30 23:08:22,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:08:22,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85f52123b47fd237711d0 HTTP/1.1" 200 None 2026-03-30 23:08:22,289 - lava_callback - ERROR - Error processing callback for node 69c85f52123b47fd237711d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43188 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:09:22,186 - lava_callback - INFO - Received callback for node 69c85f9f123b47fd237711df INFO: 172.20.0.1:59608 - "POST /node/69c85f9f123b47fd237711df HTTP/1.0" 202 Accepted 2026-03-30 23:09:22,192 - lava_callback - INFO - Starting async job submit for node 69c85f9f123b47fd237711df 2026-03-30 23:09:22,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:09:22,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85f9f123b47fd237711df HTTP/1.1" 200 None 2026-03-30 23:09:22,207 - lava_callback - DEBUG - Processing node 69c85f9f123b47fd237711df: baseline-arm64-clabbe 2026-03-30 23:09:22,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85f9f123b47fd237711df 2026-03-30 23:09:22,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:09:22,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85f9f123b47fd237711df HTTP/1.1" 200 None 2026-03-30 23:09:22,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:09:22,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-30 23:09:22,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:09:22,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85f9f123b47fd237711df HTTP/1.1" 200 None 2026-03-30 23:09:22,268 - lava_callback - ERROR - Error processing callback for node 69c85f9f123b47fd237711df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47080 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:10:42,222 - lava_callback - INFO - Received callback for node 69c85fea123b47fd237711f0 INFO: 172.20.0.1:52448 - "POST /node/69c85fea123b47fd237711f0 HTTP/1.0" 202 Accepted 2026-03-30 23:10:42,227 - lava_callback - INFO - Starting async job submit for node 69c85fea123b47fd237711f0 2026-03-30 23:10:42,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:10:42,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85fea123b47fd237711f0 HTTP/1.1" 200 None 2026-03-30 23:10:42,244 - lava_callback - DEBUG - Processing node 69c85fea123b47fd237711f0: baseline-arm64-clabbe 2026-03-30 23:10:42,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c85fea123b47fd237711f0 2026-03-30 23:10:42,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:10:42,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c85fea123b47fd237711f0 HTTP/1.1" 200 None 2026-03-30 23:10:42,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:10:42,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-30 23:10:42,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:10:42,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c85fea123b47fd237711f0 HTTP/1.1" 200 None 2026-03-30 23:10:42,301 - lava_callback - ERROR - Error processing callback for node 69c85fea123b47fd237711f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37792 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:12:02,345 - lava_callback - INFO - Received callback for node 69c86035123b47fd237711f7 INFO: 172.20.0.1:43980 - "POST /node/69c86035123b47fd237711f7 HTTP/1.0" 202 Accepted 2026-03-30 23:12:02,350 - lava_callback - INFO - Starting async job submit for node 69c86035123b47fd237711f7 2026-03-30 23:12:02,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:12:02,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86035123b47fd237711f7 HTTP/1.1" 200 None 2026-03-30 23:12:02,366 - lava_callback - DEBUG - Processing node 69c86035123b47fd237711f7: baseline-arm64-clabbe 2026-03-30 23:12:02,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86035123b47fd237711f7 2026-03-30 23:12:02,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:12:02,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86035123b47fd237711f7 HTTP/1.1" 200 None 2026-03-30 23:12:02,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:12:02,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-30 23:12:02,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:12:02,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86035123b47fd237711f7 HTTP/1.1" 200 None 2026-03-30 23:12:02,425 - lava_callback - ERROR - Error processing callback for node 69c86035123b47fd237711f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52926 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:13:22,333 - lava_callback - INFO - Received callback for node 69c8607e123b47fd23771202 INFO: 172.20.0.1:52650 - "POST /node/69c8607e123b47fd23771202 HTTP/1.0" 202 Accepted 2026-03-30 23:13:22,339 - lava_callback - INFO - Starting async job submit for node 69c8607e123b47fd23771202 2026-03-30 23:13:22,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:13:22,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8607e123b47fd23771202 HTTP/1.1" 200 None 2026-03-30 23:13:22,356 - lava_callback - DEBUG - Processing node 69c8607e123b47fd23771202: baseline-arm64-clabbe 2026-03-30 23:13:22,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8607e123b47fd23771202 2026-03-30 23:13:22,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:13:22,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8607e123b47fd23771202 HTTP/1.1" 200 None 2026-03-30 23:13:22,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:13:22,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c5b114abf66a8f4d9bcb37 HTTP/1.1" 200 None 2026-03-30 23:13:22,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:13:22,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8607e123b47fd23771202 HTTP/1.1" 200 None 2026-03-30 23:13:22,421 - lava_callback - ERROR - Error processing callback for node 69c8607e123b47fd23771202: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49444 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 23:14:15,672 - lava_callback - INFO - Received callback for node 69c860b7123b47fd2377120e INFO: 172.20.0.1:49454 - "POST /node/69c860b7123b47fd2377120e HTTP/1.0" 202 Accepted 2026-03-30 23:14:15,677 - lava_callback - INFO - Starting async job submit for node 69c860b7123b47fd2377120e 2026-03-30 23:14:15,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:14:15,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c860b7123b47fd2377120e HTTP/1.1" 200 None 2026-03-30 23:14:15,693 - lava_callback - DEBUG - Processing node 69c860b7123b47fd2377120e: baseline-arm-baylibre 2026-03-30 23:14:15,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c860b7123b47fd2377120e 2026-03-30 23:14:15,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:14:15,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c860b7123b47fd2377120e HTTP/1.1" 200 None 2026-03-30 23:14:15,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:14:15,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:14:15,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:14:15,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c860b7123b47fd2377120e HTTP/1.1" 200 None 2026-03-30 23:14:15,757 - lava_callback - ERROR - Error processing callback for node 69c860b7123b47fd2377120e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48850 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:14:55,596 - lava_callback - INFO - Received callback for node 69c860dd123b47fd2377121a INFO: 172.20.0.1:38000 - "POST /node/69c860dd123b47fd2377121a HTTP/1.0" 202 Accepted 2026-03-30 23:14:55,602 - lava_callback - INFO - Starting async job submit for node 69c860dd123b47fd2377121a 2026-03-30 23:14:55,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:14:55,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c860dd123b47fd2377121a HTTP/1.1" 200 None 2026-03-30 23:14:55,620 - lava_callback - DEBUG - Processing node 69c860dd123b47fd2377121a: baseline-arm-baylibre 2026-03-30 23:14:55,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c860dd123b47fd2377121a 2026-03-30 23:14:55,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:14:55,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c860dd123b47fd2377121a HTTP/1.1" 200 None 2026-03-30 23:14:55,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:14:55,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:14:55,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:14:55,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c860dd123b47fd2377121a HTTP/1.1" 200 None 2026-03-30 23:14:55,685 - lava_callback - ERROR - Error processing callback for node 69c860dd123b47fd2377121a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46408 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:17:55,816 - lava_callback - INFO - Received callback for node 69c8619e123b47fd23771235 INFO: 172.20.0.1:43660 - "POST /node/69c8619e123b47fd23771235 HTTP/1.0" 202 Accepted 2026-03-30 23:17:55,821 - lava_callback - INFO - Starting async job submit for node 69c8619e123b47fd23771235 2026-03-30 23:17:55,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:17:55,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8619e123b47fd23771235 HTTP/1.1" 200 None 2026-03-30 23:17:55,856 - lava_callback - DEBUG - Processing node 69c8619e123b47fd23771235: baseline-arm64-baylibre 2026-03-30 23:17:55,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8619e123b47fd23771235 2026-03-30 23:17:55,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:17:55,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8619e123b47fd23771235 HTTP/1.1" 200 None 2026-03-30 23:17:55,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:17:55,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 23:17:55,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:17:55,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8619e123b47fd23771235 HTTP/1.1" 200 None 2026-03-30 23:17:55,928 - lava_callback - ERROR - Error processing callback for node 69c8619e123b47fd23771235: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59642 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:19:22,649 - lava_callback - INFO - Received callback for node 69c861f0123b47fd23771249 INFO: 172.20.0.1:39186 - "POST /node/69c861f0123b47fd23771249 HTTP/1.0" 202 Accepted 2026-03-30 23:19:22,655 - lava_callback - INFO - Starting async job submit for node 69c861f0123b47fd23771249 2026-03-30 23:19:22,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:19:22,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c861f0123b47fd23771249 HTTP/1.1" 200 None 2026-03-30 23:19:22,671 - lava_callback - DEBUG - Processing node 69c861f0123b47fd23771249: baseline-arm64-clabbe 2026-03-30 23:19:22,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c861f0123b47fd23771249 2026-03-30 23:19:22,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:19:22,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c861f0123b47fd23771249 HTTP/1.1" 200 None 2026-03-30 23:19:22,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:19:22,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 23:19:22,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:19:22,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c861f0123b47fd23771249 HTTP/1.1" 200 None 2026-03-30 23:19:22,732 - lava_callback - ERROR - Error processing callback for node 69c861f0123b47fd23771249: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33950 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:20:42,680 - lava_callback - INFO - Received callback for node 69c8623d123b47fd23771253 INFO: 172.20.0.1:58410 - "POST /node/69c8623d123b47fd23771253 HTTP/1.0" 202 Accepted 2026-03-30 23:20:42,685 - lava_callback - INFO - Starting async job submit for node 69c8623d123b47fd23771253 2026-03-30 23:20:42,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:20:42,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8623d123b47fd23771253 HTTP/1.1" 200 None 2026-03-30 23:20:42,708 - lava_callback - DEBUG - Processing node 69c8623d123b47fd23771253: baseline-arm64-clabbe 2026-03-30 23:20:42,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8623d123b47fd23771253 2026-03-30 23:20:42,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:20:42,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8623d123b47fd23771253 HTTP/1.1" 200 None 2026-03-30 23:20:42,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:20:42,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 23:20:42,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:20:42,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8623d123b47fd23771253 HTTP/1.1" 200 None 2026-03-30 23:20:42,780 - lava_callback - ERROR - Error processing callback for node 69c8623d123b47fd23771253: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56942 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:22:02,777 - lava_callback - INFO - Received callback for node 69c86288123b47fd23771265 INFO: 172.20.0.1:34772 - "POST /node/69c86288123b47fd23771265 HTTP/1.0" 202 Accepted 2026-03-30 23:22:02,783 - lava_callback - INFO - Starting async job submit for node 69c86288123b47fd23771265 2026-03-30 23:22:02,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:22:02,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86288123b47fd23771265 HTTP/1.1" 200 None 2026-03-30 23:22:02,800 - lava_callback - DEBUG - Processing node 69c86288123b47fd23771265: baseline-arm64-clabbe 2026-03-30 23:22:02,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86288123b47fd23771265 2026-03-30 23:22:02,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:22:02,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86288123b47fd23771265 HTTP/1.1" 200 None 2026-03-30 23:22:02,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:22:02,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 23:22:02,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:22:02,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86288123b47fd23771265 HTTP/1.1" 200 None 2026-03-30 23:22:02,869 - lava_callback - ERROR - Error processing callback for node 69c86288123b47fd23771265: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55276 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:23:02,751 - lava_callback - INFO - Received callback for node 69c862d4123b47fd2377126f INFO: 172.20.0.1:53528 - "POST /node/69c862d4123b47fd2377126f HTTP/1.0" 202 Accepted 2026-03-30 23:23:02,757 - lava_callback - INFO - Starting async job submit for node 69c862d4123b47fd2377126f 2026-03-30 23:23:02,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:23:02,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c862d4123b47fd2377126f HTTP/1.1" 200 None 2026-03-30 23:23:02,772 - lava_callback - DEBUG - Processing node 69c862d4123b47fd2377126f: baseline-arm64-clabbe 2026-03-30 23:23:02,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c862d4123b47fd2377126f 2026-03-30 23:23:02,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:23:02,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c862d4123b47fd2377126f HTTP/1.1" 200 None 2026-03-30 23:23:02,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:23:02,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 23:23:02,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:23:02,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c862d4123b47fd2377126f HTTP/1.1" 200 None 2026-03-30 23:23:02,836 - lava_callback - ERROR - Error processing callback for node 69c862d4123b47fd2377126f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35320 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:24:22,833 - lava_callback - INFO - Received callback for node 69c8631d123b47fd23771284 INFO: 172.20.0.1:57628 - "POST /node/69c8631d123b47fd23771284 HTTP/1.0" 202 Accepted 2026-03-30 23:24:22,838 - lava_callback - INFO - Starting async job submit for node 69c8631d123b47fd23771284 2026-03-30 23:24:22,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:24:22,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8631d123b47fd23771284 HTTP/1.1" 200 None 2026-03-30 23:24:22,856 - lava_callback - DEBUG - Processing node 69c8631d123b47fd23771284: baseline-arm64-clabbe 2026-03-30 23:24:22,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8631d123b47fd23771284 2026-03-30 23:24:22,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:24:22,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8631d123b47fd23771284 HTTP/1.1" 200 None 2026-03-30 23:24:22,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:24:22,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 23:24:22,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:24:22,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8631d123b47fd23771284 HTTP/1.1" 200 None 2026-03-30 23:24:22,926 - lava_callback - ERROR - Error processing callback for node 69c8631d123b47fd23771284: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51946 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:25:42,873 - lava_callback - INFO - Received callback for node 69c86367123b47fd2377128c INFO: 172.20.0.1:55716 - "POST /node/69c86367123b47fd2377128c HTTP/1.0" 202 Accepted 2026-03-30 23:25:42,878 - lava_callback - INFO - Starting async job submit for node 69c86367123b47fd2377128c 2026-03-30 23:25:42,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:25:42,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86367123b47fd2377128c HTTP/1.1" 200 None 2026-03-30 23:25:42,919 - lava_callback - DEBUG - Processing node 69c86367123b47fd2377128c: baseline-arm64-clabbe 2026-03-30 23:25:42,919 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86367123b47fd2377128c 2026-03-30 23:25:42,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:25:42,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86367123b47fd2377128c HTTP/1.1" 200 None 2026-03-30 23:25:42,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:25:42,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c7ff4f123b47fd2376d75b HTTP/1.1" 200 None 2026-03-30 23:25:42,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:25:42,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86367123b47fd2377128c HTTP/1.1" 200 None 2026-03-30 23:25:42,990 - lava_callback - ERROR - Error processing callback for node 69c86367123b47fd2377128c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47340 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:26:36,339 - lava_callback - INFO - Received callback for node 69c8639f123b47fd2377129a INFO: 172.20.0.1:49750 - "POST /node/69c8639f123b47fd2377129a HTTP/1.0" 202 Accepted 2026-03-30 23:26:36,345 - lava_callback - INFO - Starting async job submit for node 69c8639f123b47fd2377129a 2026-03-30 23:26:36,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:26:36,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8639f123b47fd2377129a HTTP/1.1" 200 None 2026-03-30 23:26:36,361 - lava_callback - DEBUG - Processing node 69c8639f123b47fd2377129a: baseline-arm-baylibre 2026-03-30 23:26:36,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8639f123b47fd2377129a 2026-03-30 23:26:36,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:26:36,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8639f123b47fd2377129a HTTP/1.1" 200 None 2026-03-30 23:26:36,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:26:36,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:26:36,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:26:36,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8639f123b47fd2377129a HTTP/1.1" 200 None 2026-03-30 23:26:36,421 - lava_callback - ERROR - Error processing callback for node 69c8639f123b47fd2377129a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33846 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:27:23,003 - lava_callback - INFO - Received callback for node 69c863c8123b47fd237712a5 INFO: 172.20.0.1:47930 - "POST /node/69c863c8123b47fd237712a5 HTTP/1.0" 202 Accepted 2026-03-30 23:27:23,009 - lava_callback - INFO - Starting async job submit for node 69c863c8123b47fd237712a5 2026-03-30 23:27:23,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:27:23,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c863c8123b47fd237712a5 HTTP/1.1" 200 None 2026-03-30 23:27:23,031 - lava_callback - DEBUG - Processing node 69c863c8123b47fd237712a5: baseline-arm-clabbe 2026-03-30 23:27:23,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c863c8123b47fd237712a5 2026-03-30 23:27:23,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:27:23,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c863c8123b47fd237712a5 HTTP/1.1" 200 None 2026-03-30 23:27:23,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:27:23,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:27:23,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:27:23,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c863c8123b47fd237712a5 HTTP/1.1" 200 None 2026-03-30 23:27:23,088 - lava_callback - ERROR - Error processing callback for node 69c863c8123b47fd237712a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37800 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:27:56,435 - lava_callback - INFO - Received callback for node 69c863e8123b47fd237712b0 INFO: 172.20.0.1:52962 - "POST /node/69c863e8123b47fd237712b0 HTTP/1.0" 202 Accepted 2026-03-30 23:27:56,440 - lava_callback - INFO - Starting async job submit for node 69c863e8123b47fd237712b0 2026-03-30 23:27:56,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:27:56,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c863e8123b47fd237712b0 HTTP/1.1" 200 None 2026-03-30 23:27:56,456 - lava_callback - DEBUG - Processing node 69c863e8123b47fd237712b0: baseline-arm-baylibre 2026-03-30 23:27:56,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c863e8123b47fd237712b0 2026-03-30 23:27:56,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:27:56,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c863e8123b47fd237712b0 HTTP/1.1" 200 None 2026-03-30 23:27:56,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:27:56,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:27:56,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:27:56,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c863e8123b47fd237712b0 HTTP/1.1" 200 None 2026-03-30 23:27:56,513 - lava_callback - ERROR - Error processing callback for node 69c863e8123b47fd237712b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36246 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 23:28:16,365 - lava_callback - INFO - Received callback for node 69c8640c123b47fd237712ba INFO: 172.20.0.1:36250 - "POST /node/69c8640c123b47fd237712ba HTTP/1.0" 202 Accepted 2026-03-30 23:28:16,371 - lava_callback - INFO - Starting async job submit for node 69c8640c123b47fd237712ba 2026-03-30 23:28:16,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:28:16,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8640c123b47fd237712ba HTTP/1.1" 200 None 2026-03-30 23:28:16,386 - lava_callback - DEBUG - Processing node 69c8640c123b47fd237712ba: baseline-arm-baylibre 2026-03-30 23:28:16,386 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8640c123b47fd237712ba 2026-03-30 23:28:16,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:28:16,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8640c123b47fd237712ba HTTP/1.1" 200 None 2026-03-30 23:28:16,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:28:16,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:28:16,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:28:16,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8640c123b47fd237712ba HTTP/1.1" 200 None 2026-03-30 23:28:16,441 - lava_callback - ERROR - Error processing callback for node 69c8640c123b47fd237712ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56698 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:29:03,035 - lava_callback - INFO - Received callback for node 69c86432123b47fd237712c5 INFO: 172.20.0.1:33494 - "POST /node/69c86432123b47fd237712c5 HTTP/1.0" 202 Accepted 2026-03-30 23:29:03,040 - lava_callback - INFO - Starting async job submit for node 69c86432123b47fd237712c5 2026-03-30 23:29:03,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:29:03,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86432123b47fd237712c5 HTTP/1.1" 200 None 2026-03-30 23:29:03,065 - lava_callback - DEBUG - Processing node 69c86432123b47fd237712c5: baseline-arm-clabbe 2026-03-30 23:29:03,065 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86432123b47fd237712c5 2026-03-30 23:29:03,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:29:03,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86432123b47fd237712c5 HTTP/1.1" 200 None 2026-03-30 23:29:03,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:29:03,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:29:03,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:29:03,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86432123b47fd237712c5 HTTP/1.1" 200 None 2026-03-30 23:29:03,120 - lava_callback - ERROR - Error processing callback for node 69c86432123b47fd237712c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60740 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:29:36,480 - lava_callback - INFO - Received callback for node 69c86454123b47fd237712cf INFO: 172.20.0.1:48216 - "POST /node/69c86454123b47fd237712cf HTTP/1.0" 202 Accepted 2026-03-30 23:29:36,486 - lava_callback - INFO - Starting async job submit for node 69c86454123b47fd237712cf 2026-03-30 23:29:36,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:29:36,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86454123b47fd237712cf HTTP/1.1" 200 None 2026-03-30 23:29:36,503 - lava_callback - DEBUG - Processing node 69c86454123b47fd237712cf: baseline-arm-baylibre 2026-03-30 23:29:36,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86454123b47fd237712cf 2026-03-30 23:29:36,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:48220 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:29:36,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86454123b47fd237712cf HTTP/1.1" 200 None 2026-03-30 23:29:36,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:29:36,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:29:36,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:29:36,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86454123b47fd237712cf HTTP/1.1" 200 None 2026-03-30 23:29:36,555 - lava_callback - ERROR - Error processing callback for node 69c86454123b47fd237712cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33892 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-30 23:30:16,473 - lava_callback - INFO - Received callback for node 69c86478123b47fd237712d8 INFO: 172.20.0.1:33898 - "POST /node/69c86478123b47fd237712d8 HTTP/1.0" 202 Accepted 2026-03-30 23:30:16,478 - lava_callback - INFO - Starting async job submit for node 69c86478123b47fd237712d8 2026-03-30 23:30:16,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:30:16,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86478123b47fd237712d8 HTTP/1.1" 200 None 2026-03-30 23:30:16,495 - lava_callback - DEBUG - Processing node 69c86478123b47fd237712d8: baseline-arm-baylibre 2026-03-30 23:30:16,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86478123b47fd237712d8 2026-03-30 23:30:16,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:30:16,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86478123b47fd237712d8 HTTP/1.1" 200 None 2026-03-30 23:30:16,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:30:16,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:30:16,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:33902 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:30:16,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86478123b47fd237712d8 HTTP/1.1" 200 None 2026-03-30 23:30:16,553 - lava_callback - ERROR - Error processing callback for node 69c86478123b47fd237712d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59042 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:30:36,501 - lava_callback - INFO - Received callback for node 69c86498123b47fd237712e0 INFO: 172.20.0.1:42944 - "POST /node/69c86498123b47fd237712e0 HTTP/1.0" 202 Accepted 2026-03-30 23:30:36,507 - lava_callback - INFO - Starting async job submit for node 69c86498123b47fd237712e0 2026-03-30 23:30:36,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:30:36,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86498123b47fd237712e0 HTTP/1.1" 200 None 2026-03-30 23:30:36,523 - lava_callback - DEBUG - Processing node 69c86498123b47fd237712e0: baseline-arm-baylibre 2026-03-30 23:30:36,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86498123b47fd237712e0 2026-03-30 23:30:36,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:30:36,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86498123b47fd237712e0 HTTP/1.1" 200 None 2026-03-30 23:30:36,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:42958 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:30:36,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:30:36,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:30:36,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86498123b47fd237712e0 HTTP/1.1" 200 None 2026-03-30 23:30:36,591 - lava_callback - ERROR - Error processing callback for node 69c86498123b47fd237712e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43786 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:31:16,584 - lava_callback - INFO - Received callback for node 69c864bc123b47fd237712ee INFO: 172.20.0.1:43800 - "POST /node/69c864bc123b47fd237712ee HTTP/1.0" 202 Accepted 2026-03-30 23:31:16,590 - lava_callback - INFO - Starting async job submit for node 69c864bc123b47fd237712ee 2026-03-30 23:31:16,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:31:16,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c864bc123b47fd237712ee HTTP/1.1" 200 None 2026-03-30 23:31:16,606 - lava_callback - DEBUG - Processing node 69c864bc123b47fd237712ee: baseline-arm-baylibre 2026-03-30 23:31:16,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c864bc123b47fd237712ee 2026-03-30 23:31:16,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:31:16,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c864bc123b47fd237712ee HTTP/1.1" 200 None 2026-03-30 23:31:16,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:31:16,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:31:16,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:31:16,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c864bc123b47fd237712ee HTTP/1.1" 200 None 2026-03-30 23:31:16,666 - lava_callback - ERROR - Error processing callback for node 69c864bc123b47fd237712ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42046 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:31:56,630 - lava_callback - INFO - Received callback for node 69c864df123b47fd237712f9 INFO: 172.20.0.1:42048 - "POST /node/69c864df123b47fd237712f9 HTTP/1.0" 202 Accepted 2026-03-30 23:31:56,636 - lava_callback - INFO - Starting async job submit for node 69c864df123b47fd237712f9 2026-03-30 23:31:56,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:31:56,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c864df123b47fd237712f9 HTTP/1.1" 200 None 2026-03-30 23:31:56,660 - lava_callback - DEBUG - Processing node 69c864df123b47fd237712f9: baseline-arm-baylibre 2026-03-30 23:31:56,660 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c864df123b47fd237712f9 2026-03-30 23:31:56,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:31:56,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c864df123b47fd237712f9 HTTP/1.1" 200 None 2026-03-30 23:31:56,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:31:56,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:31:56,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:31:56,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c864df123b47fd237712f9 HTTP/1.1" 200 None 2026-03-30 23:31:56,733 - lava_callback - ERROR - Error processing callback for node 69c864df123b47fd237712f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39426 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:32:43,195 - lava_callback - INFO - Received callback for node 69c86506123b47fd23771305 INFO: 172.20.0.1:58024 - "POST /node/69c86506123b47fd23771305 HTTP/1.0" 202 Accepted 2026-03-30 23:32:43,200 - lava_callback - INFO - Starting async job submit for node 69c86506123b47fd23771305 2026-03-30 23:32:43,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:32:43,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86506123b47fd23771305 HTTP/1.1" 200 None 2026-03-30 23:32:43,216 - lava_callback - DEBUG - Processing node 69c86506123b47fd23771305: baseline-arm-clabbe 2026-03-30 23:32:43,216 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86506123b47fd23771305 2026-03-30 23:32:43,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:32:43,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86506123b47fd23771305 HTTP/1.1" 200 None 2026-03-30 23:32:43,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:32:43,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:32:43,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:32:43,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86506123b47fd23771305 HTTP/1.1" 200 None 2026-03-30 23:32:43,268 - lava_callback - ERROR - Error processing callback for node 69c86506123b47fd23771305: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44182 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:33:16,684 - lava_callback - INFO - Received callback for node 69c86527123b47fd23771312 INFO: 172.20.0.1:44190 - "POST /node/69c86527123b47fd23771312 HTTP/1.0" 202 Accepted 2026-03-30 23:33:16,692 - lava_callback - INFO - Starting async job submit for node 69c86527123b47fd23771312 2026-03-30 23:33:16,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:33:16,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86527123b47fd23771312 HTTP/1.1" 200 None 2026-03-30 23:33:16,709 - lava_callback - DEBUG - Processing node 69c86527123b47fd23771312: baseline-arm-baylibre 2026-03-30 23:33:16,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86527123b47fd23771312 2026-03-30 23:33:16,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:33:16,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86527123b47fd23771312 HTTP/1.1" 200 None 2026-03-30 23:33:16,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:33:16,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:33:16,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:33:16,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86527123b47fd23771312 HTTP/1.1" 200 None 2026-03-30 23:33:16,768 - lava_callback - ERROR - Error processing callback for node 69c86527123b47fd23771312: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57538 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:33:43,168 - lava_callback - INFO - Received callback for node 69c8654e123b47fd2377131f INFO: 172.20.0.1:42722 - "POST /node/69c8654e123b47fd2377131f HTTP/1.0" 202 Accepted 2026-03-30 23:33:43,173 - lava_callback - INFO - Starting async job submit for node 69c8654e123b47fd2377131f 2026-03-30 23:33:43,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:33:43,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8654e123b47fd2377131f HTTP/1.1" 200 None 2026-03-30 23:33:43,189 - lava_callback - DEBUG - Processing node 69c8654e123b47fd2377131f: baseline-arm-clabbe 2026-03-30 23:33:43,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8654e123b47fd2377131f 2026-03-30 23:33:43,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:33:43,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8654e123b47fd2377131f HTTP/1.1" 200 None 2026-03-30 23:33:43,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:33:43,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:33:43,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:33:43,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8654e123b47fd2377131f HTTP/1.1" 200 None 2026-03-30 23:33:43,248 - lava_callback - ERROR - Error processing callback for node 69c8654e123b47fd2377131f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44344 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:34:23,159 - lava_callback - INFO - Received callback for node 69c86572123b47fd2377132e INFO: 172.20.0.1:50352 - "POST /node/69c86572123b47fd2377132e HTTP/1.0" 202 Accepted 2026-03-30 23:34:23,165 - lava_callback - INFO - Starting async job submit for node 69c86572123b47fd2377132e 2026-03-30 23:34:23,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:34:23,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86572123b47fd2377132e HTTP/1.1" 200 None 2026-03-30 23:34:23,181 - lava_callback - DEBUG - Processing node 69c86572123b47fd2377132e: baseline-arm-clabbe 2026-03-30 23:34:23,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86572123b47fd2377132e 2026-03-30 23:34:23,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:34:23,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86572123b47fd2377132e HTTP/1.1" 200 None 2026-03-30 23:34:23,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:34:23,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:34:23,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:34:23,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86572123b47fd2377132e HTTP/1.1" 200 None 2026-03-30 23:34:23,251 - lava_callback - ERROR - Error processing callback for node 69c86572123b47fd2377132e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52952 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:34:56,882 - lava_callback - INFO - Received callback for node 69c86593123b47fd23771339 INFO: 172.20.0.1:52968 - "POST /node/69c86593123b47fd23771339 HTTP/1.0" 202 Accepted 2026-03-30 23:34:56,890 - lava_callback - INFO - Starting async job submit for node 69c86593123b47fd23771339 2026-03-30 23:34:56,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:34:56,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86593123b47fd23771339 HTTP/1.1" 200 None 2026-03-30 23:34:56,906 - lava_callback - DEBUG - Processing node 69c86593123b47fd23771339: baseline-arm-baylibre 2026-03-30 23:34:56,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86593123b47fd23771339 2026-03-30 23:34:56,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:34:56,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86593123b47fd23771339 HTTP/1.1" 200 None 2026-03-30 23:34:56,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:34:56,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:34:56,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:34:56,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86593123b47fd23771339 HTTP/1.1" 200 None 2026-03-30 23:34:56,978 - lava_callback - ERROR - Error processing callback for node 69c86593123b47fd23771339: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36298 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:35:43,309 - lava_callback - INFO - Received callback for node 69c865b9123b47fd23771347 INFO: 172.20.0.1:54162 - "POST /node/69c865b9123b47fd23771347 HTTP/1.0" 202 Accepted 2026-03-30 23:35:43,315 - lava_callback - INFO - Starting async job submit for node 69c865b9123b47fd23771347 2026-03-30 23:35:43,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:35:43,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c865b9123b47fd23771347 HTTP/1.1" 200 None 2026-03-30 23:35:43,332 - lava_callback - DEBUG - Processing node 69c865b9123b47fd23771347: baseline-arm-clabbe 2026-03-30 23:35:43,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c865b9123b47fd23771347 2026-03-30 23:35:43,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:35:43,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c865b9123b47fd23771347 HTTP/1.1" 200 None 2026-03-30 23:35:43,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:35:43,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:35:43,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:35:43,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c865b9123b47fd23771347 HTTP/1.1" 200 None 2026-03-30 23:35:43,397 - lava_callback - ERROR - Error processing callback for node 69c865b9123b47fd23771347: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48400 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:36:16,816 - lava_callback - INFO - Received callback for node 69c865db123b47fd23771353 INFO: 172.20.0.1:48404 - "POST /node/69c865db123b47fd23771353 HTTP/1.0" 202 Accepted 2026-03-30 23:36:16,821 - lava_callback - INFO - Starting async job submit for node 69c865db123b47fd23771353 2026-03-30 23:36:16,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:36:16,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c865db123b47fd23771353 HTTP/1.1" 200 None 2026-03-30 23:36:16,837 - lava_callback - DEBUG - Processing node 69c865db123b47fd23771353: baseline-arm-baylibre 2026-03-30 23:36:16,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c865db123b47fd23771353 2026-03-30 23:36:16,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:36:16,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c865db123b47fd23771353 HTTP/1.1" 200 None 2026-03-30 23:36:16,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:36:16,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:36:16,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:36:16,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c865db123b47fd23771353 HTTP/1.1" 200 None 2026-03-30 23:36:16,891 - lava_callback - ERROR - Error processing callback for node 69c865db123b47fd23771353: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50132 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:36:43,327 - lava_callback - INFO - Received callback for node 69c86601123b47fd2377135f INFO: 172.20.0.1:46298 - "POST /node/69c86601123b47fd2377135f HTTP/1.0" 202 Accepted 2026-03-30 23:36:43,332 - lava_callback - INFO - Starting async job submit for node 69c86601123b47fd2377135f 2026-03-30 23:36:43,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:36:43,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86601123b47fd2377135f HTTP/1.1" 200 None 2026-03-30 23:36:43,350 - lava_callback - DEBUG - Processing node 69c86601123b47fd2377135f: baseline-arm-clabbe 2026-03-30 23:36:43,351 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86601123b47fd2377135f 2026-03-30 23:36:43,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:36:43,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86601123b47fd2377135f HTTP/1.1" 200 None 2026-03-30 23:36:43,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:36:43,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:36:43,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:36:43,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86601123b47fd2377135f HTTP/1.1" 200 None 2026-03-30 23:36:43,408 - lava_callback - ERROR - Error processing callback for node 69c86601123b47fd2377135f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53614 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:37:23,314 - lava_callback - INFO - Received callback for node 69c86625123b47fd23771373 INFO: 172.20.0.1:42838 - "POST /node/69c86625123b47fd23771373 HTTP/1.0" 202 Accepted 2026-03-30 23:37:23,320 - lava_callback - INFO - Starting async job submit for node 69c86625123b47fd23771373 2026-03-30 23:37:23,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:37:23,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86625123b47fd23771373 HTTP/1.1" 200 None 2026-03-30 23:37:23,335 - lava_callback - DEBUG - Processing node 69c86625123b47fd23771373: baseline-arm-clabbe 2026-03-30 23:37:23,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86625123b47fd23771373 2026-03-30 23:37:23,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:37:23,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86625123b47fd23771373 HTTP/1.1" 200 None 2026-03-30 23:37:23,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:37:23,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:37:23,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:37:23,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86625123b47fd23771373 HTTP/1.1" 200 None 2026-03-30 23:37:23,398 - lava_callback - ERROR - Error processing callback for node 69c86625123b47fd23771373: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49398 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:38:03,375 - lava_callback - INFO - Received callback for node 69c86648123b47fd2377137a INFO: 172.20.0.1:44650 - "POST /node/69c86648123b47fd2377137a HTTP/1.0" 202 Accepted 2026-03-30 23:38:03,380 - lava_callback - INFO - Starting async job submit for node 69c86648123b47fd2377137a 2026-03-30 23:38:03,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:38:03,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86648123b47fd2377137a HTTP/1.1" 200 None 2026-03-30 23:38:03,396 - lava_callback - DEBUG - Processing node 69c86648123b47fd2377137a: baseline-arm-clabbe 2026-03-30 23:38:03,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86648123b47fd2377137a 2026-03-30 23:38:03,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:38:03,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86648123b47fd2377137a HTTP/1.1" 200 None 2026-03-30 23:38:03,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:38:03,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:38:03,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:38:03,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86648123b47fd2377137a HTTP/1.1" 200 None 2026-03-30 23:38:03,468 - lava_callback - ERROR - Error processing callback for node 69c86648123b47fd2377137a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47086 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:38:23,344 - lava_callback - INFO - Received callback for node 69c8666d123b47fd23771386 INFO: 172.20.0.1:59324 - "POST /node/69c8666d123b47fd23771386 HTTP/1.0" 202 Accepted 2026-03-30 23:38:23,350 - lava_callback - INFO - Starting async job submit for node 69c8666d123b47fd23771386 2026-03-30 23:38:23,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:38:23,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8666d123b47fd23771386 HTTP/1.1" 200 None 2026-03-30 23:38:23,366 - lava_callback - DEBUG - Processing node 69c8666d123b47fd23771386: baseline-arm-clabbe 2026-03-30 23:38:23,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8666d123b47fd23771386 2026-03-30 23:38:23,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:38:23,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8666d123b47fd23771386 HTTP/1.1" 200 None 2026-03-30 23:38:23,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:38:23,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:38:23,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:38:23,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8666d123b47fd23771386 HTTP/1.1" 200 None 2026-03-30 23:38:23,426 - lava_callback - ERROR - Error processing callback for node 69c8666d123b47fd23771386: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39074 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:39:03,412 - lava_callback - INFO - Received callback for node 69c86690123b47fd23771392 INFO: 172.20.0.1:36456 - "POST /node/69c86690123b47fd23771392 HTTP/1.0" 202 Accepted 2026-03-30 23:39:03,418 - lava_callback - INFO - Starting async job submit for node 69c86690123b47fd23771392 2026-03-30 23:39:03,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:39:03,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86690123b47fd23771392 HTTP/1.1" 200 None 2026-03-30 23:39:03,434 - lava_callback - DEBUG - Processing node 69c86690123b47fd23771392: baseline-arm-clabbe 2026-03-30 23:39:03,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86690123b47fd23771392 2026-03-30 23:39:03,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:39:03,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86690123b47fd23771392 HTTP/1.1" 200 None 2026-03-30 23:39:03,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:39:03,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:39:03,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:39:03,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86690123b47fd23771392 HTTP/1.1" 200 None 2026-03-30 23:39:03,490 - lava_callback - ERROR - Error processing callback for node 69c86690123b47fd23771392: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58682 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:39:43,427 - lava_callback - INFO - Received callback for node 69c866b4123b47fd2377139e INFO: 172.20.0.1:54432 - "POST /node/69c866b4123b47fd2377139e HTTP/1.0" 202 Accepted 2026-03-30 23:39:43,432 - lava_callback - INFO - Starting async job submit for node 69c866b4123b47fd2377139e 2026-03-30 23:39:43,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:39:43,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c866b4123b47fd2377139e HTTP/1.1" 200 None 2026-03-30 23:39:43,447 - lava_callback - DEBUG - Processing node 69c866b4123b47fd2377139e: baseline-arm-clabbe 2026-03-30 23:39:43,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c866b4123b47fd2377139e 2026-03-30 23:39:43,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:39:43,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c866b4123b47fd2377139e HTTP/1.1" 200 None 2026-03-30 23:39:43,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:39:43,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:39:43,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:39:43,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c866b4123b47fd2377139e HTTP/1.1" 200 None 2026-03-30 23:39:43,513 - lava_callback - ERROR - Error processing callback for node 69c866b4123b47fd2377139e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59608 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:40:23,477 - lava_callback - INFO - Received callback for node 69c866d9123b47fd237713b2 INFO: 172.20.0.1:41570 - "POST /node/69c866d9123b47fd237713b2 HTTP/1.0" 202 Accepted 2026-03-30 23:40:23,483 - lava_callback - INFO - Starting async job submit for node 69c866d9123b47fd237713b2 2026-03-30 23:40:23,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:40:23,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c866d9123b47fd237713b2 HTTP/1.1" 200 None 2026-03-30 23:40:23,500 - lava_callback - DEBUG - Processing node 69c866d9123b47fd237713b2: baseline-arm-clabbe 2026-03-30 23:40:23,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c866d9123b47fd237713b2 2026-03-30 23:40:23,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:40:23,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c866d9123b47fd237713b2 HTTP/1.1" 200 None 2026-03-30 23:40:23,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:40:23,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:40:23,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:40:23,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c866d9123b47fd237713b2 HTTP/1.1" 200 None 2026-03-30 23:40:23,581 - lava_callback - ERROR - Error processing callback for node 69c866d9123b47fd237713b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38312 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:41:03,467 - lava_callback - INFO - Received callback for node 69c866fc123b47fd237713bc INFO: 172.20.0.1:33252 - "POST /node/69c866fc123b47fd237713bc HTTP/1.0" 202 Accepted 2026-03-30 23:41:03,473 - lava_callback - INFO - Starting async job submit for node 69c866fc123b47fd237713bc 2026-03-30 23:41:03,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:41:03,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c866fc123b47fd237713bc HTTP/1.1" 200 None 2026-03-30 23:41:03,493 - lava_callback - DEBUG - Processing node 69c866fc123b47fd237713bc: baseline-arm-clabbe 2026-03-30 23:41:03,494 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c866fc123b47fd237713bc 2026-03-30 23:41:03,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:41:03,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c866fc123b47fd237713bc HTTP/1.1" 200 None 2026-03-30 23:41:03,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:41:03,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:41:03,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:41:03,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c866fc123b47fd237713bc HTTP/1.1" 200 None 2026-03-30 23:41:03,556 - lava_callback - ERROR - Error processing callback for node 69c866fc123b47fd237713bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33964 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:41:23,505 - lava_callback - INFO - Received callback for node 69c86720123b47fd237713c9 INFO: 172.20.0.1:37394 - "POST /node/69c86720123b47fd237713c9 HTTP/1.0" 202 Accepted 2026-03-30 23:41:23,511 - lava_callback - INFO - Starting async job submit for node 69c86720123b47fd237713c9 2026-03-30 23:41:23,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:41:23,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86720123b47fd237713c9 HTTP/1.1" 200 None 2026-03-30 23:41:23,531 - lava_callback - DEBUG - Processing node 69c86720123b47fd237713c9: baseline-arm-clabbe 2026-03-30 23:41:23,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86720123b47fd237713c9 2026-03-30 23:41:23,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:41:23,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86720123b47fd237713c9 HTTP/1.1" 200 None 2026-03-30 23:41:23,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:41:23,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:41:23,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:41:23,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86720123b47fd237713c9 HTTP/1.1" 200 None 2026-03-30 23:41:23,608 - lava_callback - ERROR - Error processing callback for node 69c86720123b47fd237713c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47966 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:42:03,519 - lava_callback - INFO - Received callback for node 69c86745123b47fd237713d5 INFO: 172.20.0.1:54070 - "POST /node/69c86745123b47fd237713d5 HTTP/1.0" 202 Accepted 2026-03-30 23:42:03,525 - lava_callback - INFO - Starting async job submit for node 69c86745123b47fd237713d5 2026-03-30 23:42:03,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:42:03,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86745123b47fd237713d5 HTTP/1.1" 200 None 2026-03-30 23:42:03,543 - lava_callback - DEBUG - Processing node 69c86745123b47fd237713d5: baseline-arm-clabbe 2026-03-30 23:42:03,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86745123b47fd237713d5 2026-03-30 23:42:03,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:42:03,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86745123b47fd237713d5 HTTP/1.1" 200 None 2026-03-30 23:42:03,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:42:03,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c55c70abf66a8f4d9b9655 HTTP/1.1" 200 None 2026-03-30 23:42:03,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:42:03,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86745123b47fd237713d5 HTTP/1.1" 200 None 2026-03-30 23:42:03,599 - lava_callback - ERROR - Error processing callback for node 69c86745123b47fd237713d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33624 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:42:43,549 - lava_callback - INFO - Received callback for node 69c86769123b47fd237713e2 INFO: 172.20.0.1:38928 - "POST /node/69c86769123b47fd237713e2 HTTP/1.0" 202 Accepted 2026-03-30 23:42:43,555 - lava_callback - INFO - Starting async job submit for node 69c86769123b47fd237713e2 2026-03-30 23:42:43,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:42:43,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86769123b47fd237713e2 HTTP/1.1" 200 None 2026-03-30 23:42:43,572 - lava_callback - DEBUG - Processing node 69c86769123b47fd237713e2: baseline-arm-clabbe 2026-03-30 23:42:43,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86769123b47fd237713e2 2026-03-30 23:42:43,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:42:43,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86769123b47fd237713e2 HTTP/1.1" 200 None 2026-03-30 23:42:43,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:42:43,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:42:43,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:42:43,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86769123b47fd237713e2 HTTP/1.1" 200 None 2026-03-30 23:42:43,637 - lava_callback - ERROR - Error processing callback for node 69c86769123b47fd237713e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44614 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:43:23,568 - lava_callback - INFO - Received callback for node 69c8678d123b47fd237713f7 INFO: 172.20.0.1:37122 - "POST /node/69c8678d123b47fd237713f7 HTTP/1.0" 202 Accepted 2026-03-30 23:43:23,573 - lava_callback - INFO - Starting async job submit for node 69c8678d123b47fd237713f7 2026-03-30 23:43:23,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:43:23,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8678d123b47fd237713f7 HTTP/1.1" 200 None 2026-03-30 23:43:23,590 - lava_callback - DEBUG - Processing node 69c8678d123b47fd237713f7: baseline-arm-clabbe 2026-03-30 23:43:23,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8678d123b47fd237713f7 2026-03-30 23:43:23,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:43:23,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8678d123b47fd237713f7 HTTP/1.1" 200 None 2026-03-30 23:43:23,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:43:23,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:43:23,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:43:23,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8678d123b47fd237713f7 HTTP/1.1" 200 None 2026-03-30 23:43:23,655 - lava_callback - ERROR - Error processing callback for node 69c8678d123b47fd237713f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49058 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:44:03,675 - lava_callback - INFO - Received callback for node 69c867b2123b47fd23771401 INFO: 172.20.0.1:46630 - "POST /node/69c867b2123b47fd23771401 HTTP/1.0" 202 Accepted 2026-03-30 23:44:03,681 - lava_callback - INFO - Starting async job submit for node 69c867b2123b47fd23771401 2026-03-30 23:44:03,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:44:03,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c867b2123b47fd23771401 HTTP/1.1" 200 None 2026-03-30 23:44:03,710 - lava_callback - DEBUG - Processing node 69c867b2123b47fd23771401: baseline-arm-clabbe 2026-03-30 23:44:03,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c867b2123b47fd23771401 2026-03-30 23:44:03,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:44:03,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c867b2123b47fd23771401 HTTP/1.1" 200 None 2026-03-30 23:44:03,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:44:03,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:44:03,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:44:03,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c867b2123b47fd23771401 HTTP/1.1" 200 None 2026-03-30 23:44:03,766 - lava_callback - ERROR - Error processing callback for node 69c867b2123b47fd23771401: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54704 - "GET /node/69938a74cebe99dd8e0719d8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57304 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:44:43,616 - lava_callback - INFO - Received callback for node 69c867d6123b47fd2377140e INFO: 172.20.0.1:60350 - "POST /node/69c867d6123b47fd2377140e HTTP/1.0" 202 Accepted 2026-03-30 23:44:43,621 - lava_callback - INFO - Starting async job submit for node 69c867d6123b47fd2377140e 2026-03-30 23:44:43,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:44:43,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c867d6123b47fd2377140e HTTP/1.1" 200 None 2026-03-30 23:44:43,637 - lava_callback - DEBUG - Processing node 69c867d6123b47fd2377140e: baseline-arm-clabbe 2026-03-30 23:44:43,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c867d6123b47fd2377140e 2026-03-30 23:44:43,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:44:43,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c867d6123b47fd2377140e HTTP/1.1" 200 None 2026-03-30 23:44:43,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:44:43,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:44:43,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:44:43,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c867d6123b47fd2377140e HTTP/1.1" 200 None 2026-03-30 23:44:43,701 - lava_callback - ERROR - Error processing callback for node 69c867d6123b47fd2377140e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57224 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:45:03,732 - lava_callback - INFO - Received callback for node 69c867fa123b47fd2377141d INFO: 172.20.0.1:48758 - "POST /node/69c867fa123b47fd2377141d HTTP/1.0" 202 Accepted 2026-03-30 23:45:03,738 - lava_callback - INFO - Starting async job submit for node 69c867fa123b47fd2377141d 2026-03-30 23:45:03,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:45:03,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c867fa123b47fd2377141d HTTP/1.1" 200 None 2026-03-30 23:45:03,754 - lava_callback - DEBUG - Processing node 69c867fa123b47fd2377141d: baseline-arm-clabbe 2026-03-30 23:45:03,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c867fa123b47fd2377141d 2026-03-30 23:45:03,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:45:03,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c867fa123b47fd2377141d HTTP/1.1" 200 None 2026-03-30 23:45:03,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:45:03,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:45:03,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:45:03,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c867fa123b47fd2377141d HTTP/1.1" 200 None 2026-03-30 23:45:03,869 - lava_callback - ERROR - Error processing callback for node 69c867fa123b47fd2377141d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55124 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:45:43,649 - lava_callback - INFO - Received callback for node 69c8681e123b47fd2377142b INFO: 172.20.0.1:47192 - "POST /node/69c8681e123b47fd2377142b HTTP/1.0" 202 Accepted 2026-03-30 23:45:43,655 - lava_callback - INFO - Starting async job submit for node 69c8681e123b47fd2377142b 2026-03-30 23:45:43,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:45:43,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8681e123b47fd2377142b HTTP/1.1" 200 None 2026-03-30 23:45:43,675 - lava_callback - DEBUG - Processing node 69c8681e123b47fd2377142b: baseline-arm-clabbe 2026-03-30 23:45:43,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8681e123b47fd2377142b 2026-03-30 23:45:43,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:45:43,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8681e123b47fd2377142b HTTP/1.1" 200 None 2026-03-30 23:45:43,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:45:43,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:45:43,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:45:43,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8681e123b47fd2377142b HTTP/1.1" 200 None 2026-03-30 23:45:43,736 - lava_callback - ERROR - Error processing callback for node 69c8681e123b47fd2377142b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56262 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:46:23,722 - lava_callback - INFO - Received callback for node 69c86842123b47fd2377143a INFO: 172.20.0.1:55434 - "POST /node/69c86842123b47fd2377143a HTTP/1.0" 202 Accepted 2026-03-30 23:46:23,728 - lava_callback - INFO - Starting async job submit for node 69c86842123b47fd2377143a 2026-03-30 23:46:23,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:46:23,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86842123b47fd2377143a HTTP/1.1" 200 None 2026-03-30 23:46:23,749 - lava_callback - DEBUG - Processing node 69c86842123b47fd2377143a: baseline-arm-clabbe 2026-03-30 23:46:23,749 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86842123b47fd2377143a 2026-03-30 23:46:23,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:46:23,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86842123b47fd2377143a HTTP/1.1" 200 None 2026-03-30 23:46:23,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:46:23,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b94b6778148209fd336c HTTP/1.1" 200 None 2026-03-30 23:46:23,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:46:23,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86842123b47fd2377143a HTTP/1.1" 200 None 2026-03-30 23:46:23,800 - lava_callback - ERROR - Error processing callback for node 69c86842123b47fd2377143a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52700 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:46:57,332 - lava_callback - INFO - Received callback for node 69c8686c123b47fd23771445 INFO: 172.20.0.1:52712 - "POST /node/69c8686c123b47fd23771445 HTTP/1.0" 202 Accepted 2026-03-30 23:46:57,338 - lava_callback - INFO - Starting async job submit for node 69c8686c123b47fd23771445 2026-03-30 23:46:57,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:46:57,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8686c123b47fd23771445 HTTP/1.1" 200 None 2026-03-30 23:46:57,382 - lava_callback - DEBUG - Processing node 69c8686c123b47fd23771445: baseline-arm64-baylibre 2026-03-30 23:46:57,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c8686c123b47fd23771445 2026-03-30 23:46:57,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:46:57,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8686c123b47fd23771445 HTTP/1.1" 200 None 2026-03-30 23:46:57,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:46:57,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 23:46:57,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:46:57,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c8686c123b47fd23771445 HTTP/1.1" 200 None 2026-03-30 23:46:57,441 - lava_callback - ERROR - Error processing callback for node 69c8686c123b47fd23771445: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41324 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:48:17,792 - lava_callback - INFO - Received callback for node 69c868b6123b47fd23771454 INFO: 172.20.0.1:41326 - "POST /node/69c868b6123b47fd23771454 HTTP/1.0" 202 Accepted 2026-03-30 23:48:17,797 - lava_callback - INFO - Starting async job submit for node 69c868b6123b47fd23771454 2026-03-30 23:48:17,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:48:17,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c868b6123b47fd23771454 HTTP/1.1" 200 None 2026-03-30 23:48:17,813 - lava_callback - DEBUG - Processing node 69c868b6123b47fd23771454: baseline-arm64-baylibre 2026-03-30 23:48:17,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c868b6123b47fd23771454 2026-03-30 23:48:17,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:48:17,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c868b6123b47fd23771454 HTTP/1.1" 200 None 2026-03-30 23:48:17,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:48:17,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 23:48:17,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:48:17,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c868b6123b47fd23771454 HTTP/1.1" 200 None 2026-03-30 23:48:17,877 - lava_callback - ERROR - Error processing callback for node 69c868b6123b47fd23771454: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48652 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:53:17,690 - lava_callback - INFO - Received callback for node 69c869de123b47fd2377147b INFO: 172.20.0.1:48658 - "POST /node/69c869de123b47fd2377147b HTTP/1.0" 202 Accepted 2026-03-30 23:53:17,696 - lava_callback - INFO - Starting async job submit for node 69c869de123b47fd2377147b 2026-03-30 23:53:17,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:53:17,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c869de123b47fd2377147b HTTP/1.1" 200 None 2026-03-30 23:53:17,712 - lava_callback - DEBUG - Processing node 69c869de123b47fd2377147b: baseline-arm64-baylibre 2026-03-30 23:53:17,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c869de123b47fd2377147b 2026-03-30 23:53:17,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:53:17,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c869de123b47fd2377147b HTTP/1.1" 200 None 2026-03-30 23:53:17,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:53:17,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 23:53:17,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:53:17,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c869de123b47fd2377147b HTTP/1.1" 200 None 2026-03-30 23:53:17,770 - lava_callback - ERROR - Error processing callback for node 69c869de123b47fd2377147b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42058 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:54:44,225 - lava_callback - INFO - Received callback for node 69c86a30123b47fd2377148b INFO: 172.20.0.1:57556 - "POST /node/69c86a30123b47fd2377148b HTTP/1.0" 202 Accepted 2026-03-30 23:54:44,230 - lava_callback - INFO - Starting async job submit for node 69c86a30123b47fd2377148b 2026-03-30 23:54:44,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:54:44,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86a30123b47fd2377148b HTTP/1.1" 200 None 2026-03-30 23:54:44,246 - lava_callback - DEBUG - Processing node 69c86a30123b47fd2377148b: baseline-arm64-clabbe 2026-03-30 23:54:44,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86a30123b47fd2377148b 2026-03-30 23:54:44,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:54:44,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86a30123b47fd2377148b HTTP/1.1" 200 None 2026-03-30 23:54:44,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:54:44,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 23:54:44,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:54:44,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86a30123b47fd2377148b HTTP/1.1" 200 None 2026-03-30 23:54:44,307 - lava_callback - ERROR - Error processing callback for node 69c86a30123b47fd2377148b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46830 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:55:37,757 - lava_callback - INFO - Received callback for node 69c86a71123b47fd23771492 INFO: 172.20.0.1:46840 - "POST /node/69c86a71123b47fd23771492 HTTP/1.0" 202 Accepted 2026-03-30 23:55:37,763 - lava_callback - INFO - Starting async job submit for node 69c86a71123b47fd23771492 2026-03-30 23:55:37,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:55:37,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86a71123b47fd23771492 HTTP/1.1" 200 None 2026-03-30 23:55:37,780 - lava_callback - DEBUG - Processing node 69c86a71123b47fd23771492: baseline-arm64-baylibre 2026-03-30 23:55:37,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86a71123b47fd23771492 2026-03-30 23:55:37,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:55:37,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86a71123b47fd23771492 HTTP/1.1" 200 None 2026-03-30 23:55:37,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:55:37,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 23:55:37,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:55:37,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86a71123b47fd23771492 HTTP/1.1" 200 None 2026-03-30 23:55:37,833 - lava_callback - ERROR - Error processing callback for node 69c86a71123b47fd23771492: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58692 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:57:04,174 - lava_callback - INFO - Received callback for node 69c86ac5123b47fd237714a4 INFO: 172.20.0.1:51704 - "POST /node/69c86ac5123b47fd237714a4 HTTP/1.0" 202 Accepted 2026-03-30 23:57:04,180 - lava_callback - INFO - Starting async job submit for node 69c86ac5123b47fd237714a4 2026-03-30 23:57:04,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:57:04,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86ac5123b47fd237714a4 HTTP/1.1" 200 None 2026-03-30 23:57:04,200 - lava_callback - DEBUG - Processing node 69c86ac5123b47fd237714a4: baseline-arm64-clabbe 2026-03-30 23:57:04,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86ac5123b47fd237714a4 2026-03-30 23:57:04,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:57:04,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86ac5123b47fd237714a4 HTTP/1.1" 200 None 2026-03-30 23:57:04,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:57:04,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 23:57:04,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:57:04,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86ac5123b47fd237714a4 HTTP/1.1" 200 None 2026-03-30 23:57:04,263 - lava_callback - ERROR - Error processing callback for node 69c86ac5123b47fd237714a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36948 - "GET /node/69a3fba46ebb1cc56c1decf2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:36956 - "GET /node/6993d5373e9ba4930771473e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34666 - "GET /node/691093908b15debe9dd51439%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54698 - "GET / HTTP/1.0" 200 OK 2026-03-30 23:59:28,364 - lava_callback - INFO - Received callback for node 69c86b5a123b47fd237714b7 INFO: 172.20.0.1:54706 - "POST /node/69c86b5a123b47fd237714b7 HTTP/1.0" 202 Accepted 2026-03-30 23:59:28,371 - lava_callback - INFO - Starting async job submit for node 69c86b5a123b47fd237714b7 2026-03-30 23:59:28,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:59:28,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86b5a123b47fd237714b7 HTTP/1.1" 200 None 2026-03-30 23:59:28,391 - lava_callback - DEBUG - Processing node 69c86b5a123b47fd237714b7: baseline-arm64-clabbe 2026-03-30 23:59:28,391 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86b5a123b47fd237714b7 2026-03-30 23:59:28,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:59:28,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86b5a123b47fd237714b7 HTTP/1.1" 200 None 2026-03-30 23:59:28,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:59:28,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-30 23:59:28,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-30 23:59:28,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86b5a123b47fd237714b7 HTTP/1.1" 200 None 2026-03-30 23:59:28,467 - lava_callback - ERROR - Error processing callback for node 69c86b5a123b47fd237714b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48408 - "GET / HTTP/1.0" 200 OK 2026-03-31 00:00:38,005 - lava_callback - INFO - Received callback for node 69c86ba0123b47fd237714be INFO: 172.20.0.1:48420 - "POST /node/69c86ba0123b47fd237714be HTTP/1.0" 202 Accepted 2026-03-31 00:00:38,012 - lava_callback - INFO - Starting async job submit for node 69c86ba0123b47fd237714be 2026-03-31 00:00:38,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:00:38,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86ba0123b47fd237714be HTTP/1.1" 200 None 2026-03-31 00:00:38,053 - lava_callback - DEBUG - Processing node 69c86ba0123b47fd237714be: baseline-arm64-baylibre 2026-03-31 00:00:38,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86ba0123b47fd237714be 2026-03-31 00:00:38,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:00:38,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86ba0123b47fd237714be HTTP/1.1" 200 None 2026-03-31 00:00:38,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:00:38,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-31 00:00:38,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:00:38,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86ba0123b47fd237714be HTTP/1.1" 200 None 2026-03-31 00:00:38,130 - lava_callback - ERROR - Error processing callback for node 69c86ba0123b47fd237714be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35836 - "GET / HTTP/1.0" 200 OK 2026-03-31 00:02:04,397 - lava_callback - INFO - Received callback for node 69c86bf5123b47fd237714cc INFO: 172.20.0.1:40468 - "POST /node/69c86bf5123b47fd237714cc HTTP/1.0" 202 Accepted 2026-03-31 00:02:04,403 - lava_callback - INFO - Starting async job submit for node 69c86bf5123b47fd237714cc 2026-03-31 00:02:04,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:02:04,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86bf5123b47fd237714cc HTTP/1.1" 200 None 2026-03-31 00:02:04,418 - lava_callback - DEBUG - Processing node 69c86bf5123b47fd237714cc: baseline-arm64-clabbe 2026-03-31 00:02:04,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86bf5123b47fd237714cc 2026-03-31 00:02:04,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:02:04,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86bf5123b47fd237714cc HTTP/1.1" 200 None 2026-03-31 00:02:04,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:02:04,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-31 00:02:04,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:02:04,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86bf5123b47fd237714cc HTTP/1.1" 200 None 2026-03-31 00:02:04,483 - lava_callback - ERROR - Error processing callback for node 69c86bf5123b47fd237714cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK 2026-03-31 00:03:24,496 - lava_callback - INFO - Received callback for node 69c86c40123b47fd237714dc INFO: 172.20.0.1:50792 - "POST /node/69c86c40123b47fd237714dc HTTP/1.0" 202 Accepted 2026-03-31 00:03:24,502 - lava_callback - INFO - Starting async job submit for node 69c86c40123b47fd237714dc 2026-03-31 00:03:24,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:03:24,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86c40123b47fd237714dc HTTP/1.1" 200 None 2026-03-31 00:03:24,524 - lava_callback - DEBUG - Processing node 69c86c40123b47fd237714dc: baseline-arm64-clabbe 2026-03-31 00:03:24,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86c40123b47fd237714dc 2026-03-31 00:03:24,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:03:24,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86c40123b47fd237714dc HTTP/1.1" 200 None 2026-03-31 00:03:24,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:03:24,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-31 00:03:24,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:03:24,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86c40123b47fd237714dc HTTP/1.1" 200 None 2026-03-31 00:03:24,592 - lava_callback - ERROR - Error processing callback for node 69c86c40123b47fd237714dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40078 - "GET / HTTP/1.0" 200 OK 2026-03-31 00:04:38,387 - lava_callback - INFO - Received callback for node 69c86c85123b47fd237714e3 INFO: 172.20.0.1:40092 - "POST /node/69c86c85123b47fd237714e3 HTTP/1.0" 202 Accepted 2026-03-31 00:04:38,393 - lava_callback - INFO - Starting async job submit for node 69c86c85123b47fd237714e3 2026-03-31 00:04:38,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:04:38,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86c85123b47fd237714e3 HTTP/1.1" 200 None 2026-03-31 00:04:38,411 - lava_callback - DEBUG - Processing node 69c86c85123b47fd237714e3: baseline-arm64-baylibre 2026-03-31 00:04:38,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86c85123b47fd237714e3 2026-03-31 00:04:38,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:04:38,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86c85123b47fd237714e3 HTTP/1.1" 200 None 2026-03-31 00:04:38,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:04:38,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-31 00:04:38,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:04:38,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86c85123b47fd237714e3 HTTP/1.1" 200 None 2026-03-31 00:04:38,469 - lava_callback - ERROR - Error processing callback for node 69c86c85123b47fd237714e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33644 - "GET / HTTP/1.0" 200 OK 2026-03-31 00:06:04,558 - lava_callback - INFO - Received callback for node 69c86cd8123b47fd237714fa INFO: 172.20.0.1:51558 - "POST /node/69c86cd8123b47fd237714fa HTTP/1.0" 202 Accepted 2026-03-31 00:06:04,564 - lava_callback - INFO - Starting async job submit for node 69c86cd8123b47fd237714fa 2026-03-31 00:06:04,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:06:04,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86cd8123b47fd237714fa HTTP/1.1" 200 None 2026-03-31 00:06:04,586 - lava_callback - DEBUG - Processing node 69c86cd8123b47fd237714fa: baseline-arm64-clabbe 2026-03-31 00:06:04,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86cd8123b47fd237714fa 2026-03-31 00:06:04,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:06:04,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86cd8123b47fd237714fa HTTP/1.1" 200 None 2026-03-31 00:06:04,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:06:04,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-31 00:06:04,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:06:04,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86cd8123b47fd237714fa HTTP/1.1" 200 None 2026-03-31 00:06:04,651 - lava_callback - ERROR - Error processing callback for node 69c86cd8123b47fd237714fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46050 - "GET / HTTP/1.0" 200 OK 2026-03-31 00:06:58,393 - lava_callback - INFO - Received callback for node 69c86d1e123b47fd23771502 INFO: 172.20.0.1:46056 - "POST /node/69c86d1e123b47fd23771502 HTTP/1.0" 202 Accepted 2026-03-31 00:06:58,398 - lava_callback - INFO - Starting async job submit for node 69c86d1e123b47fd23771502 2026-03-31 00:06:58,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:06:58,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86d1e123b47fd23771502 HTTP/1.1" 200 None 2026-03-31 00:06:58,416 - lava_callback - DEBUG - Processing node 69c86d1e123b47fd23771502: baseline-arm64-baylibre 2026-03-31 00:06:58,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86d1e123b47fd23771502 2026-03-31 00:06:58,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:06:58,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86d1e123b47fd23771502 HTTP/1.1" 200 None 2026-03-31 00:06:58,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:06:58,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-31 00:06:58,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:06:58,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86d1e123b47fd23771502 HTTP/1.1" 200 None 2026-03-31 00:06:58,471 - lava_callback - ERROR - Error processing callback for node 69c86d1e123b47fd23771502: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49934 - "GET / HTTP/1.0" 200 OK 2026-03-31 00:08:18,413 - lava_callback - INFO - Received callback for node 69c86d6b123b47fd23771514 INFO: 172.20.0.1:49948 - "POST /node/69c86d6b123b47fd23771514 HTTP/1.0" 202 Accepted 2026-03-31 00:08:18,419 - lava_callback - INFO - Starting async job submit for node 69c86d6b123b47fd23771514 2026-03-31 00:08:18,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:08:18,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86d6b123b47fd23771514 HTTP/1.1" 200 None 2026-03-31 00:08:18,444 - lava_callback - DEBUG - Processing node 69c86d6b123b47fd23771514: baseline-arm64-baylibre 2026-03-31 00:08:18,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86d6b123b47fd23771514 2026-03-31 00:08:18,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:08:18,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86d6b123b47fd23771514 HTTP/1.1" 200 None 2026-03-31 00:08:18,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:08:18,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-31 00:08:18,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:08:18,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86d6b123b47fd23771514 HTTP/1.1" 200 None 2026-03-31 00:08:18,503 - lava_callback - ERROR - Error processing callback for node 69c86d6b123b47fd23771514: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40662 - "GET / HTTP/1.0" 200 OK 2026-03-31 00:09:38,487 - lava_callback - INFO - Received callback for node 69c86db7123b47fd23771523 INFO: 172.20.0.1:40670 - "POST /node/69c86db7123b47fd23771523 HTTP/1.0" 202 Accepted 2026-03-31 00:09:38,492 - lava_callback - INFO - Starting async job submit for node 69c86db7123b47fd23771523 2026-03-31 00:09:38,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:09:38,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86db7123b47fd23771523 HTTP/1.1" 200 None 2026-03-31 00:09:38,508 - lava_callback - DEBUG - Processing node 69c86db7123b47fd23771523: baseline-arm64-baylibre 2026-03-31 00:09:38,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86db7123b47fd23771523 2026-03-31 00:09:38,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:09:38,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86db7123b47fd23771523 HTTP/1.1" 200 None 2026-03-31 00:09:38,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:09:38,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-31 00:09:38,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:09:38,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86db7123b47fd23771523 HTTP/1.1" 200 None 2026-03-31 00:09:38,587 - lava_callback - ERROR - Error processing callback for node 69c86db7123b47fd23771523: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35392 - "GET / HTTP/1.0" 200 OK 2026-03-31 00:11:04,784 - lava_callback - INFO - Received callback for node 69c86e07123b47fd23771537 INFO: 172.20.0.1:59376 - "POST /node/69c86e07123b47fd23771537 HTTP/1.0" 202 Accepted 2026-03-31 00:11:04,790 - lava_callback - INFO - Starting async job submit for node 69c86e07123b47fd23771537 2026-03-31 00:11:04,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:11:04,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86e07123b47fd23771537 HTTP/1.1" 200 None 2026-03-31 00:11:04,805 - lava_callback - DEBUG - Processing node 69c86e07123b47fd23771537: baseline-arm64-clabbe 2026-03-31 00:11:04,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86e07123b47fd23771537 2026-03-31 00:11:04,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:11:04,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86e07123b47fd23771537 HTTP/1.1" 200 None 2026-03-31 00:11:04,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:11:04,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-31 00:11:04,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:11:04,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86e07123b47fd23771537 HTTP/1.1" 200 None 2026-03-31 00:11:04,862 - lava_callback - ERROR - Error processing callback for node 69c86e07123b47fd23771537: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET /node/6985c49a71989fb141498081%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43304 - "GET /node/693e1e3c407f32424eb574ff%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54642 - "GET / HTTP/1.0" 200 OK 2026-03-31 00:12:04,858 - lava_callback - INFO - Received callback for node 69c86e52123b47fd23771543 INFO: 172.20.0.1:35372 - "POST /node/69c86e52123b47fd23771543 HTTP/1.0" 202 Accepted 2026-03-31 00:12:04,863 - lava_callback - INFO - Starting async job submit for node 69c86e52123b47fd23771543 2026-03-31 00:12:04,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:12:04,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86e52123b47fd23771543 HTTP/1.1" 200 None 2026-03-31 00:12:04,881 - lava_callback - DEBUG - Processing node 69c86e52123b47fd23771543: baseline-arm64-clabbe 2026-03-31 00:12:04,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69c86e52123b47fd23771543 2026-03-31 00:12:04,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:12:04,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86e52123b47fd23771543 HTTP/1.1" 200 None 2026-03-31 00:12:04,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:12:04,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c2b9626778148209fd337b HTTP/1.1" 200 None 2026-03-31 00:12:04,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-31 00:12:04,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c86e52123b47fd23771543 HTTP/1.1" 200 None 2026-03-31 00:12:04,939 - lava_callback - ERROR - Error processing callback for node 69c86e52123b47fd23771543: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58346 - "GET /node/693b3e804b47c3f87266e43c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58348 - "GET /node/693ae821fee8383e92b65678%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]