INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50368 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 08:29:16,213 - lava_callback - INFO - Received callback for node 69ba61e6537ae4d3c8236e8a 2026-03-18 08:29:16,220 - lava_callback - INFO - Starting async job submit for node 69ba61e6537ae4d3c8236e8a INFO: 172.21.0.1:50382 - "POST /node/69ba61e6537ae4d3c8236e8a HTTP/1.0" 202 Accepted 2026-03-18 08:29:16,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:29:16,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba61e6537ae4d3c8236e8a HTTP/1.1" 200 None 2026-03-18 08:29:16,265 - lava_callback - DEBUG - Processing node 69ba61e6537ae4d3c8236e8a: baseline-arm 2026-03-18 08:29:16,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50390 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:29:16,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:29:16,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ba61e6537ae4d3c8236e8a/log.txt.gz 2026-03-18 08:29:16,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:29:16,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:29:16,913 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba61e6537ae4d3c8236e8a/lava-logs.yaml 2026-03-18 08:29:16,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:29:17,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:29:17,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba61e6537ae4d3c8236e8a/lava_callback.json.gz 2026-03-18 08:29:17,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:29:17,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba61e6537ae4d3c8236e8a HTTP/1.1" 200 None 2026-03-18 08:29:17,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:29:17,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f73537ae4d3c8236e4c HTTP/1.1" 200 None 2026-03-18 08:29:17,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:29:17,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba61e6537ae4d3c8236e8a HTTP/1.1" 200 None 2026-03-18 08:29:17,186 - lava_callback - INFO - Completed processing callback for node 69ba61e6537ae4d3c8236e8a INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45558 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:29:47,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:29:47,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:37:58,910 - lava_callback - INFO - Received callback for node 69ba6454537ae4d3c823745f INFO: 172.21.0.1:58190 - "POST /node/69ba6454537ae4d3c823745f HTTP/1.0" 202 Accepted 2026-03-18 08:37:58,916 - lava_callback - INFO - Starting async job submit for node 69ba6454537ae4d3c823745f 2026-03-18 08:37:58,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:37:58,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6454537ae4d3c823745f HTTP/1.1" 200 None 2026-03-18 08:37:58,934 - lava_callback - DEBUG - Processing node 69ba6454537ae4d3c823745f: baseline-arm 2026-03-18 08:37:58,939 - lava_callback - WARNING - Failed to upload log 2026-03-18 08:37:58,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:37:59,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:37:59,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6454537ae4d3c823745f/lava-logs.yaml 2026-03-18 08:37:59,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:37:59,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:37:59,185 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6454537ae4d3c823745f/lava_callback.json.gz 2026-03-18 08:37:59,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:37:59,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6454537ae4d3c823745f HTTP/1.1" 200 None 2026-03-18 08:37:59,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:37:59,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:37:59,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:37:59,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6454537ae4d3c823745f HTTP/1.1" 200 None 2026-03-18 08:37:59,280 - lava_callback - INFO - Completed processing callback for node 69ba6454537ae4d3c823745f INFO: 172.21.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35158 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:38:14,909 - lava_callback - INFO - Received callback for node 69ba6455537ae4d3c8237462 INFO: 172.21.0.1:41696 - "POST /node/69ba6455537ae4d3c8237462 HTTP/1.0" 202 Accepted 2026-03-18 08:38:14,959 - lava_callback - INFO - Starting async job submit for node 69ba6455537ae4d3c8237462 2026-03-18 08:38:14,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:38:15,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6455537ae4d3c8237462 HTTP/1.1" 200 None 2026-03-18 08:38:15,003 - lava_callback - DEBUG - Processing node 69ba6455537ae4d3c8237462: baseline-arm 2026-03-18 08:38:15,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:41700 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 08:38:15,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:38:15,283 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6455537ae4d3c8237462/log.txt.gz 2026-03-18 08:38:15,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:38:15,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:38:15,567 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6455537ae4d3c8237462/lava-logs.yaml 2026-03-18 08:38:15,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:38:15,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:38:15,705 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6455537ae4d3c8237462/lava_callback.json.gz 2026-03-18 08:38:15,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:38:15,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6455537ae4d3c8237462 HTTP/1.1" 200 None 2026-03-18 08:38:15,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:38:15,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:38:15,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:38:15,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6455537ae4d3c8237462 HTTP/1.1" 200 None 2026-03-18 08:38:15,823 - lava_callback - INFO - Completed processing callback for node 69ba6455537ae4d3c8237462 INFO: 172.21.0.1:41702 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:38:17,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:38:17,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:38:33,936 - lava_callback - INFO - Received callback for node 69ba6458537ae4d3c823746b INFO: 172.21.0.1:46620 - "POST /node/69ba6458537ae4d3c823746b HTTP/1.0" 202 Accepted 2026-03-18 08:38:33,948 - lava_callback - INFO - Starting async job submit for node 69ba6458537ae4d3c823746b 2026-03-18 08:38:33,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:38:34,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6458537ae4d3c823746b HTTP/1.1" 200 None 2026-03-18 08:38:34,022 - lava_callback - DEBUG - Processing node 69ba6458537ae4d3c823746b: baseline-arm 2026-03-18 08:38:34,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:38:34,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:38:34,289 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6458537ae4d3c823746b/log.txt.gz 2026-03-18 08:38:34,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:38:34,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:38:34,547 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6458537ae4d3c823746b/lava-logs.yaml 2026-03-18 08:38:34,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:38:34,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:38:34,687 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6458537ae4d3c823746b/lava_callback.json.gz 2026-03-18 08:38:34,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:38:34,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6458537ae4d3c823746b HTTP/1.1" 200 None 2026-03-18 08:38:34,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:38:34,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:38:34,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:38:34,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6458537ae4d3c823746b HTTP/1.1" 200 None 2026-03-18 08:38:34,775 - lava_callback - INFO - Completed processing callback for node 69ba6458537ae4d3c823746b INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:38:47,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:38:47,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:39:06,844 - lava_callback - INFO - Received callback for node 69ba6453537ae4d3c823745c INFO: 172.21.0.1:41972 - "POST /node/69ba6453537ae4d3c823745c HTTP/1.0" 202 Accepted 2026-03-18 08:39:06,854 - lava_callback - INFO - Starting async job submit for node 69ba6453537ae4d3c823745c 2026-03-18 08:39:06,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:06,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6453537ae4d3c823745c HTTP/1.1" 200 None 2026-03-18 08:39:06,896 - lava_callback - DEBUG - Processing node 69ba6453537ae4d3c823745c: baseline-arm 2026-03-18 08:39:07,134 - lava_callback - INFO - Received callback for node 69ba6457537ae4d3c8237468 2026-03-18 08:39:07,141 - lava_callback - INFO - Starting async job submit for node 69ba6457537ae4d3c8237468 INFO: 172.21.0.1:41988 - "POST /node/69ba6457537ae4d3c8237468 HTTP/1.0" 202 Accepted 2026-03-18 08:39:07,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:07,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:07,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6457537ae4d3c8237468 HTTP/1.1" 200 None 2026-03-18 08:39:07,191 - lava_callback - DEBUG - Processing node 69ba6457537ae4d3c8237468: baseline-arm 2026-03-18 08:39:07,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:07,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6453537ae4d3c823745c/log.txt.gz 2026-03-18 08:39:07,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:07,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:07,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:07,831 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6457537ae4d3c8237468/log.txt.gz 2026-03-18 08:39:07,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:07,871 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6453537ae4d3c823745c/lava-logs.yaml 2026-03-18 08:39:07,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:07,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:08,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:08,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6453537ae4d3c823745c/lava_callback.json.gz 2026-03-18 08:39:08,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:08,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6453537ae4d3c823745c HTTP/1.1" 200 None 2026-03-18 08:39:08,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:08,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:08,243 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6457537ae4d3c8237468/lava-logs.yaml 2026-03-18 08:39:08,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:39:08,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:08,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:08,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6453537ae4d3c823745c HTTP/1.1" 200 None 2026-03-18 08:39:08,288 - lava_callback - INFO - Completed processing callback for node 69ba6453537ae4d3c823745c 2026-03-18 08:39:08,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:08,479 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6457537ae4d3c8237468/lava_callback.json.gz 2026-03-18 08:39:08,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:08,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6457537ae4d3c8237468 HTTP/1.1" 200 None 2026-03-18 08:39:08,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:08,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:39:08,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:08,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6457537ae4d3c8237468 HTTP/1.1" 200 None 2026-03-18 08:39:08,609 - lava_callback - INFO - Completed processing callback for node 69ba6457537ae4d3c8237468 INFO: 172.21.0.1:48422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:39:16,877 - lava_callback - INFO - Received callback for node 69ba6465537ae4d3c823748f INFO: 172.21.0.1:48450 - "POST /node/69ba6465537ae4d3c823748f HTTP/1.0" 202 Accepted 2026-03-18 08:39:16,883 - lava_callback - INFO - Starting async job submit for node 69ba6465537ae4d3c823748f 2026-03-18 08:39:16,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:16,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6465537ae4d3c823748f HTTP/1.1" 200 None 2026-03-18 08:39:16,928 - lava_callback - DEBUG - Processing node 69ba6465537ae4d3c823748f: baseline-arm-broonie 2026-03-18 08:39:17,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:17,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:17,272 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6465537ae4d3c823748f/log.txt.gz 2026-03-18 08:39:17,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:17,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-18 08:39:17,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:17,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:17,579 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6465537ae4d3c823748f/lava-logs.yaml 2026-03-18 08:39:17,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:17,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:17,737 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6465537ae4d3c823748f/lava_callback.json.gz 2026-03-18 08:39:17,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:17,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6465537ae4d3c823748f HTTP/1.1" 200 None 2026-03-18 08:39:17,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:17,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:39:17,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:17,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6465537ae4d3c823748f HTTP/1.1" 200 None 2026-03-18 08:39:17,827 - lava_callback - INFO - Completed processing callback for node 69ba6465537ae4d3c823748f 2026-03-18 08:39:18,381 - lava_callback - INFO - Received callback for node 69ba6467537ae4d3c8237493 INFO: 172.21.0.1:48460 - "POST /node/69ba6467537ae4d3c8237493 HTTP/1.0" 202 Accepted 2026-03-18 08:39:18,387 - lava_callback - INFO - Starting async job submit for node 69ba6467537ae4d3c8237493 2026-03-18 08:39:18,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:18,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6467537ae4d3c8237493 HTTP/1.1" 200 None 2026-03-18 08:39:18,426 - lava_callback - DEBUG - Processing node 69ba6467537ae4d3c8237493: baseline-arm-broonie 2026-03-18 08:39:18,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:18,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:18,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6467537ae4d3c8237493/log.txt.gz 2026-03-18 08:39:18,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:19,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:19,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6467537ae4d3c8237493/lava-logs.yaml 2026-03-18 08:39:19,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:19,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:19,238 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6467537ae4d3c8237493/lava_callback.json.gz 2026-03-18 08:39:19,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:19,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6467537ae4d3c8237493 HTTP/1.1" 200 None 2026-03-18 08:39:19,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:19,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:39:19,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:19,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6467537ae4d3c8237493 HTTP/1.1" 200 None 2026-03-18 08:39:19,324 - lava_callback - INFO - Completed processing callback for node 69ba6467537ae4d3c8237493 2026-03-18 08:39:22,932 - lava_callback - INFO - Received callback for node 69ba6477537ae4d3c82374ea INFO: 172.21.0.1:51724 - "POST /node/69ba6477537ae4d3c82374ea HTTP/1.0" 202 Accepted 2026-03-18 08:39:22,938 - lava_callback - INFO - Starting async job submit for node 69ba6477537ae4d3c82374ea 2026-03-18 08:39:22,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:22,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6477537ae4d3c82374ea HTTP/1.1" 200 None 2026-03-18 08:39:22,983 - lava_callback - DEBUG - Processing node 69ba6477537ae4d3c82374ea: baseline-arm-pengutronix 2026-03-18 08:39:23,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:23,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:23,252 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba6477537ae4d3c82374ea/log.txt.gz 2026-03-18 08:39:23,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:23,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:23,505 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba6477537ae4d3c82374ea/lava-logs.yaml 2026-03-18 08:39:23,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:23,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:23,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba6477537ae4d3c82374ea/lava_callback.json.gz 2026-03-18 08:39:23,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:23,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6477537ae4d3c82374ea HTTP/1.1" 200 None 2026-03-18 08:39:23,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:23,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:39:23,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:23,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6477537ae4d3c82374ea HTTP/1.1" 200 None 2026-03-18 08:39:23,722 - lava_callback - INFO - Completed processing callback for node 69ba6477537ae4d3c82374ea 2026-03-18 08:39:23,918 - lava_callback - INFO - Received callback for node 69ba647a537ae4d3c82374fb INFO: 172.21.0.1:51736 - "POST /node/69ba647a537ae4d3c82374fb HTTP/1.0" 202 Accepted 2026-03-18 08:39:23,970 - lava_callback - INFO - Starting async job submit for node 69ba647a537ae4d3c82374fb 2026-03-18 08:39:24,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:24,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba647a537ae4d3c82374fb HTTP/1.1" 200 None 2026-03-18 08:39:24,016 - lava_callback - DEBUG - Processing node 69ba647a537ae4d3c82374fb: baseline-arm-pengutronix 2026-03-18 08:39:24,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:24,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:24,268 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba647a537ae4d3c82374fb/log.txt.gz 2026-03-18 08:39:24,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:24,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:24,496 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba647a537ae4d3c82374fb/lava-logs.yaml 2026-03-18 08:39:24,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:24,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:24,617 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba647a537ae4d3c82374fb/lava_callback.json.gz 2026-03-18 08:39:24,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:24,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba647a537ae4d3c82374fb HTTP/1.1" 200 None 2026-03-18 08:39:24,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:24,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:39:24,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:24,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba647a537ae4d3c82374fb HTTP/1.1" 200 None 2026-03-18 08:39:24,698 - lava_callback - INFO - Completed processing callback for node 69ba647a537ae4d3c82374fb INFO: 172.21.0.1:51752 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:39:27,849 - lava_callback - INFO - Received callback for node 69ba6474537ae4d3c82374df INFO: 172.21.0.1:51766 - "POST /node/69ba6474537ae4d3c82374df HTTP/1.0" 202 Accepted 2026-03-18 08:39:27,858 - lava_callback - INFO - Starting async job submit for node 69ba6474537ae4d3c82374df 2026-03-18 08:39:27,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:27,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6474537ae4d3c82374df HTTP/1.1" 200 None 2026-03-18 08:39:27,947 - lava_callback - DEBUG - Processing node 69ba6474537ae4d3c82374df: baseline-arm-kontron 2026-03-18 08:39:28,146 - lava_callback - WARNING - Failed to upload log 2026-03-18 08:39:28,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:28,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:28,478 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ba6474537ae4d3c82374df/lava-logs.yaml 2026-03-18 08:39:28,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:28,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:28,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ba6474537ae4d3c82374df/lava_callback.json.gz 2026-03-18 08:39:28,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:28,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6474537ae4d3c82374df HTTP/1.1" 200 None 2026-03-18 08:39:28,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:28,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:39:28,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:28,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6474537ae4d3c82374df HTTP/1.1" 200 None 2026-03-18 08:39:29,024 - lava_callback - INFO - Completed processing callback for node 69ba6474537ae4d3c82374df 2026-03-18 08:39:33,318 - lava_callback - INFO - Received callback for node 69ba6468537ae4d3c8237497 INFO: 172.21.0.1:37228 - "POST /node/69ba6468537ae4d3c8237497 HTTP/1.0" 202 Accepted 2026-03-18 08:39:33,328 - lava_callback - INFO - Starting async job submit for node 69ba6468537ae4d3c8237497 2026-03-18 08:39:33,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:33,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6468537ae4d3c8237497 HTTP/1.1" 200 None 2026-03-18 08:39:33,376 - lava_callback - DEBUG - Processing node 69ba6468537ae4d3c8237497: baseline-arm-broonie 2026-03-18 08:39:33,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:34,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:34,024 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6468537ae4d3c8237497/log.txt.gz 2026-03-18 08:39:34,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:34,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:34,368 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6468537ae4d3c8237497/lava-logs.yaml 2026-03-18 08:39:34,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:34,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:34,801 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6468537ae4d3c8237497/lava_callback.json.gz 2026-03-18 08:39:34,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:34,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6468537ae4d3c8237497 HTTP/1.1" 200 None 2026-03-18 08:39:34,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:34,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:39:34,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:34,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6468537ae4d3c8237497 HTTP/1.1" 200 None 2026-03-18 08:39:34,923 - lava_callback - INFO - Completed processing callback for node 69ba6468537ae4d3c8237497 INFO: 172.21.0.1:37236 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:39:46,473 - lava_callback - INFO - Received callback for node 69ba646c537ae4d3c82374c6 INFO: 172.21.0.1:43348 - "POST /node/69ba646c537ae4d3c82374c6 HTTP/1.0" 202 Accepted 2026-03-18 08:39:46,479 - lava_callback - INFO - Starting async job submit for node 69ba646c537ae4d3c82374c6 2026-03-18 08:39:46,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:43362 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:39:46,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba646c537ae4d3c82374c6 HTTP/1.1" 200 None 2026-03-18 08:39:46,528 - lava_callback - DEBUG - Processing node 69ba646c537ae4d3c82374c6: baseline-arm-clabbe 2026-03-18 08:39:46,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:47,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:47,054 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba646c537ae4d3c82374c6/log.txt.gz 2026-03-18 08:39:47,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:47,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:47,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-18 08:39:47,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:47,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba646c537ae4d3c82374c6/lava-logs.yaml 2026-03-18 08:39:47,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:47,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:47,793 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba646c537ae4d3c82374c6/lava_callback.json.gz 2026-03-18 08:39:47,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:47,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba646c537ae4d3c82374c6 HTTP/1.1" 200 None 2026-03-18 08:39:47,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:47,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:39:47,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:47,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba646c537ae4d3c82374c6 HTTP/1.1" 200 None 2026-03-18 08:39:47,891 - lava_callback - INFO - Completed processing callback for node 69ba646c537ae4d3c82374c6 INFO: 172.21.0.1:58822 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:39:56,642 - lava_callback - INFO - Received callback for node 69ba6464537ae4d3c8237488 INFO: 172.21.0.1:58830 - "POST /node/69ba6464537ae4d3c8237488 HTTP/1.0" 202 Accepted 2026-03-18 08:39:56,652 - lava_callback - INFO - Starting async job submit for node 69ba6464537ae4d3c8237488 2026-03-18 08:39:56,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:56,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6464537ae4d3c8237488 HTTP/1.1" 200 None 2026-03-18 08:39:56,724 - lava_callback - DEBUG - Processing node 69ba6464537ae4d3c8237488: baseline-arm-broonie 2026-03-18 08:39:56,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:57,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:57,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6464537ae4d3c8237488/log.txt.gz 2026-03-18 08:39:57,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:57,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:57,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6464537ae4d3c8237488/lava-logs.yaml 2026-03-18 08:39:57,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:39:57,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:39:57,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ba6464537ae4d3c8237488/lava_callback.json.gz 2026-03-18 08:39:57,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:57,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6464537ae4d3c8237488 HTTP/1.1" 200 None 2026-03-18 08:39:57,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:57,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:39:57,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:39:57,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6464537ae4d3c8237488 HTTP/1.1" 200 None 2026-03-18 08:39:57,953 - lava_callback - INFO - Completed processing callback for node 69ba6464537ae4d3c8237488 INFO: 172.21.0.1:49306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:40:13,282 - lava_callback - INFO - Received callback for node 69ba64d5537ae4d3c82375a9 INFO: 172.21.0.1:34068 - "POST /node/69ba64d5537ae4d3c82375a9 HTTP/1.0" 202 Accepted 2026-03-18 08:40:13,291 - lava_callback - INFO - Starting async job submit for node 69ba64d5537ae4d3c82375a9 2026-03-18 08:40:13,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:40:13,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64d5537ae4d3c82375a9 HTTP/1.1" 200 None 2026-03-18 08:40:13,325 - lava_callback - DEBUG - Processing node 69ba64d5537ae4d3c82375a9: baseline-arm 2026-03-18 08:40:13,331 - lava_callback - WARNING - Failed to upload log 2026-03-18 08:40:13,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:40:13,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:40:13,448 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba64d5537ae4d3c82375a9/lava-logs.yaml 2026-03-18 08:40:13,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:40:13,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:40:13,878 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba64d5537ae4d3c82375a9/lava_callback.json.gz 2026-03-18 08:40:13,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:40:13,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64d5537ae4d3c82375a9 HTTP/1.1" 200 None 2026-03-18 08:40:13,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:40:13,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:40:13,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:40:13,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba64d5537ae4d3c82375a9 HTTP/1.1" 200 None 2026-03-18 08:40:13,981 - lava_callback - INFO - Completed processing callback for node 69ba64d5537ae4d3c82375a9 INFO: 172.21.0.1:34082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:40:17,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:40:17,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-18 08:40:24,433 - lava_callback - INFO - Received callback for node 69ba6478537ae4d3c82374f1 INFO: 172.21.0.1:57012 - "POST /node/69ba6478537ae4d3c82374f1 HTTP/1.0" 202 Accepted 2026-03-18 08:40:24,439 - lava_callback - INFO - Starting async job submit for node 69ba6478537ae4d3c82374f1 2026-03-18 08:40:24,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:40:24,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6478537ae4d3c82374f1 HTTP/1.1" 200 None 2026-03-18 08:40:24,476 - lava_callback - DEBUG - Processing node 69ba6478537ae4d3c82374f1: baseline-arm-pengutronix 2026-03-18 08:40:24,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:40:25,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:40:25,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba6478537ae4d3c82374f1/log.txt.gz 2026-03-18 08:40:25,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:40:25,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:40:25,795 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba6478537ae4d3c82374f1/lava-logs.yaml 2026-03-18 08:40:25,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:40:25,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:40:25,975 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba6478537ae4d3c82374f1/lava_callback.json.gz 2026-03-18 08:40:26,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:40:26,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6478537ae4d3c82374f1 HTTP/1.1" 200 None 2026-03-18 08:40:26,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:40:26,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:40:26,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:40:26,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6478537ae4d3c82374f1 HTTP/1.1" 200 None 2026-03-18 08:40:26,224 - lava_callback - INFO - Completed processing callback for node 69ba6478537ae4d3c82374f1 INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:40:47,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:40:47,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38726 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:40:57,376 - lava_callback - INFO - Received callback for node 69ba6496537ae4d3c823752c INFO: 172.21.0.1:38736 - "POST /node/69ba6496537ae4d3c823752c HTTP/1.0" 202 Accepted 2026-03-18 08:40:57,386 - lava_callback - INFO - Starting async job submit for node 69ba6496537ae4d3c823752c 2026-03-18 08:40:57,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:40:57,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6496537ae4d3c823752c HTTP/1.1" 200 None 2026-03-18 08:40:57,486 - lava_callback - DEBUG - Processing node 69ba6496537ae4d3c823752c: ltp-dio 2026-03-18 08:40:58,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:40:58,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:40:58,542 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69ba6496537ae4d3c823752c/log.txt.gz 2026-03-18 08:40:58,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:40:59,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:40:59,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69ba6496537ae4d3c823752c/lava-logs.yaml 2026-03-18 08:40:59,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:41:00,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:41:00,034 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69ba6496537ae4d3c823752c/lava_callback.json.gz 2026-03-18 08:41:00,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:41:00,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6496537ae4d3c823752c HTTP/1.1" 200 None 2026-03-18 08:41:00,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:41:00,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:41:00,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:41:00,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6496537ae4d3c823752c HTTP/1.1" 200 None 2026-03-18 08:41:00,190 - lava_callback - INFO - Completed processing callback for node 69ba6496537ae4d3c823752c INFO: 172.21.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33868 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:41:17,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:41:17,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38138 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:41:33,534 - lava_callback - INFO - Received callback for node 69ba646d537ae4d3c82374ca INFO: 172.21.0.1:56872 - "POST /node/69ba646d537ae4d3c82374ca HTTP/1.0" 202 Accepted 2026-03-18 08:41:33,540 - lava_callback - INFO - Starting async job submit for node 69ba646d537ae4d3c82374ca 2026-03-18 08:41:33,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:41:33,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba646d537ae4d3c82374ca HTTP/1.1" 200 None 2026-03-18 08:41:33,581 - lava_callback - DEBUG - Processing node 69ba646d537ae4d3c82374ca: baseline-arm-clabbe 2026-03-18 08:41:33,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:41:34,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:41:34,017 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba646d537ae4d3c82374ca/log.txt.gz 2026-03-18 08:41:34,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:41:34,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:41:34,346 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba646d537ae4d3c82374ca/lava-logs.yaml 2026-03-18 08:41:34,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:41:34,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:41:34,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba646d537ae4d3c82374ca/lava_callback.json.gz 2026-03-18 08:41:34,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:41:34,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba646d537ae4d3c82374ca HTTP/1.1" 200 None 2026-03-18 08:41:34,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:41:34,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:41:34,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:41:34,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba646d537ae4d3c82374ca HTTP/1.1" 200 None 2026-03-18 08:41:34,651 - lava_callback - INFO - Completed processing callback for node 69ba646d537ae4d3c82374ca INFO: 172.21.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:41:47,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:41:47,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:42:33,395 - lava_callback - INFO - Received callback for node 69ba648d537ae4d3c8237523 INFO: 172.21.0.1:35876 - "POST /node/69ba648d537ae4d3c8237523 HTTP/1.0" 202 Accepted 2026-03-18 08:42:33,401 - lava_callback - INFO - Starting async job submit for node 69ba648d537ae4d3c8237523 2026-03-18 08:42:33,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:33,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba648d537ae4d3c8237523 HTTP/1.1" 200 None 2026-03-18 08:42:33,446 - lava_callback - DEBUG - Processing node 69ba648d537ae4d3c8237523: ltp-containers 2026-03-18 08:42:33,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:42:34,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:42:34,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69ba648d537ae4d3c8237523/log.txt.gz 2026-03-18 08:42:34,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:42:34,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:42:34,607 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69ba648d537ae4d3c8237523/lava-logs.yaml 2026-03-18 08:42:34,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:42:34,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:42:34,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69ba648d537ae4d3c8237523/lava_callback.json.gz 2026-03-18 08:42:34,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:34,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba648d537ae4d3c8237523 HTTP/1.1" 200 None 2026-03-18 08:42:34,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:34,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:42:34,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:34,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba648d537ae4d3c8237523 HTTP/1.1" 200 None 2026-03-18 08:42:34,937 - lava_callback - INFO - Completed processing callback for node 69ba648d537ae4d3c8237523 2026-03-18 08:42:34,995 - lava_callback - INFO - Received callback for node 69ba6495537ae4d3c8237529 INFO: 172.21.0.1:35886 - "POST /node/69ba6495537ae4d3c8237529 HTTP/1.0" 202 Accepted 2026-03-18 08:42:35,008 - lava_callback - INFO - Starting async job submit for node 69ba6495537ae4d3c8237529 2026-03-18 08:42:35,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:35,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6495537ae4d3c8237529 HTTP/1.1" 200 None 2026-03-18 08:42:35,086 - lava_callback - DEBUG - Processing node 69ba6495537ae4d3c8237529: ltp-cve 2026-03-18 08:42:35,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:42:35,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:42:35,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69ba6495537ae4d3c8237529/log.txt.gz 2026-03-18 08:42:36,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:42:36,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:42:36,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69ba6495537ae4d3c8237529/lava-logs.yaml 2026-03-18 08:42:36,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35898 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:42:36,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:42:36,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69ba6495537ae4d3c8237529/lava_callback.json.gz 2026-03-18 08:42:36,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:36,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6495537ae4d3c8237529 HTTP/1.1" 200 None 2026-03-18 08:42:36,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:36,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:42:36,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:36,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6495537ae4d3c8237529 HTTP/1.1" 200 None 2026-03-18 08:42:36,684 - lava_callback - INFO - Completed processing callback for node 69ba6495537ae4d3c8237529 INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:42:47,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:47,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-18 08:42:55,024 - lava_callback - INFO - Received callback for node 69ba648b537ae4d3c8237520 INFO: 172.21.0.1:55272 - "POST /node/69ba648b537ae4d3c8237520 HTTP/1.0" 202 Accepted 2026-03-18 08:42:55,041 - lava_callback - INFO - Starting async job submit for node 69ba648b537ae4d3c8237520 2026-03-18 08:42:55,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:55,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba648b537ae4d3c8237520 HTTP/1.1" 200 None 2026-03-18 08:42:55,123 - lava_callback - DEBUG - Processing node 69ba648b537ae4d3c8237520: ltp-cap_bounds 2026-03-18 08:42:55,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:42:56,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:42:56,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ba648b537ae4d3c8237520/log.txt.gz 2026-03-18 08:42:56,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:42:56,830 - lava_callback - INFO - Received callback for node 69ba64a2537ae4d3c8237547 INFO: 172.21.0.1:55276 - "POST /node/69ba64a2537ae4d3c8237547 HTTP/1.0" 202 Accepted 2026-03-18 08:42:56,844 - lava_callback - INFO - Starting async job submit for node 69ba64a2537ae4d3c8237547 2026-03-18 08:42:56,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:42:56,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:56,906 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ba648b537ae4d3c8237520/lava-logs.yaml 2026-03-18 08:42:56,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:42:56,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64a2537ae4d3c8237547 HTTP/1.1" 200 None 2026-03-18 08:42:56,937 - lava_callback - DEBUG - Processing node 69ba64a2537ae4d3c8237547: ltp-syscalls 2026-03-18 08:42:57,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:42:57,416 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ba648b537ae4d3c8237520/lava_callback.json.gz 2026-03-18 08:42:57,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:57,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba648b537ae4d3c8237520 HTTP/1.1" 200 None 2026-03-18 08:42:57,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:57,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:42:57,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:42:57,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba648b537ae4d3c8237520 HTTP/1.1" 200 None 2026-03-18 08:42:57,766 - lava_callback - INFO - Completed processing callback for node 69ba648b537ae4d3c8237520 2026-03-18 08:42:58,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:42:58,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:42:58,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ba64a2537ae4d3c8237547/log.txt.gz 2026-03-18 08:42:59,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:43:00,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:43:00,143 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ba64a2537ae4d3c8237547/lava-logs.yaml 2026-03-18 08:43:00,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:43:00,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:43:00,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ba64a2537ae4d3c8237547/lava_callback.json.gz 2026-03-18 08:43:00,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:00,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64a2537ae4d3c8237547 HTTP/1.1" 200 None 2026-03-18 08:43:00,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:00,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:43:00,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:00,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba64a2537ae4d3c8237547 HTTP/1.1" 200 None 2026-03-18 08:43:00,679 - lava_callback - INFO - Completed processing callback for node 69ba64a2537ae4d3c8237547 INFO: 172.21.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:43:12,614 - lava_callback - INFO - Received callback for node 69ba6470537ae4d3c82374d6 INFO: 172.21.0.1:44480 - "POST /node/69ba6470537ae4d3c82374d6 HTTP/1.0" 202 Accepted 2026-03-18 08:43:12,624 - lava_callback - INFO - Starting async job submit for node 69ba6470537ae4d3c82374d6 2026-03-18 08:43:12,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:12,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6470537ae4d3c82374d6 HTTP/1.1" 200 None 2026-03-18 08:43:12,692 - lava_callback - DEBUG - Processing node 69ba6470537ae4d3c82374d6: baseline-arm-clabbe 2026-03-18 08:43:13,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:43:13,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:43:13,466 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba6470537ae4d3c82374d6/log.txt.gz 2026-03-18 08:43:13,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:43:13,764 - lava_callback - INFO - Received callback for node 69ba6490537ae4d3c8237526 INFO: 172.21.0.1:44482 - "POST /node/69ba6490537ae4d3c8237526 HTTP/1.0" 202 Accepted 2026-03-18 08:43:13,775 - lava_callback - INFO - Starting async job submit for node 69ba6490537ae4d3c8237526 2026-03-18 08:43:13,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:13,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6490537ae4d3c8237526 HTTP/1.1" 200 None 2026-03-18 08:43:13,843 - lava_callback - DEBUG - Processing node 69ba6490537ae4d3c8237526: ltp-controllers 2026-03-18 08:43:14,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:43:14,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba6470537ae4d3c82374d6/lava-logs.yaml 2026-03-18 08:43:14,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:43:14,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:43:14,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:43:14,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba6470537ae4d3c82374d6/lava_callback.json.gz 2026-03-18 08:43:15,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:15,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6470537ae4d3c82374d6 HTTP/1.1" 200 None 2026-03-18 08:43:15,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:15,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:43:15,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:15,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6470537ae4d3c82374d6 HTTP/1.1" 200 None 2026-03-18 08:43:15,154 - lava_callback - INFO - Completed processing callback for node 69ba6470537ae4d3c82374d6 INFO: 172.21.0.1:44492 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 08:43:15,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:43:15,406 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69ba6490537ae4d3c8237526/log.txt.gz 2026-03-18 08:43:15,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:43:16,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:43:16,471 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69ba6490537ae4d3c8237526/lava-logs.yaml 2026-03-18 08:43:16,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44496 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:43:16,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:43:16,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69ba6490537ae4d3c8237526/lava_callback.json.gz 2026-03-18 08:43:17,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:17,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6490537ae4d3c8237526 HTTP/1.1" 200 None 2026-03-18 08:43:17,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:17,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:43:17,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:17,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6490537ae4d3c8237526 HTTP/1.1" 200 None 2026-03-18 08:43:17,188 - lava_callback - INFO - Completed processing callback for node 69ba6490537ae4d3c8237526 2026-03-18 08:43:17,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:17,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60370 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:43:56,970 - lava_callback - INFO - Received callback for node 69ba6498537ae4d3c8237532 INFO: 172.21.0.1:60378 - "POST /node/69ba6498537ae4d3c8237532 HTTP/1.0" 202 Accepted 2026-03-18 08:43:56,977 - lava_callback - INFO - Starting async job submit for node 69ba6498537ae4d3c8237532 2026-03-18 08:43:57,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:57,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6498537ae4d3c8237532 HTTP/1.1" 200 None 2026-03-18 08:43:57,030 - lava_callback - DEBUG - Processing node 69ba6498537ae4d3c8237532: ltp-fs_bind 2026-03-18 08:43:57,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:43:57,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:43:57,547 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ba6498537ae4d3c8237532/log.txt.gz 2026-03-18 08:43:57,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:43:57,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:43:57,977 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ba6498537ae4d3c8237532/lava-logs.yaml 2026-03-18 08:43:57,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:43:58,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:43:58,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ba6498537ae4d3c8237532/lava_callback.json.gz 2026-03-18 08:43:58,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:58,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6498537ae4d3c8237532 HTTP/1.1" 200 None 2026-03-18 08:43:58,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:58,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:43:58,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:43:58,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6498537ae4d3c8237532 HTTP/1.1" 200 None 2026-03-18 08:43:58,244 - lava_callback - INFO - Completed processing callback for node 69ba6498537ae4d3c8237532 INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54024 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:44:17,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:44:17,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60594 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:44:51,696 - lava_callback - INFO - Received callback for node 69ba6471537ae4d3c82374d9 INFO: 172.21.0.1:59368 - "POST /node/69ba6471537ae4d3c82374d9 HTTP/1.0" 202 Accepted 2026-03-18 08:44:51,702 - lava_callback - INFO - Starting async job submit for node 69ba6471537ae4d3c82374d9 2026-03-18 08:44:51,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:44:51,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6471537ae4d3c82374d9 HTTP/1.1" 200 None 2026-03-18 08:44:51,739 - lava_callback - DEBUG - Processing node 69ba6471537ae4d3c82374d9: baseline-arm-clabbe 2026-03-18 08:44:51,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:44:52,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:44:52,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba6471537ae4d3c82374d9/log.txt.gz 2026-03-18 08:44:52,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:44:52,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:44:52,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba6471537ae4d3c82374d9/lava-logs.yaml 2026-03-18 08:44:52,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:44:52,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:44:52,560 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ba6471537ae4d3c82374d9/lava_callback.json.gz 2026-03-18 08:44:52,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:44:52,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6471537ae4d3c82374d9 HTTP/1.1" 200 None 2026-03-18 08:44:52,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:44:52,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:44:52,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:44:52,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6471537ae4d3c82374d9 HTTP/1.1" 200 None 2026-03-18 08:44:52,649 - lava_callback - INFO - Completed processing callback for node 69ba6471537ae4d3c82374d9 INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:45:17,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:45:17,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39774 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:45:46,363 - lava_callback - INFO - Received callback for node 69b7c32f1727ff69d6f28d20 INFO: 172.21.0.1:54122 - "POST /node/69b7c32f1727ff69d6f28d20 HTTP/1.0" 202 Accepted 2026-03-18 08:45:46,369 - lava_callback - INFO - Starting async job submit for node 69b7c32f1727ff69d6f28d20 2026-03-18 08:45:46,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:45:46,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c32f1727ff69d6f28d20 HTTP/1.1" 200 None 2026-03-18 08:45:46,385 - lava_callback - DEBUG - Processing node 69b7c32f1727ff69d6f28d20: baseline-arm-baylibre 2026-03-18 08:45:46,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c32f1727ff69d6f28d20 2026-03-18 08:45:46,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:45:46,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c32f1727ff69d6f28d20 HTTP/1.1" 200 None 2026-03-18 08:45:46,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:45:46,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 08:45:46,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:45:46,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c32f1727ff69d6f28d20 HTTP/1.1" 200 None 2026-03-18 08:45:46,445 - lava_callback - ERROR - Error processing callback for node 69b7c32f1727ff69d6f28d20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:45:53,469 - lava_callback - INFO - Received callback for node 69ba662b537ae4d3c8237666 INFO: 172.21.0.1:44188 - "POST /node/69ba662b537ae4d3c8237666 HTTP/1.0" 202 Accepted 2026-03-18 08:45:53,475 - lava_callback - INFO - Starting async job submit for node 69ba662b537ae4d3c8237666 2026-03-18 08:45:53,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:45:53,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba662b537ae4d3c8237666 HTTP/1.1" 200 None 2026-03-18 08:45:53,494 - lava_callback - DEBUG - Processing node 69ba662b537ae4d3c8237666: baseline-arm 2026-03-18 08:45:53,499 - lava_callback - WARNING - Failed to upload log 2026-03-18 08:45:53,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:45:53,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:45:53,638 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba662b537ae4d3c8237666/lava-logs.yaml 2026-03-18 08:45:53,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:45:53,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:45:53,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba662b537ae4d3c8237666/lava_callback.json.gz 2026-03-18 08:45:53,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:45:53,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba662b537ae4d3c8237666 HTTP/1.1" 200 None 2026-03-18 08:45:53,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:45:53,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:45:53,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:45:53,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba662b537ae4d3c8237666 HTTP/1.1" 200 None 2026-03-18 08:45:53,842 - lava_callback - INFO - Completed processing callback for node 69ba662b537ae4d3c8237666 INFO: 172.21.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49662 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:46:17,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:17,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:46:33,706 - lava_callback - INFO - Received callback for node 69ba6499537ae4d3c8237535 INFO: 172.21.0.1:50312 - "POST /node/69ba6499537ae4d3c8237535 HTTP/1.0" 202 Accepted 2026-03-18 08:46:33,712 - lava_callback - INFO - Starting async job submit for node 69ba6499537ae4d3c8237535 2026-03-18 08:46:33,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:33,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6499537ae4d3c8237535 HTTP/1.1" 200 None 2026-03-18 08:46:33,752 - lava_callback - DEBUG - Processing node 69ba6499537ae4d3c8237535: ltp-fsx 2026-03-18 08:46:34,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:46:34,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:46:34,254 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69ba6499537ae4d3c8237535/log.txt.gz 2026-03-18 08:46:34,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:46:34,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:46:34,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69ba6499537ae4d3c8237535/lava-logs.yaml 2026-03-18 08:46:34,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:46:34,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:46:34,914 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69ba6499537ae4d3c8237535/lava_callback.json.gz 2026-03-18 08:46:34,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:34,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6499537ae4d3c8237535 HTTP/1.1" 200 None 2026-03-18 08:46:34,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:34,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:46:34,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:35,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6499537ae4d3c8237535 HTTP/1.1" 200 None 2026-03-18 08:46:35,009 - lava_callback - INFO - Completed processing callback for node 69ba6499537ae4d3c8237535 2026-03-18 08:46:35,486 - lava_callback - INFO - Received callback for node 69ba649b537ae4d3c8237538 INFO: 172.21.0.1:50318 - "POST /node/69ba649b537ae4d3c8237538 HTTP/1.0" 202 Accepted 2026-03-18 08:46:35,493 - lava_callback - INFO - Starting async job submit for node 69ba649b537ae4d3c8237538 2026-03-18 08:46:35,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:35,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba649b537ae4d3c8237538 HTTP/1.1" 200 None 2026-03-18 08:46:35,542 - lava_callback - DEBUG - Processing node 69ba649b537ae4d3c8237538: ltp-input 2026-03-18 08:46:35,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:46:35,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:46:36,000 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69ba649b537ae4d3c8237538/log.txt.gz 2026-03-18 08:46:36,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:46:36,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:46:36,439 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69ba649b537ae4d3c8237538/lava-logs.yaml 2026-03-18 08:46:36,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:46:36,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:46:36,636 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69ba649b537ae4d3c8237538/lava_callback.json.gz 2026-03-18 08:46:36,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:36,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba649b537ae4d3c8237538 HTTP/1.1" 200 None 2026-03-18 08:46:36,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:36,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:46:36,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:36,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba649b537ae4d3c8237538 HTTP/1.1" 200 None 2026-03-18 08:46:36,719 - lava_callback - INFO - Completed processing callback for node 69ba649b537ae4d3c8237538 2026-03-18 08:46:37,354 - lava_callback - INFO - Received callback for node 69b7c35b1727ff69d6f28d2b INFO: 172.21.0.1:50344 - "POST /node/69b7c35b1727ff69d6f28d2b HTTP/1.0" 202 Accepted 2026-03-18 08:46:37,360 - lava_callback - INFO - Starting async job submit for node 69b7c35b1727ff69d6f28d2b 2026-03-18 08:46:37,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:37,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c35b1727ff69d6f28d2b HTTP/1.1" 200 None 2026-03-18 08:46:37,376 - lava_callback - DEBUG - Processing node 69b7c35b1727ff69d6f28d2b: baseline-arm-clabbe 2026-03-18 08:46:37,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c35b1727ff69d6f28d2b 2026-03-18 08:46:37,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:37,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c35b1727ff69d6f28d2b HTTP/1.1" 200 None 2026-03-18 08:46:37,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:37,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 08:46:37,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:37,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c35b1727ff69d6f28d2b HTTP/1.1" 200 None 2026-03-18 08:46:37,428 - lava_callback - ERROR - Error processing callback for node 69b7c35b1727ff69d6f28d2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:46:47,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:47,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:46:57,735 - lava_callback - INFO - Received callback for node 69ba61e8537ae4d3c8236e8d INFO: 172.21.0.1:57684 - "POST /node/69ba61e8537ae4d3c8236e8d HTTP/1.0" 202 Accepted 2026-03-18 08:46:57,742 - lava_callback - INFO - Starting async job submit for node 69ba61e8537ae4d3c8236e8d 2026-03-18 08:46:57,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:57,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba61e8537ae4d3c8236e8d HTTP/1.1" 200 None 2026-03-18 08:46:57,841 - lava_callback - DEBUG - Processing node 69ba61e8537ae4d3c8236e8d: ltp-smoke 2026-03-18 08:46:58,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:46:58,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:46:58,479 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ba61e8537ae4d3c8236e8d/log.txt.gz 2026-03-18 08:46:58,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:46:58,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:46:58,984 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ba61e8537ae4d3c8236e8d/lava-logs.yaml 2026-03-18 08:46:58,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:46:59,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:46:59,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ba61e8537ae4d3c8236e8d/lava_callback.json.gz 2026-03-18 08:46:59,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:59,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba61e8537ae4d3c8236e8d HTTP/1.1" 200 None 2026-03-18 08:46:59,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:59,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f73537ae4d3c8236e4c HTTP/1.1" 200 None 2026-03-18 08:46:59,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:46:59,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba61e8537ae4d3c8236e8d HTTP/1.1" 200 None 2026-03-18 08:46:59,556 - lava_callback - INFO - Completed processing callback for node 69ba61e8537ae4d3c8236e8d INFO: 172.21.0.1:49166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 08:47:15,893 - lava_callback - INFO - Received callback for node 69ba649c537ae4d3c823753b INFO: 172.21.0.1:40040 - "POST /node/69ba649c537ae4d3c823753b HTTP/1.0" 202 Accepted 2026-03-18 08:47:15,899 - lava_callback - INFO - Starting async job submit for node 69ba649c537ae4d3c823753b 2026-03-18 08:47:15,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:15,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba649c537ae4d3c823753b HTTP/1.1" 200 None 2026-03-18 08:47:15,956 - lava_callback - DEBUG - Processing node 69ba649c537ae4d3c823753b: ltp-ipc 2026-03-18 08:47:16,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:47:16,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:47:16,451 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69ba649c537ae4d3c823753b/log.txt.gz INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:47:16,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:47:16,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:47:16,884 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69ba649c537ae4d3c823753b/lava-logs.yaml 2026-03-18 08:47:16,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:47:17,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:47:17,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69ba649c537ae4d3c823753b/lava_callback.json.gz 2026-03-18 08:47:17,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:17,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba649c537ae4d3c823753b HTTP/1.1" 200 None 2026-03-18 08:47:17,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:17,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:47:17,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:17,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba649c537ae4d3c823753b HTTP/1.1" 200 None 2026-03-18 08:47:17,196 - lava_callback - INFO - Completed processing callback for node 69ba649c537ae4d3c823753b 2026-03-18 08:47:17,398 - lava_callback - INFO - Received callback for node 69b7c3831727ff69d6f28d38 INFO: 172.21.0.1:40068 - "POST /node/69b7c3831727ff69d6f28d38 HTTP/1.0" 202 Accepted 2026-03-18 08:47:17,406 - lava_callback - INFO - Starting async job submit for node 69b7c3831727ff69d6f28d38 2026-03-18 08:47:17,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:17,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c3831727ff69d6f28d38 HTTP/1.1" 200 None 2026-03-18 08:47:17,426 - lava_callback - DEBUG - Processing node 69b7c3831727ff69d6f28d38: baseline-arm-clabbe 2026-03-18 08:47:17,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c3831727ff69d6f28d38 2026-03-18 08:47:17,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:17,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c3831727ff69d6f28d38 HTTP/1.1" 200 None 2026-03-18 08:47:17,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:17,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 08:47:17,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:17,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c3831727ff69d6f28d38 HTTP/1.1" 200 None 2026-03-18 08:47:17,494 - lava_callback - ERROR - Error processing callback for node 69b7c3831727ff69d6f28d38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 08:47:17,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:17,663 - lava_callback - INFO - Received callback for node 69ba665c537ae4d3c8237676 INFO: 172.21.0.1:40072 - "POST /node/69ba665c537ae4d3c8237676 HTTP/1.0" 202 Accepted 2026-03-18 08:47:17,670 - lava_callback - INFO - Starting async job submit for node 69ba665c537ae4d3c8237676 2026-03-18 08:47:17,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:17,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-18 08:47:17,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba665c537ae4d3c8237676 HTTP/1.1" 200 None 2026-03-18 08:47:17,703 - lava_callback - DEBUG - Processing node 69ba665c537ae4d3c8237676: baseline-arm-pengutronix 2026-03-18 08:47:17,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:47:18,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:47:18,015 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba665c537ae4d3c8237676/log.txt.gz 2026-03-18 08:47:18,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:47:18,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:47:18,294 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba665c537ae4d3c8237676/lava-logs.yaml 2026-03-18 08:47:18,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:47:18,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:47:18,436 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba665c537ae4d3c8237676/lava_callback.json.gz 2026-03-18 08:47:18,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:18,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba665c537ae4d3c8237676 HTTP/1.1" 200 None 2026-03-18 08:47:18,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:18,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:47:18,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:18,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba665c537ae4d3c8237676 HTTP/1.1" 200 None 2026-03-18 08:47:18,518 - lava_callback - INFO - Completed processing callback for node 69ba665c537ae4d3c8237676 INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35318 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:47:47,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:47,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51598 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:47:57,424 - lava_callback - INFO - Received callback for node 69ba649f537ae4d3c8237541 INFO: 172.21.0.1:51608 - "POST /node/69ba649f537ae4d3c8237541 HTTP/1.0" 202 Accepted 2026-03-18 08:47:57,431 - lava_callback - INFO - Starting async job submit for node 69ba649f537ae4d3c8237541 2026-03-18 08:47:57,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:57,456 - lava_callback - INFO - Received callback for node 69b7c3a81727ff69d6f28d41 INFO: 172.21.0.1:51616 - "POST /node/69b7c3a81727ff69d6f28d41 HTTP/1.0" 202 Accepted 2026-03-18 08:47:57,461 - lava_callback - INFO - Starting async job submit for node 69b7c3a81727ff69d6f28d41 2026-03-18 08:47:57,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:57,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba649f537ae4d3c8237541 HTTP/1.1" 200 None 2026-03-18 08:47:57,479 - lava_callback - DEBUG - Processing node 69ba649f537ae4d3c8237541: ltp-sched 2026-03-18 08:47:57,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c3a81727ff69d6f28d41 HTTP/1.1" 200 None 2026-03-18 08:47:57,543 - lava_callback - DEBUG - Processing node 69b7c3a81727ff69d6f28d41: baseline-arm-clabbe 2026-03-18 08:47:57,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c3a81727ff69d6f28d41 2026-03-18 08:47:57,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:57,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c3a81727ff69d6f28d41 HTTP/1.1" 200 None 2026-03-18 08:47:57,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:57,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 08:47:57,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:57,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c3a81727ff69d6f28d41 HTTP/1.1" 200 None 2026-03-18 08:47:57,876 - lava_callback - ERROR - Error processing callback for node 69b7c3a81727ff69d6f28d41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 08:47:57,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:47:58,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:47:58,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69ba649f537ae4d3c8237541/log.txt.gz 2026-03-18 08:47:58,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:47:58,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:47:58,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69ba649f537ae4d3c8237541/lava-logs.yaml 2026-03-18 08:47:58,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:47:58,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:47:58,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69ba649f537ae4d3c8237541/lava_callback.json.gz 2026-03-18 08:47:58,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:58,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba649f537ae4d3c8237541 HTTP/1.1" 200 None 2026-03-18 08:47:58,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:58,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:47:58,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:47:58,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba649f537ae4d3c8237541 HTTP/1.1" 200 None 2026-03-18 08:47:58,783 - lava_callback - INFO - Completed processing callback for node 69ba649f537ae4d3c8237541 INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:48:17,440 - lava_callback - INFO - Received callback for node 69b7c3ce1727ff69d6f28d4c INFO: 172.21.0.1:59988 - "POST /node/69b7c3ce1727ff69d6f28d4c HTTP/1.0" 202 Accepted 2026-03-18 08:48:17,445 - lava_callback - INFO - Starting async job submit for node 69b7c3ce1727ff69d6f28d4c 2026-03-18 08:48:17,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:48:17,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c3ce1727ff69d6f28d4c HTTP/1.1" 200 None 2026-03-18 08:48:17,462 - lava_callback - DEBUG - Processing node 69b7c3ce1727ff69d6f28d4c: baseline-arm-clabbe 2026-03-18 08:48:17,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c3ce1727ff69d6f28d4c 2026-03-18 08:48:17,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:48:17,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c3ce1727ff69d6f28d4c HTTP/1.1" 200 None 2026-03-18 08:48:17,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:48:17,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 08:48:17,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:48:17,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c3ce1727ff69d6f28d4c HTTP/1.1" 200 None 2026-03-18 08:48:17,542 - lava_callback - ERROR - Error processing callback for node 69b7c3ce1727ff69d6f28d4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 08:48:17,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:48:17,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:48:57,489 - lava_callback - INFO - Received callback for node 69b7c3f31727ff69d6f28d57 INFO: 172.21.0.1:56394 - "POST /node/69b7c3f31727ff69d6f28d57 HTTP/1.0" 202 Accepted 2026-03-18 08:48:57,497 - lava_callback - INFO - Starting async job submit for node 69b7c3f31727ff69d6f28d57 2026-03-18 08:48:57,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:48:57,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c3f31727ff69d6f28d57 HTTP/1.1" 200 None 2026-03-18 08:48:57,527 - lava_callback - DEBUG - Processing node 69b7c3f31727ff69d6f28d57: baseline-arm-clabbe 2026-03-18 08:48:57,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c3f31727ff69d6f28d57 2026-03-18 08:48:57,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:48:57,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c3f31727ff69d6f28d57 HTTP/1.1" 200 None 2026-03-18 08:48:57,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:48:57,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 08:48:57,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:48:57,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c3f31727ff69d6f28d57 HTTP/1.1" 200 None 2026-03-18 08:48:57,612 - lava_callback - ERROR - Error processing callback for node 69b7c3f31727ff69d6f28d57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52158 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:50:35,700 - lava_callback - INFO - Received callback for node 69ba64a0537ae4d3c8237544 INFO: 172.21.0.1:51816 - "POST /node/69ba64a0537ae4d3c8237544 HTTP/1.0" 202 Accepted 2026-03-18 08:50:35,709 - lava_callback - INFO - Starting async job submit for node 69ba64a0537ae4d3c8237544 2026-03-18 08:50:35,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:50:35,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64a0537ae4d3c8237544 HTTP/1.1" 200 None 2026-03-18 08:50:35,762 - lava_callback - DEBUG - Processing node 69ba64a0537ae4d3c8237544: ltp-smoke 2026-03-18 08:50:36,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:50:37,245 - lava_callback - INFO - Received callback for node 69ba64a4537ae4d3c823754a INFO: 172.21.0.1:51840 - "POST /node/69ba64a4537ae4d3c823754a HTTP/1.0" 202 Accepted 2026-03-18 08:50:37,256 - lava_callback - INFO - Starting async job submit for node 69ba64a4537ae4d3c823754a 2026-03-18 08:50:37,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:50:37,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64a4537ae4d3c823754a HTTP/1.1" 200 None 2026-03-18 08:50:37,322 - lava_callback - DEBUG - Processing node 69ba64a4537ae4d3c823754a: ltp-syscalls-ipc 2026-03-18 08:50:37,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:50:37,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ba64a0537ae4d3c8237544/log.txt.gz 2026-03-18 08:50:38,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:50:38,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:50:39,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:50:39,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ba64a0537ae4d3c8237544/lava-logs.yaml 2026-03-18 08:50:39,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:50:39,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:50:39,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ba64a4537ae4d3c823754a/log.txt.gz 2026-03-18 08:50:39,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:50:40,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:50:40,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ba64a0537ae4d3c8237544/lava_callback.json.gz 2026-03-18 08:50:40,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:50:40,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64a0537ae4d3c8237544 HTTP/1.1" 200 None 2026-03-18 08:50:40,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:50:40,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:50:40,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:50:40,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba64a0537ae4d3c8237544 HTTP/1.1" 200 None 2026-03-18 08:50:40,569 - lava_callback - INFO - Completed processing callback for node 69ba64a0537ae4d3c8237544 2026-03-18 08:50:40,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:50:40,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ba64a4537ae4d3c823754a/lava-logs.yaml 2026-03-18 08:50:40,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:50:42,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:50:42,172 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ba64a4537ae4d3c823754a/lava_callback.json.gz 2026-03-18 08:50:42,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:50:42,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64a4537ae4d3c823754a HTTP/1.1" 200 None 2026-03-18 08:50:42,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:50:42,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:50:42,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:50:42,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba64a4537ae4d3c823754a HTTP/1.1" 200 None 2026-03-18 08:50:42,283 - lava_callback - INFO - Completed processing callback for node 69ba64a4537ae4d3c823754a INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:50:47,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:50:47,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:51:14,029 - lava_callback - INFO - Received callback for node 69ba676a537ae4d3c823770c INFO: 172.21.0.1:45950 - "POST /node/69ba676a537ae4d3c823770c HTTP/1.0" 202 Accepted 2026-03-18 08:51:14,036 - lava_callback - INFO - Starting async job submit for node 69ba676a537ae4d3c823770c 2026-03-18 08:51:14,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:14,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba676a537ae4d3c823770c HTTP/1.1" 200 None 2026-03-18 08:51:14,057 - lava_callback - DEBUG - Processing node 69ba676a537ae4d3c823770c: baseline-arm 2026-03-18 08:51:14,063 - lava_callback - WARNING - Failed to upload log 2026-03-18 08:51:14,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:51:14,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:51:14,352 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba676a537ae4d3c823770c/lava-logs.yaml 2026-03-18 08:51:14,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:51:14,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:51:14,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba676a537ae4d3c823770c/lava_callback.json.gz 2026-03-18 08:51:14,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:14,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba676a537ae4d3c823770c HTTP/1.1" 200 None 2026-03-18 08:51:14,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:14,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:51:14,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:14,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba676a537ae4d3c823770c HTTP/1.1" 200 None 2026-03-18 08:51:14,609 - lava_callback - INFO - Completed processing callback for node 69ba676a537ae4d3c823770c INFO: 172.21.0.1:45962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:51:17,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:17,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:51:39,166 - lava_callback - INFO - Received callback for node 69ba64a6537ae4d3c823754d INFO: 172.21.0.1:34560 - "POST /node/69ba64a6537ae4d3c823754d HTTP/1.0" 202 Accepted 2026-03-18 08:51:39,181 - lava_callback - INFO - Starting async job submit for node 69ba64a6537ae4d3c823754d 2026-03-18 08:51:39,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:39,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64a6537ae4d3c823754d HTTP/1.1" 200 None 2026-03-18 08:51:39,291 - lava_callback - DEBUG - Processing node 69ba64a6537ae4d3c823754d: ltp-timers 2026-03-18 08:51:39,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:51:40,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:51:40,295 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69ba64a6537ae4d3c823754d/log.txt.gz 2026-03-18 08:51:40,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:51:41,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:51:41,049 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69ba64a6537ae4d3c823754d/lava-logs.yaml 2026-03-18 08:51:41,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:51:41,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:51:41,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69ba64a6537ae4d3c823754d/lava_callback.json.gz 2026-03-18 08:51:41,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:41,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64a6537ae4d3c823754d HTTP/1.1" 200 None 2026-03-18 08:51:41,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:41,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:51:41,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:41,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba64a6537ae4d3c823754d HTTP/1.1" 200 None 2026-03-18 08:51:41,369 - lava_callback - INFO - Completed processing callback for node 69ba64a6537ae4d3c823754d INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:51:47,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:47,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:51:57,325 - lava_callback - INFO - Received callback for node 69ba64a9537ae4d3c8237562 INFO: 172.21.0.1:51198 - "POST /node/69ba64a9537ae4d3c8237562 HTTP/1.0" 202 Accepted 2026-03-18 08:51:57,332 - lava_callback - INFO - Starting async job submit for node 69ba64a9537ae4d3c8237562 2026-03-18 08:51:57,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:57,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64a9537ae4d3c8237562 HTTP/1.1" 200 None 2026-03-18 08:51:57,373 - lava_callback - DEBUG - Processing node 69ba64a9537ae4d3c8237562: ltp-watchqueue 2026-03-18 08:51:57,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:51:57,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:51:57,858 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ba64a9537ae4d3c8237562/log.txt.gz 2026-03-18 08:51:58,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:51:58,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:51:58,255 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ba64a9537ae4d3c8237562/lava-logs.yaml 2026-03-18 08:51:58,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:51:58,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:51:58,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ba64a9537ae4d3c8237562/lava_callback.json.gz 2026-03-18 08:51:58,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:58,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba64a9537ae4d3c8237562 HTTP/1.1" 200 None 2026-03-18 08:51:58,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:58,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:51:58,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:51:58,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba64a9537ae4d3c8237562 HTTP/1.1" 200 None 2026-03-18 08:51:58,505 - lava_callback - INFO - Completed processing callback for node 69ba64a9537ae4d3c8237562 INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41928 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:52:17,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:52:17,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:54:25,983 - lava_callback - INFO - Received callback for node 69ba6456537ae4d3c8237465 INFO: 172.21.0.1:47662 - "POST /node/69ba6456537ae4d3c8237465 HTTP/1.0" 202 Accepted 2026-03-18 08:54:25,998 - lava_callback - INFO - Starting async job submit for node 69ba6456537ae4d3c8237465 2026-03-18 08:54:26,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:54:26,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6456537ae4d3c8237465 HTTP/1.1" 200 None 2026-03-18 08:54:26,081 - lava_callback - DEBUG - Processing node 69ba6456537ae4d3c8237465: baseline-arm INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:54:26,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:54:26,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:54:26,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6456537ae4d3c8237465/log.txt.gz 2026-03-18 08:54:27,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:54:27,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:54:27,549 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6456537ae4d3c8237465/lava-logs.yaml 2026-03-18 08:54:27,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:54:27,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:54:27,742 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6456537ae4d3c8237465/lava_callback.json.gz DEBUG: Setup failed for 69ba6456537ae4d3c8237465. Transitting job node result: incomplete -> fail 2026-03-18 08:54:27,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:54:27,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6456537ae4d3c8237465 HTTP/1.1" 200 None 2026-03-18 08:54:27,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:54:27,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:54:27,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:54:27,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6456537ae4d3c8237465 HTTP/1.1" 200 None 2026-03-18 08:54:28,130 - lava_callback - INFO - Completed processing callback for node 69ba6456537ae4d3c8237465 INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:54:47,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:54:47,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:57:47,374 - lava_callback - INFO - Received callback for node 69b7c6071727ff69d6f28d62 INFO: 172.21.0.1:49596 - "POST /node/69b7c6071727ff69d6f28d62 HTTP/1.0" 202 Accepted 2026-03-18 08:57:47,382 - lava_callback - INFO - Starting async job submit for node 69b7c6071727ff69d6f28d62 2026-03-18 08:57:47,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:57:47,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c6071727ff69d6f28d62 HTTP/1.1" 200 None 2026-03-18 08:57:47,407 - lava_callback - DEBUG - Processing node 69b7c6071727ff69d6f28d62: baseline-arm64-baylibre 2026-03-18 08:57:47,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c6071727ff69d6f28d62 2026-03-18 08:57:47,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:57:47,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c6071727ff69d6f28d62 HTTP/1.1" 200 None 2026-03-18 08:57:47,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:57:47,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-18 08:57:47,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:57:47,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c6071727ff69d6f28d62 HTTP/1.1" 200 None 2026-03-18 08:57:47,489 - lava_callback - ERROR - Error processing callback for node 69b7c6071727ff69d6f28d62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:58:12,714 - lava_callback - INFO - Received callback for node 69ba6479537ae4d3c82374f8 INFO: 172.21.0.1:60994 - "POST /node/69ba6479537ae4d3c82374f8 HTTP/1.0" 202 Accepted 2026-03-18 08:58:12,766 - lava_callback - INFO - Starting async job submit for node 69ba6479537ae4d3c82374f8 2026-03-18 08:58:12,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:58:12,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6479537ae4d3c82374f8 HTTP/1.1" 200 None 2026-03-18 08:58:12,830 - lava_callback - DEBUG - Processing node 69ba6479537ae4d3c82374f8: baseline-arm-pengutronix 2026-03-18 08:58:12,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:58:13,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:58:13,144 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba6479537ae4d3c82374f8/log.txt.gz 2026-03-18 08:58:13,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:58:13,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:58:13,368 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba6479537ae4d3c82374f8/lava-logs.yaml 2026-03-18 08:58:13,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 08:58:13,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 08:58:13,565 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ba6479537ae4d3c82374f8/lava_callback.json.gz DEBUG: Setup failed for 69ba6479537ae4d3c82374f8. Transitting job node result: incomplete -> fail 2026-03-18 08:58:13,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:58:13,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6479537ae4d3c82374f8 HTTP/1.1" 200 None 2026-03-18 08:58:13,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:58:13,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 08:58:13,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:58:13,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6479537ae4d3c82374f8 HTTP/1.1" 200 None 2026-03-18 08:58:13,760 - lava_callback - INFO - Completed processing callback for node 69ba6479537ae4d3c82374f8 INFO: 172.21.0.1:32778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:58:17,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:58:17,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54148 - "GET / HTTP/1.0" 200 OK 2026-03-18 08:59:07,016 - lava_callback - INFO - Received callback for node 69b7c6571727ff69d6f28d6e INFO: 172.21.0.1:54164 - "POST /node/69b7c6571727ff69d6f28d6e HTTP/1.0" 202 Accepted 2026-03-18 08:59:07,021 - lava_callback - INFO - Starting async job submit for node 69b7c6571727ff69d6f28d6e 2026-03-18 08:59:07,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:59:07,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c6571727ff69d6f28d6e HTTP/1.1" 200 None 2026-03-18 08:59:07,040 - lava_callback - DEBUG - Processing node 69b7c6571727ff69d6f28d6e: baseline-arm64-baylibre 2026-03-18 08:59:07,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c6571727ff69d6f28d6e 2026-03-18 08:59:07,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:59:07,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c6571727ff69d6f28d6e HTTP/1.1" 200 None 2026-03-18 08:59:07,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:59:07,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-18 08:59:07,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 08:59:07,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c6571727ff69d6f28d6e HTTP/1.1" 200 None 2026-03-18 08:59:07,100 - lava_callback - ERROR - Error processing callback for node 69b7c6571727ff69d6f28d6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51118 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:00:47,267 - lava_callback - INFO - Received callback for node 69b7c6ad1727ff69d6f28d93 INFO: 172.21.0.1:51134 - "POST /node/69b7c6ad1727ff69d6f28d93 HTTP/1.0" 202 Accepted 2026-03-18 09:00:47,272 - lava_callback - INFO - Starting async job submit for node 69b7c6ad1727ff69d6f28d93 2026-03-18 09:00:47,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:00:47,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c6ad1727ff69d6f28d93 HTTP/1.1" 200 None 2026-03-18 09:00:47,288 - lava_callback - DEBUG - Processing node 69b7c6ad1727ff69d6f28d93: baseline-arm64-baylibre 2026-03-18 09:00:47,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c6ad1727ff69d6f28d93 2026-03-18 09:00:47,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:00:47,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c6ad1727ff69d6f28d93 HTTP/1.1" 200 None 2026-03-18 09:00:47,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:00:47,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-18 09:00:47,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:00:47,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c6ad1727ff69d6f28d93 HTTP/1.1" 200 None 2026-03-18 09:00:47,366 - lava_callback - ERROR - Error processing callback for node 69b7c6ad1727ff69d6f28d93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60354 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:01:47,140 - lava_callback - INFO - Received callback for node 69b7c6f21727ff69d6f28db3 INFO: 172.21.0.1:60364 - "POST /node/69b7c6f21727ff69d6f28db3 HTTP/1.0" 202 Accepted 2026-03-18 09:01:47,146 - lava_callback - INFO - Starting async job submit for node 69b7c6f21727ff69d6f28db3 2026-03-18 09:01:47,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:01:47,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c6f21727ff69d6f28db3 HTTP/1.1" 200 None 2026-03-18 09:01:47,162 - lava_callback - DEBUG - Processing node 69b7c6f21727ff69d6f28db3: baseline-arm64-baylibre 2026-03-18 09:01:47,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c6f21727ff69d6f28db3 2026-03-18 09:01:47,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:01:47,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c6f21727ff69d6f28db3 HTTP/1.1" 200 None 2026-03-18 09:01:47,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:01:47,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-18 09:01:47,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:01:47,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c6f21727ff69d6f28db3 HTTP/1.1" 200 None 2026-03-18 09:01:47,255 - lava_callback - ERROR - Error processing callback for node 69b7c6f21727ff69d6f28db3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56080 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:04:47,382 - lava_callback - INFO - Received callback for node 69b7c79a1727ff69d6f28ddd INFO: 172.21.0.1:56084 - "POST /node/69b7c79a1727ff69d6f28ddd HTTP/1.0" 202 Accepted 2026-03-18 09:04:47,391 - lava_callback - INFO - Starting async job submit for node 69b7c79a1727ff69d6f28ddd 2026-03-18 09:04:47,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:04:47,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c79a1727ff69d6f28ddd HTTP/1.1" 200 None 2026-03-18 09:04:47,444 - lava_callback - DEBUG - Processing node 69b7c79a1727ff69d6f28ddd: baseline-arm64-baylibre 2026-03-18 09:04:47,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c79a1727ff69d6f28ddd 2026-03-18 09:04:47,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:04:47,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c79a1727ff69d6f28ddd HTTP/1.1" 200 None 2026-03-18 09:04:47,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:04:47,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-18 09:04:47,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:04:47,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c79a1727ff69d6f28ddd HTTP/1.1" 200 None 2026-03-18 09:04:47,526 - lava_callback - ERROR - Error processing callback for node 69b7c79a1727ff69d6f28ddd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:05:14,334 - lava_callback - INFO - Received callback for node 69ba649d537ae4d3c823753e INFO: 172.21.0.1:52478 - "POST /node/69ba649d537ae4d3c823753e HTTP/1.0" 202 Accepted 2026-03-18 09:05:14,381 - lava_callback - INFO - Starting async job submit for node 69ba649d537ae4d3c823753e 2026-03-18 09:05:14,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:05:14,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba649d537ae4d3c823753e HTTP/1.1" 200 None 2026-03-18 09:05:14,429 - lava_callback - DEBUG - Processing node 69ba649d537ae4d3c823753e: ltp-pty 2026-03-18 09:05:14,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:05:14,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:05:14,671 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69ba649d537ae4d3c823753e/log.txt.gz 2026-03-18 09:05:14,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:05:14,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:05:14,901 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69ba649d537ae4d3c823753e/lava-logs.yaml 2026-03-18 09:05:14,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:05:15,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:05:15,049 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69ba649d537ae4d3c823753e/lava_callback.json.gz 2026-03-18 09:05:15,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:05:15,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba649d537ae4d3c823753e HTTP/1.1" 200 None 2026-03-18 09:05:15,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:05:15,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 09:05:15,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:52482 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 09:05:15,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba649d537ae4d3c823753e HTTP/1.1" 200 None 2026-03-18 09:05:15,225 - lava_callback - INFO - Completed processing callback for node 69ba649d537ae4d3c823753e INFO: 172.21.0.1:52488 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:05:17,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:05:17,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44130 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:05:36,629 - lava_callback - INFO - Received callback for node 69ba6acb537ae4d3c82377c9 INFO: 172.21.0.1:44134 - "POST /node/69ba6acb537ae4d3c82377c9 HTTP/1.0" 202 Accepted 2026-03-18 09:05:36,638 - lava_callback - INFO - Starting async job submit for node 69ba6acb537ae4d3c82377c9 2026-03-18 09:05:36,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:05:36,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6acb537ae4d3c82377c9 HTTP/1.1" 200 None 2026-03-18 09:05:36,666 - lava_callback - DEBUG - Processing node 69ba6acb537ae4d3c82377c9: baseline-x86 2026-03-18 09:05:36,674 - lava_callback - WARNING - Failed to upload log 2026-03-18 09:05:36,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:05:36,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:05:36,863 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6acb537ae4d3c82377c9/lava-logs.yaml 2026-03-18 09:05:36,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:05:37,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:05:37,005 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6acb537ae4d3c82377c9/lava_callback.json.gz 2026-03-18 09:05:37,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:05:37,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6acb537ae4d3c82377c9 HTTP/1.1" 200 None 2026-03-18 09:05:37,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:05:37,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None 2026-03-18 09:05:37,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:05:37,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6acb537ae4d3c82377c9 HTTP/1.1" 200 None 2026-03-18 09:05:37,070 - lava_callback - INFO - Completed processing callback for node 69ba6acb537ae4d3c82377c9 INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:05:47,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:05:47,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43114 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:05:59,571 - lava_callback - INFO - Received callback for node 69ba6acd537ae4d3c82377d2 INFO: 172.21.0.1:43124 - "POST /node/69ba6acd537ae4d3c82377d2 HTTP/1.0" 202 Accepted 2026-03-18 09:05:59,577 - lava_callback - INFO - Starting async job submit for node 69ba6acd537ae4d3c82377d2 2026-03-18 09:05:59,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:05:59,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6acd537ae4d3c82377d2 HTTP/1.1" 200 None 2026-03-18 09:05:59,610 - lava_callback - DEBUG - Processing node 69ba6acd537ae4d3c82377d2: baseline-x86 2026-03-18 09:05:59,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:06:00,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:06:00,020 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6acd537ae4d3c82377d2/log.txt.gz 2026-03-18 09:06:00,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:06:00,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:06:00,312 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6acd537ae4d3c82377d2/lava-logs.yaml 2026-03-18 09:06:00,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:06:00,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:06:00,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6acd537ae4d3c82377d2/lava_callback.json.gz 2026-03-18 09:06:00,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:06:00,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6acd537ae4d3c82377d2 HTTP/1.1" 200 None 2026-03-18 09:06:00,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:06:00,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None 2026-03-18 09:06:00,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:06:00,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6acd537ae4d3c82377d2 HTTP/1.1" 200 None 2026-03-18 09:06:00,542 - lava_callback - INFO - Completed processing callback for node 69ba6acd537ae4d3c82377d2 INFO: 172.21.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:06:17,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:06:17,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39092 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:06:39,708 - lava_callback - INFO - Received callback for node 69ba6acc537ae4d3c82377cc INFO: 172.21.0.1:39544 - "POST /node/69ba6acc537ae4d3c82377cc HTTP/1.0" 202 Accepted 2026-03-18 09:06:39,714 - lava_callback - INFO - Starting async job submit for node 69ba6acc537ae4d3c82377cc 2026-03-18 09:06:39,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:06:39,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6acc537ae4d3c82377cc HTTP/1.1" 200 None 2026-03-18 09:06:39,757 - lava_callback - DEBUG - Processing node 69ba6acc537ae4d3c82377cc: baseline-x86 2026-03-18 09:06:40,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:06:40,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:06:40,187 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6acc537ae4d3c82377cc/log.txt.gz 2026-03-18 09:06:40,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:06:40,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:06:40,576 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6acc537ae4d3c82377cc/lava-logs.yaml 2026-03-18 09:06:40,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:06:40,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:06:40,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6acc537ae4d3c82377cc/lava_callback.json.gz 2026-03-18 09:06:40,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:06:40,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6acc537ae4d3c82377cc HTTP/1.1" 200 None 2026-03-18 09:06:40,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:06:40,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None 2026-03-18 09:06:40,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:06:40,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6acc537ae4d3c82377cc HTTP/1.1" 200 None 2026-03-18 09:06:40,826 - lava_callback - INFO - Completed processing callback for node 69ba6acc537ae4d3c82377cc INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:06:47,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:06:47,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:06:59,603 - lava_callback - INFO - Received callback for node 69ba6acd537ae4d3c82377cf INFO: 172.21.0.1:35292 - "POST /node/69ba6acd537ae4d3c82377cf HTTP/1.0" 202 Accepted 2026-03-18 09:06:59,610 - lava_callback - INFO - Starting async job submit for node 69ba6acd537ae4d3c82377cf 2026-03-18 09:06:59,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:06:59,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6acd537ae4d3c82377cf HTTP/1.1" 200 None 2026-03-18 09:06:59,670 - lava_callback - DEBUG - Processing node 69ba6acd537ae4d3c82377cf: baseline-x86 2026-03-18 09:06:59,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:07:00,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:07:00,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6acd537ae4d3c82377cf/log.txt.gz 2026-03-18 09:07:00,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:07:00,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:07:00,408 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6acd537ae4d3c82377cf/lava-logs.yaml 2026-03-18 09:07:00,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:07:00,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:07:00,553 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6acd537ae4d3c82377cf/lava_callback.json.gz 2026-03-18 09:07:00,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:07:00,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6acd537ae4d3c82377cf HTTP/1.1" 200 None 2026-03-18 09:07:00,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:07:00,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None 2026-03-18 09:07:00,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:07:00,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6acd537ae4d3c82377cf HTTP/1.1" 200 None 2026-03-18 09:07:00,661 - lava_callback - INFO - Completed processing callback for node 69ba6acd537ae4d3c82377cf INFO: 172.21.0.1:55154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:07:17,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:07:17,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-18 09:07:18,307 - lava_callback - INFO - Received callback for node 69b7c8431727ff69d6f28de5 INFO: 172.21.0.1:56892 - "POST /node/69b7c8431727ff69d6f28de5 HTTP/1.0" 202 Accepted 2026-03-18 09:07:18,313 - lava_callback - INFO - Starting async job submit for node 69b7c8431727ff69d6f28de5 2026-03-18 09:07:18,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:07:18,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c8431727ff69d6f28de5 HTTP/1.1" 200 None 2026-03-18 09:07:18,340 - lava_callback - DEBUG - Processing node 69b7c8431727ff69d6f28de5: baseline-arm64-clabbe 2026-03-18 09:07:18,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c8431727ff69d6f28de5 2026-03-18 09:07:18,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:07:18,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c8431727ff69d6f28de5 HTTP/1.1" 200 None 2026-03-18 09:07:18,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:07:18,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-18 09:07:18,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:07:18,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c8431727ff69d6f28de5 HTTP/1.1" 200 None 2026-03-18 09:07:18,435 - lava_callback - ERROR - Error processing callback for node 69b7c8431727ff69d6f28de5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50182 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:08:38,310 - lava_callback - INFO - Received callback for node 69b7c8921727ff69d6f28df1 INFO: 172.21.0.1:50186 - "POST /node/69b7c8921727ff69d6f28df1 HTTP/1.0" 202 Accepted 2026-03-18 09:08:38,316 - lava_callback - INFO - Starting async job submit for node 69b7c8921727ff69d6f28df1 2026-03-18 09:08:38,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:38,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c8921727ff69d6f28df1 HTTP/1.1" 200 None 2026-03-18 09:08:38,332 - lava_callback - DEBUG - Processing node 69b7c8921727ff69d6f28df1: baseline-arm64-clabbe 2026-03-18 09:08:38,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c8921727ff69d6f28df1 2026-03-18 09:08:38,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:38,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c8921727ff69d6f28df1 HTTP/1.1" 200 None 2026-03-18 09:08:38,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:38,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-18 09:08:38,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:38,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c8921727ff69d6f28df1 HTTP/1.1" 200 None 2026-03-18 09:08:38,393 - lava_callback - ERROR - Error processing callback for node 69b7c8921727ff69d6f28df1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58404 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:08:46,537 - lava_callback - INFO - Received callback for node 69ba6b7f537ae4d3c8237815 INFO: 172.21.0.1:58418 - "POST /node/69ba6b7f537ae4d3c8237815 HTTP/1.0" 202 Accepted 2026-03-18 09:08:46,543 - lava_callback - INFO - Starting async job submit for node 69ba6b7f537ae4d3c8237815 2026-03-18 09:08:46,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:46,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6b7f537ae4d3c8237815 HTTP/1.1" 200 None 2026-03-18 09:08:46,577 - lava_callback - DEBUG - Processing node 69ba6b7f537ae4d3c8237815: baseline-x86 2026-03-18 09:08:46,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:08:46,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:08:46,904 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6b7f537ae4d3c8237815/log.txt.gz 2026-03-18 09:08:47,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:08:47,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:08:47,218 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6b7f537ae4d3c8237815/lava-logs.yaml 2026-03-18 09:08:47,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:08:47,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:08:47,380 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6b7f537ae4d3c8237815/lava_callback.json.gz 2026-03-18 09:08:47,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:47,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6b7f537ae4d3c8237815 HTTP/1.1" 200 None 2026-03-18 09:08:47,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:47,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None 2026-03-18 09:08:47,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:47,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6b7f537ae4d3c8237815 HTTP/1.1" 200 None 2026-03-18 09:08:47,474 - lava_callback - INFO - Completed processing callback for node 69ba6b7f537ae4d3c8237815 2026-03-18 09:08:47,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:47,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-18 09:08:56,472 - lava_callback - INFO - Received callback for node 69ba6b80537ae4d3c8237818 INFO: 172.21.0.1:60366 - "POST /node/69ba6b80537ae4d3c8237818 HTTP/1.0" 202 Accepted 2026-03-18 09:08:56,478 - lava_callback - INFO - Starting async job submit for node 69ba6b80537ae4d3c8237818 2026-03-18 09:08:56,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:56,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6b80537ae4d3c8237818 HTTP/1.1" 200 None 2026-03-18 09:08:56,511 - lava_callback - DEBUG - Processing node 69ba6b80537ae4d3c8237818: baseline-x86 INFO: 172.21.0.1:60380 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:08:56,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:08:56,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:08:56,813 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6b80537ae4d3c8237818/log.txt.gz 2026-03-18 09:08:56,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:08:57,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:08:57,116 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6b80537ae4d3c8237818/lava-logs.yaml 2026-03-18 09:08:57,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:08:57,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:08:57,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ba6b80537ae4d3c8237818/lava_callback.json.gz 2026-03-18 09:08:57,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:57,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6b80537ae4d3c8237818 HTTP/1.1" 200 None 2026-03-18 09:08:57,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:57,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None 2026-03-18 09:08:57,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:08:57,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6b80537ae4d3c8237818 HTTP/1.1" 200 None 2026-03-18 09:08:57,331 - lava_callback - INFO - Completed processing callback for node 69ba6b80537ae4d3c8237818 INFO: 172.21.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33520 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:09:17,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:09:18,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45480 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:09:54,392 - lava_callback - INFO - Received callback for node 69ba6af7537ae4d3c82377ec INFO: 172.21.0.1:34064 - "POST /node/69ba6af7537ae4d3c82377ec HTTP/1.0" 202 Accepted 2026-03-18 09:09:54,398 - lava_callback - INFO - Starting async job submit for node 69ba6af7537ae4d3c82377ec 2026-03-18 09:09:54,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:09:54,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6af7537ae4d3c82377ec HTTP/1.1" 200 None 2026-03-18 09:09:54,441 - lava_callback - DEBUG - Processing node 69ba6af7537ae4d3c82377ec: ltp-pty 2026-03-18 09:09:54,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:09:54,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:09:54,938 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69ba6af7537ae4d3c82377ec/log.txt.gz 2026-03-18 09:09:55,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:09:55,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:09:55,371 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69ba6af7537ae4d3c82377ec/lava-logs.yaml 2026-03-18 09:09:55,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:09:55,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:09:55,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69ba6af7537ae4d3c82377ec/lava_callback.json.gz 2026-03-18 09:09:55,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:09:55,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6af7537ae4d3c82377ec HTTP/1.1" 200 None 2026-03-18 09:09:55,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:09:55,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 09:09:55,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:09:55,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6af7537ae4d3c82377ec HTTP/1.1" 200 None 2026-03-18 09:09:55,658 - lava_callback - INFO - Completed processing callback for node 69ba6af7537ae4d3c82377ec INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:09:58,353 - lava_callback - INFO - Received callback for node 69ba67be537ae4d3c823773d INFO: 172.21.0.1:34070 - "POST /node/69ba67be537ae4d3c823773d HTTP/1.0" 202 Accepted 2026-03-18 09:09:58,360 - lava_callback - INFO - Starting async job submit for node 69ba67be537ae4d3c823773d 2026-03-18 09:09:58,409 - lava_callback - INFO - Received callback for node 69b7c8e21727ff69d6f28df8 INFO: 172.21.0.1:34084 - "POST /node/69b7c8e21727ff69d6f28df8 HTTP/1.0" 202 Accepted 2026-03-18 09:09:58,425 - lava_callback - INFO - Starting async job submit for node 69b7c8e21727ff69d6f28df8 2026-03-18 09:09:58,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:09:58,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:09:58,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba67be537ae4d3c823773d HTTP/1.1" 200 None 2026-03-18 09:09:58,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c8e21727ff69d6f28df8 HTTP/1.1" 200 None 2026-03-18 09:09:58,443 - lava_callback - DEBUG - Processing node 69ba67be537ae4d3c823773d: ltp-smoke 2026-03-18 09:09:58,454 - lava_callback - DEBUG - Processing node 69b7c8e21727ff69d6f28df8: baseline-arm64-clabbe 2026-03-18 09:09:58,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c8e21727ff69d6f28df8 2026-03-18 09:09:58,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:09:58,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c8e21727ff69d6f28df8 HTTP/1.1" 200 None 2026-03-18 09:09:58,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:09:58,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-18 09:09:58,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:09:58,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c8e21727ff69d6f28df8 HTTP/1.1" 200 None 2026-03-18 09:09:58,880 - lava_callback - ERROR - Error processing callback for node 69b7c8e21727ff69d6f28df8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:09:59,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:09:59,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:09:59,820 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ba67be537ae4d3c823773d/log.txt.gz 2026-03-18 09:10:00,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:10:00,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:10:00,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ba67be537ae4d3c823773d/lava-logs.yaml 2026-03-18 09:10:00,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:10:00,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:10:00,503 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ba67be537ae4d3c823773d/lava_callback.json.gz 2026-03-18 09:10:00,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:10:00,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba67be537ae4d3c823773d HTTP/1.1" 200 None 2026-03-18 09:10:00,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:10:00,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f73537ae4d3c8236e4c HTTP/1.1" 200 None 2026-03-18 09:10:00,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:10:00,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba67be537ae4d3c823773d HTTP/1.1" 200 None 2026-03-18 09:10:00,794 - lava_callback - INFO - Completed processing callback for node 69ba67be537ae4d3c823773d INFO: 172.21.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42256 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:10:18,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:10:18,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:11:18,456 - lava_callback - INFO - Received callback for node 69b7c9331727ff69d6f28e03 INFO: 172.21.0.1:41600 - "POST /node/69b7c9331727ff69d6f28e03 HTTP/1.0" 202 Accepted 2026-03-18 09:11:18,461 - lava_callback - INFO - Starting async job submit for node 69b7c9331727ff69d6f28e03 2026-03-18 09:11:18,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:11:18,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c9331727ff69d6f28e03 HTTP/1.1" 200 None 2026-03-18 09:11:18,477 - lava_callback - DEBUG - Processing node 69b7c9331727ff69d6f28e03: baseline-arm64-clabbe 2026-03-18 09:11:18,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c9331727ff69d6f28e03 2026-03-18 09:11:18,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:11:18,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c9331727ff69d6f28e03 HTTP/1.1" 200 None 2026-03-18 09:11:18,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:11:18,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-18 09:11:18,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:11:18,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c9331727ff69d6f28e03 HTTP/1.1" 200 None 2026-03-18 09:11:18,543 - lava_callback - ERROR - Error processing callback for node 69b7c9331727ff69d6f28e03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58780 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:12:37,828 - lava_callback - INFO - Received callback for node 69ba6c09537ae4d3c823784f INFO: 172.21.0.1:58784 - "POST /node/69ba6c09537ae4d3c823784f HTTP/1.0" 202 Accepted 2026-03-18 09:12:37,834 - lava_callback - INFO - Starting async job submit for node 69ba6c09537ae4d3c823784f 2026-03-18 09:12:37,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:12:37,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6c09537ae4d3c823784f HTTP/1.1" 200 None 2026-03-18 09:12:37,909 - lava_callback - DEBUG - Processing node 69ba6c09537ae4d3c823784f: ltp-smoke 2026-03-18 09:12:38,030 - lava_callback - WARNING - Failed to upload log 2026-03-18 09:12:38,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:12:38,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:12:38,306 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ba6c09537ae4d3c823784f/lava-logs.yaml 2026-03-18 09:12:38,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:12:38,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:12:38,448 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ba6c09537ae4d3c823784f/lava_callback.json.gz 2026-03-18 09:12:38,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:12:38,496 - lava_callback - INFO - Received callback for node 69b7c9811727ff69d6f28e0f INFO: 172.21.0.1:58800 - "POST /node/69b7c9811727ff69d6f28e0f HTTP/1.0" 202 Accepted 2026-03-18 09:12:38,503 - lava_callback - INFO - Starting async job submit for node 69b7c9811727ff69d6f28e0f 2026-03-18 09:12:38,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:12:38,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6c09537ae4d3c823784f HTTP/1.1" 200 None 2026-03-18 09:12:38,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:12:38,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c9811727ff69d6f28e0f HTTP/1.1" 200 None 2026-03-18 09:12:38,522 - lava_callback - DEBUG - Processing node 69b7c9811727ff69d6f28e0f: baseline-arm64-clabbe 2026-03-18 09:12:38,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c9811727ff69d6f28e0f 2026-03-18 09:12:38,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:12:38,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f73537ae4d3c8236e4c HTTP/1.1" 200 None 2026-03-18 09:12:38,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:12:38,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c9811727ff69d6f28e0f HTTP/1.1" 200 None 2026-03-18 09:12:38,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:12:38,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-18 09:12:38,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:12:38,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6c09537ae4d3c823784f HTTP/1.1" 200 None 2026-03-18 09:12:38,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c9811727ff69d6f28e0f HTTP/1.1" 200 None 2026-03-18 09:12:38,621 - lava_callback - ERROR - Error processing callback for node 69b7c9811727ff69d6f28e0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:12:38,692 - lava_callback - INFO - Completed processing callback for node 69ba6c09537ae4d3c823784f INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:12:48,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:12:48,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41572 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:13:52,731 - lava_callback - INFO - Received callback for node 69ba68f4537ae4d3c823779b INFO: 172.21.0.1:44974 - "POST /node/69ba68f4537ae4d3c823779b HTTP/1.0" 202 Accepted 2026-03-18 09:13:52,738 - lava_callback - INFO - Starting async job submit for node 69ba68f4537ae4d3c823779b 2026-03-18 09:13:52,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:13:52,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba68f4537ae4d3c823779b HTTP/1.1" 200 None 2026-03-18 09:13:52,807 - lava_callback - DEBUG - Processing node 69ba68f4537ae4d3c823779b: baseline-arm 2026-03-18 09:13:53,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:13:53,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:13:53,567 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ba68f4537ae4d3c823779b/log.txt.gz 2026-03-18 09:13:53,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:13:54,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:13:54,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba68f4537ae4d3c823779b/lava-logs.yaml 2026-03-18 09:13:54,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:13:54,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:13:54,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba68f4537ae4d3c823779b/lava_callback.json.gz DEBUG: Setup failed for 69ba68f4537ae4d3c823779b. Transitting job node result: incomplete -> fail 2026-03-18 09:13:54,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:13:54,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba68f4537ae4d3c823779b HTTP/1.1" 200 None 2026-03-18 09:13:54,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:13:54,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 09:13:54,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:13:54,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba68f4537ae4d3c823779b HTTP/1.1" 200 None 2026-03-18 09:13:54,696 - lava_callback - INFO - Completed processing callback for node 69ba68f4537ae4d3c823779b INFO: 172.21.0.1:44988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46868 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:14:18,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:14:18,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-18 09:14:18,547 - lava_callback - INFO - Received callback for node 69b7c9e61727ff69d6f28e17 INFO: 172.21.0.1:46874 - "POST /node/69b7c9e61727ff69d6f28e17 HTTP/1.0" 202 Accepted 2026-03-18 09:14:18,553 - lava_callback - INFO - Starting async job submit for node 69b7c9e61727ff69d6f28e17 2026-03-18 09:14:18,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:14:18,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c9e61727ff69d6f28e17 HTTP/1.1" 200 None 2026-03-18 09:14:18,570 - lava_callback - DEBUG - Processing node 69b7c9e61727ff69d6f28e17: baseline-arm64-clabbe 2026-03-18 09:14:18,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7c9e61727ff69d6f28e17 2026-03-18 09:14:18,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:14:18,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7c9e61727ff69d6f28e17 HTTP/1.1" 200 None 2026-03-18 09:14:18,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:14:18,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3b0c9209b146d8e1d77 HTTP/1.1" 200 None 2026-03-18 09:14:18,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:14:18,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7c9e61727ff69d6f28e17 HTTP/1.1" 200 None 2026-03-18 09:14:18,633 - lava_callback - ERROR - Error processing callback for node 69b7c9e61727ff69d6f28e17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:15:48,058 - lava_callback - INFO - Received callback for node 69b7ca411727ff69d6f28e20 INFO: 172.21.0.1:54014 - "POST /node/69b7ca411727ff69d6f28e20 HTTP/1.0" 202 Accepted 2026-03-18 09:15:48,064 - lava_callback - INFO - Starting async job submit for node 69b7ca411727ff69d6f28e20 2026-03-18 09:15:48,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:15:48,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ca411727ff69d6f28e20 HTTP/1.1" 200 None 2026-03-18 09:15:48,081 - lava_callback - DEBUG - Processing node 69b7ca411727ff69d6f28e20: baseline-arm64-baylibre 2026-03-18 09:15:48,081 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7ca411727ff69d6f28e20 2026-03-18 09:15:48,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:15:48,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ca411727ff69d6f28e20 HTTP/1.1" 200 None 2026-03-18 09:15:48,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:15:48,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 09:15:48,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:15:48,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ca411727ff69d6f28e20 HTTP/1.1" 200 None 2026-03-18 09:15:48,139 - lava_callback - ERROR - Error processing callback for node 69b7ca411727ff69d6f28e20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:17:08,100 - lava_callback - INFO - Received callback for node 69b7ca8a1727ff69d6f28e76 INFO: 172.21.0.1:42966 - "POST /node/69b7ca8a1727ff69d6f28e76 HTTP/1.0" 202 Accepted 2026-03-18 09:17:08,106 - lava_callback - INFO - Starting async job submit for node 69b7ca8a1727ff69d6f28e76 2026-03-18 09:17:08,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:17:08,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ca8a1727ff69d6f28e76 HTTP/1.1" 200 None 2026-03-18 09:17:08,122 - lava_callback - DEBUG - Processing node 69b7ca8a1727ff69d6f28e76: baseline-arm64-baylibre 2026-03-18 09:17:08,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7ca8a1727ff69d6f28e76 2026-03-18 09:17:08,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:17:08,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ca8a1727ff69d6f28e76 HTTP/1.1" 200 None 2026-03-18 09:17:08,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:17:08,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 09:17:08,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:17:08,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ca8a1727ff69d6f28e76 HTTP/1.1" 200 None 2026-03-18 09:17:08,184 - lava_callback - ERROR - Error processing callback for node 69b7ca8a1727ff69d6f28e76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39472 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:18:28,130 - lava_callback - INFO - Received callback for node 69b7cadc1727ff69d6f28e8d INFO: 172.21.0.1:39484 - "POST /node/69b7cadc1727ff69d6f28e8d HTTP/1.0" 202 Accepted 2026-03-18 09:18:28,135 - lava_callback - INFO - Starting async job submit for node 69b7cadc1727ff69d6f28e8d 2026-03-18 09:18:28,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:18:28,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cadc1727ff69d6f28e8d HTTP/1.1" 200 None 2026-03-18 09:18:28,152 - lava_callback - DEBUG - Processing node 69b7cadc1727ff69d6f28e8d: baseline-arm64-baylibre 2026-03-18 09:18:28,152 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cadc1727ff69d6f28e8d 2026-03-18 09:18:28,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:18:28,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cadc1727ff69d6f28e8d HTTP/1.1" 200 None 2026-03-18 09:18:28,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:18:28,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 09:18:28,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:18:28,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cadc1727ff69d6f28e8d HTTP/1.1" 200 None 2026-03-18 09:18:28,217 - lava_callback - ERROR - Error processing callback for node 69b7cadc1727ff69d6f28e8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43510 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:19:28,097 - lava_callback - INFO - Received callback for node 69b7cb171727ff69d6f28eb3 INFO: 172.21.0.1:43514 - "POST /node/69b7cb171727ff69d6f28eb3 HTTP/1.0" 202 Accepted 2026-03-18 09:19:28,103 - lava_callback - INFO - Starting async job submit for node 69b7cb171727ff69d6f28eb3 2026-03-18 09:19:28,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:19:28,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cb171727ff69d6f28eb3 HTTP/1.1" 200 None 2026-03-18 09:19:28,119 - lava_callback - DEBUG - Processing node 69b7cb171727ff69d6f28eb3: baseline-arm-baylibre 2026-03-18 09:19:28,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cb171727ff69d6f28eb3 2026-03-18 09:19:28,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:19:28,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cb171727ff69d6f28eb3 HTTP/1.1" 200 None 2026-03-18 09:19:28,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:19:28,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-18 09:19:28,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:19:28,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cb171727ff69d6f28eb3 HTTP/1.1" 200 None 2026-03-18 09:19:28,170 - lava_callback - ERROR - Error processing callback for node 69b7cb171727ff69d6f28eb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:20:28,175 - lava_callback - INFO - Received callback for node 69b7cb541727ff69d6f28ece INFO: 172.21.0.1:58192 - "POST /node/69b7cb541727ff69d6f28ece HTTP/1.0" 202 Accepted 2026-03-18 09:20:28,180 - lava_callback - INFO - Starting async job submit for node 69b7cb541727ff69d6f28ece 2026-03-18 09:20:28,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:20:28,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cb541727ff69d6f28ece HTTP/1.1" 200 None 2026-03-18 09:20:28,196 - lava_callback - DEBUG - Processing node 69b7cb541727ff69d6f28ece: baseline-arm64-baylibre 2026-03-18 09:20:28,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cb541727ff69d6f28ece 2026-03-18 09:20:28,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:20:28,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cb541727ff69d6f28ece HTTP/1.1" 200 None 2026-03-18 09:20:28,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:20:28,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 09:20:28,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:20:28,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cb541727ff69d6f28ece HTTP/1.1" 200 None 2026-03-18 09:20:28,256 - lava_callback - ERROR - Error processing callback for node 69b7cb541727ff69d6f28ece: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35564 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:21:48,571 - lava_callback - INFO - Received callback for node 69b7cba41727ff69d6f28f01 INFO: 172.21.0.1:35576 - "POST /node/69b7cba41727ff69d6f28f01 HTTP/1.0" 202 Accepted 2026-03-18 09:21:48,577 - lava_callback - INFO - Starting async job submit for node 69b7cba41727ff69d6f28f01 2026-03-18 09:21:48,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:21:48,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cba41727ff69d6f28f01 HTTP/1.1" 200 None 2026-03-18 09:21:48,602 - lava_callback - DEBUG - Processing node 69b7cba41727ff69d6f28f01: baseline-arm64-baylibre 2026-03-18 09:21:48,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cba41727ff69d6f28f01 2026-03-18 09:21:48,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:21:48,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cba41727ff69d6f28f01 HTTP/1.1" 200 None 2026-03-18 09:21:48,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:21:48,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 09:21:48,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:21:48,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cba41727ff69d6f28f01 HTTP/1.1" 200 None 2026-03-18 09:21:48,664 - lava_callback - ERROR - Error processing callback for node 69b7cba41727ff69d6f28f01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:23:18,902 - lava_callback - INFO - Received callback for node 69b7cbfc1727ff69d6f28f43 INFO: 172.21.0.1:44582 - "POST /node/69b7cbfc1727ff69d6f28f43 HTTP/1.0" 202 Accepted 2026-03-18 09:23:18,908 - lava_callback - INFO - Starting async job submit for node 69b7cbfc1727ff69d6f28f43 2026-03-18 09:23:18,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:23:18,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cbfc1727ff69d6f28f43 HTTP/1.1" 200 None 2026-03-18 09:23:18,939 - lava_callback - DEBUG - Processing node 69b7cbfc1727ff69d6f28f43: baseline-arm64-clabbe 2026-03-18 09:23:18,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cbfc1727ff69d6f28f43 2026-03-18 09:23:18,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:23:18,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cbfc1727ff69d6f28f43 HTTP/1.1" 200 None 2026-03-18 09:23:18,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:23:18,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 09:23:18,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:23:19,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cbfc1727ff69d6f28f43 HTTP/1.1" 200 None 2026-03-18 09:23:19,013 - lava_callback - ERROR - Error processing callback for node 69b7cbfc1727ff69d6f28f43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:24:38,971 - lava_callback - INFO - Received callback for node 69b7cc4e1727ff69d6f28f83 INFO: 172.21.0.1:41092 - "POST /node/69b7cc4e1727ff69d6f28f83 HTTP/1.0" 202 Accepted 2026-03-18 09:24:38,976 - lava_callback - INFO - Starting async job submit for node 69b7cc4e1727ff69d6f28f83 2026-03-18 09:24:38,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:24:38,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cc4e1727ff69d6f28f83 HTTP/1.1" 200 None 2026-03-18 09:24:38,994 - lava_callback - DEBUG - Processing node 69b7cc4e1727ff69d6f28f83: baseline-arm64-clabbe 2026-03-18 09:24:38,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cc4e1727ff69d6f28f83 2026-03-18 09:24:38,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:24:39,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cc4e1727ff69d6f28f83 HTTP/1.1" 200 None 2026-03-18 09:24:39,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:24:39,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 09:24:39,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:24:39,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cc4e1727ff69d6f28f83 HTTP/1.1" 200 None 2026-03-18 09:24:39,058 - lava_callback - ERROR - Error processing callback for node 69b7cc4e1727ff69d6f28f83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:25:58,968 - lava_callback - INFO - Received callback for node 69b7cc9d00b80c8ffdcb824f INFO: 172.21.0.1:48096 - "POST /node/69b7cc9d00b80c8ffdcb824f HTTP/1.0" 202 Accepted 2026-03-18 09:25:58,973 - lava_callback - INFO - Starting async job submit for node 69b7cc9d00b80c8ffdcb824f 2026-03-18 09:25:58,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:25:58,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cc9d00b80c8ffdcb824f HTTP/1.1" 200 None 2026-03-18 09:25:58,990 - lava_callback - DEBUG - Processing node 69b7cc9d00b80c8ffdcb824f: baseline-arm64-clabbe 2026-03-18 09:25:58,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cc9d00b80c8ffdcb824f 2026-03-18 09:25:58,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:25:59,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cc9d00b80c8ffdcb824f HTTP/1.1" 200 None 2026-03-18 09:25:59,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:25:59,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 09:25:59,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:25:59,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cc9d00b80c8ffdcb824f HTTP/1.1" 200 None 2026-03-18 09:25:59,051 - lava_callback - ERROR - Error processing callback for node 69b7cc9d00b80c8ffdcb824f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:27:19,055 - lava_callback - INFO - Received callback for node 69b7ccf400b80c8ffdcb8284 INFO: 172.21.0.1:35324 - "POST /node/69b7ccf400b80c8ffdcb8284 HTTP/1.0" 202 Accepted 2026-03-18 09:27:19,061 - lava_callback - INFO - Starting async job submit for node 69b7ccf400b80c8ffdcb8284 2026-03-18 09:27:19,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:27:19,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ccf400b80c8ffdcb8284 HTTP/1.1" 200 None 2026-03-18 09:27:19,077 - lava_callback - DEBUG - Processing node 69b7ccf400b80c8ffdcb8284: baseline-arm64-clabbe 2026-03-18 09:27:19,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7ccf400b80c8ffdcb8284 2026-03-18 09:27:19,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:27:19,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ccf400b80c8ffdcb8284 HTTP/1.1" 200 None 2026-03-18 09:27:19,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:27:19,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 09:27:19,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:27:19,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ccf400b80c8ffdcb8284 HTTP/1.1" 200 None 2026-03-18 09:27:19,145 - lava_callback - ERROR - Error processing callback for node 69b7ccf400b80c8ffdcb8284: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:28:59,140 - lava_callback - INFO - Received callback for node 69b7cd4700b80c8ffdcb8291 INFO: 172.21.0.1:37160 - "POST /node/69b7cd4700b80c8ffdcb8291 HTTP/1.0" 202 Accepted 2026-03-18 09:28:59,146 - lava_callback - INFO - Starting async job submit for node 69b7cd4700b80c8ffdcb8291 2026-03-18 09:28:59,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:28:59,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd4700b80c8ffdcb8291 HTTP/1.1" 200 None 2026-03-18 09:28:59,162 - lava_callback - DEBUG - Processing node 69b7cd4700b80c8ffdcb8291: baseline-arm64-clabbe 2026-03-18 09:28:59,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cd4700b80c8ffdcb8291 2026-03-18 09:28:59,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:28:59,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd4700b80c8ffdcb8291 HTTP/1.1" 200 None 2026-03-18 09:28:59,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:28:59,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 09:28:59,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:28:59,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cd4700b80c8ffdcb8291 HTTP/1.1" 200 None 2026-03-18 09:28:59,220 - lava_callback - ERROR - Error processing callback for node 69b7cd4700b80c8ffdcb8291: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:30:19,210 - lava_callback - INFO - Received callback for node 69b7cd9500b80c8ffdcb82db INFO: 172.21.0.1:58614 - "POST /node/69b7cd9500b80c8ffdcb82db HTTP/1.0" 202 Accepted 2026-03-18 09:30:19,216 - lava_callback - INFO - Starting async job submit for node 69b7cd9500b80c8ffdcb82db 2026-03-18 09:30:19,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:30:19,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd9500b80c8ffdcb82db HTTP/1.1" 200 None 2026-03-18 09:30:19,232 - lava_callback - DEBUG - Processing node 69b7cd9500b80c8ffdcb82db: baseline-arm64-clabbe 2026-03-18 09:30:19,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cd9500b80c8ffdcb82db 2026-03-18 09:30:19,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:30:19,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd9500b80c8ffdcb82db HTTP/1.1" 200 None 2026-03-18 09:30:19,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:30:19,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 09:30:19,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:30:19,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cd9500b80c8ffdcb82db HTTP/1.1" 200 None 2026-03-18 09:30:19,304 - lava_callback - ERROR - Error processing callback for node 69b7cd9500b80c8ffdcb82db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57758 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:31:08,788 - lava_callback - INFO - Received callback for node 69b7cdd000b80c8ffdcb82ec INFO: 172.21.0.1:57768 - "POST /node/69b7cdd000b80c8ffdcb82ec HTTP/1.0" 202 Accepted 2026-03-18 09:31:08,796 - lava_callback - INFO - Starting async job submit for node 69b7cdd000b80c8ffdcb82ec 2026-03-18 09:31:08,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:31:08,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cdd000b80c8ffdcb82ec HTTP/1.1" 200 None 2026-03-18 09:31:08,813 - lava_callback - DEBUG - Processing node 69b7cdd000b80c8ffdcb82ec: baseline-arm-baylibre 2026-03-18 09:31:08,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cdd000b80c8ffdcb82ec 2026-03-18 09:31:08,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:31:08,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cdd000b80c8ffdcb82ec HTTP/1.1" 200 None 2026-03-18 09:31:08,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:31:08,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-18 09:31:08,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:31:08,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cdd000b80c8ffdcb82ec HTTP/1.1" 200 None 2026-03-18 09:31:08,870 - lava_callback - ERROR - Error processing callback for node 69b7cdd000b80c8ffdcb82ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:31:48,743 - lava_callback - INFO - Received callback for node 69b7cdf500b80c8ffdcb82f9 INFO: 172.21.0.1:44150 - "POST /node/69b7cdf500b80c8ffdcb82f9 HTTP/1.0" 202 Accepted 2026-03-18 09:31:48,748 - lava_callback - INFO - Starting async job submit for node 69b7cdf500b80c8ffdcb82f9 2026-03-18 09:31:48,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:31:48,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cdf500b80c8ffdcb82f9 HTTP/1.1" 200 None 2026-03-18 09:31:48,774 - lava_callback - DEBUG - Processing node 69b7cdf500b80c8ffdcb82f9: baseline-arm-baylibre 2026-03-18 09:31:48,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cdf500b80c8ffdcb82f9 2026-03-18 09:31:48,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:31:48,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cdf500b80c8ffdcb82f9 HTTP/1.1" 200 None 2026-03-18 09:31:48,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:31:48,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-18 09:31:48,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:31:48,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cdf500b80c8ffdcb82f9 HTTP/1.1" 200 None 2026-03-18 09:31:48,848 - lava_callback - ERROR - Error processing callback for node 69b7cdf500b80c8ffdcb82f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44776 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:32:28,978 - lava_callback - INFO - Received callback for node 69b7ce1b00b80c8ffdcb8303 INFO: 172.21.0.1:44778 - "POST /node/69b7ce1b00b80c8ffdcb8303 HTTP/1.0" 202 Accepted 2026-03-18 09:32:28,984 - lava_callback - INFO - Starting async job submit for node 69b7ce1b00b80c8ffdcb8303 2026-03-18 09:32:28,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:32:28,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ce1b00b80c8ffdcb8303 HTTP/1.1" 200 None 2026-03-18 09:32:29,000 - lava_callback - DEBUG - Processing node 69b7ce1b00b80c8ffdcb8303: baseline-arm-baylibre 2026-03-18 09:32:29,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7ce1b00b80c8ffdcb8303 2026-03-18 09:32:29,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:32:29,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ce1b00b80c8ffdcb8303 HTTP/1.1" 200 None 2026-03-18 09:32:29,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:32:29,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-18 09:32:29,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:32:29,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ce1b00b80c8ffdcb8303 HTTP/1.1" 200 None 2026-03-18 09:32:29,071 - lava_callback - ERROR - Error processing callback for node 69b7ce1b00b80c8ffdcb8303: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46708 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:33:08,806 - lava_callback - INFO - Received callback for node 69b7ce4000b80c8ffdcb830c INFO: 172.21.0.1:46718 - "POST /node/69b7ce4000b80c8ffdcb830c HTTP/1.0" 202 Accepted 2026-03-18 09:33:08,812 - lava_callback - INFO - Starting async job submit for node 69b7ce4000b80c8ffdcb830c 2026-03-18 09:33:08,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:33:08,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ce4000b80c8ffdcb830c HTTP/1.1" 200 None 2026-03-18 09:33:08,839 - lava_callback - DEBUG - Processing node 69b7ce4000b80c8ffdcb830c: baseline-arm-baylibre 2026-03-18 09:33:08,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7ce4000b80c8ffdcb830c 2026-03-18 09:33:08,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:33:08,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ce4000b80c8ffdcb830c HTTP/1.1" 200 None 2026-03-18 09:33:08,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:33:08,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-18 09:33:08,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:33:08,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ce4000b80c8ffdcb830c HTTP/1.1" 200 None 2026-03-18 09:33:08,901 - lava_callback - ERROR - Error processing callback for node 69b7ce4000b80c8ffdcb830c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38038 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:33:28,836 - lava_callback - INFO - Received callback for node 69b7ce6500b80c8ffdcb8317 INFO: 172.21.0.1:38044 - "POST /node/69b7ce6500b80c8ffdcb8317 HTTP/1.0" 202 Accepted 2026-03-18 09:33:28,842 - lava_callback - INFO - Starting async job submit for node 69b7ce6500b80c8ffdcb8317 2026-03-18 09:33:28,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:33:28,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ce6500b80c8ffdcb8317 HTTP/1.1" 200 None 2026-03-18 09:33:28,858 - lava_callback - DEBUG - Processing node 69b7ce6500b80c8ffdcb8317: baseline-arm-baylibre 2026-03-18 09:33:28,858 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7ce6500b80c8ffdcb8317 2026-03-18 09:33:28,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:33:28,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ce6500b80c8ffdcb8317 HTTP/1.1" 200 None 2026-03-18 09:33:28,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:33:28,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-18 09:33:28,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:33:28,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ce6500b80c8ffdcb8317 HTTP/1.1" 200 None 2026-03-18 09:33:28,918 - lava_callback - ERROR - Error processing callback for node 69b7ce6500b80c8ffdcb8317: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:34:19,405 - lava_callback - INFO - Received callback for node 69b7ce8b00b80c8ffdcb8326 INFO: 172.21.0.1:58650 - "POST /node/69b7ce8b00b80c8ffdcb8326 HTTP/1.0" 202 Accepted 2026-03-18 09:34:19,411 - lava_callback - INFO - Starting async job submit for node 69b7ce8b00b80c8ffdcb8326 2026-03-18 09:34:19,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:34:19,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ce8b00b80c8ffdcb8326 HTTP/1.1" 200 None 2026-03-18 09:34:19,427 - lava_callback - DEBUG - Processing node 69b7ce8b00b80c8ffdcb8326: baseline-arm-clabbe 2026-03-18 09:34:19,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7ce8b00b80c8ffdcb8326 2026-03-18 09:34:19,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:34:19,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ce8b00b80c8ffdcb8326 HTTP/1.1" 200 None 2026-03-18 09:34:19,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:34:19,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-18 09:34:19,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:34:19,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ce8b00b80c8ffdcb8326 HTTP/1.1" 200 None 2026-03-18 09:34:19,487 - lava_callback - ERROR - Error processing callback for node 69b7ce8b00b80c8ffdcb8326: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47274 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:34:59,424 - lava_callback - INFO - Received callback for node 69b7ceb000b80c8ffdcb8331 INFO: 172.21.0.1:47290 - "POST /node/69b7ceb000b80c8ffdcb8331 HTTP/1.0" 202 Accepted 2026-03-18 09:34:59,430 - lava_callback - INFO - Starting async job submit for node 69b7ceb000b80c8ffdcb8331 2026-03-18 09:34:59,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:34:59,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ceb000b80c8ffdcb8331 HTTP/1.1" 200 None 2026-03-18 09:34:59,461 - lava_callback - DEBUG - Processing node 69b7ceb000b80c8ffdcb8331: baseline-arm-clabbe 2026-03-18 09:34:59,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7ceb000b80c8ffdcb8331 2026-03-18 09:34:59,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:34:59,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ceb000b80c8ffdcb8331 HTTP/1.1" 200 None 2026-03-18 09:34:59,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:34:59,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-18 09:34:59,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:34:59,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ceb000b80c8ffdcb8331 HTTP/1.1" 200 None 2026-03-18 09:34:59,513 - lava_callback - ERROR - Error processing callback for node 69b7ceb000b80c8ffdcb8331: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:35:39,471 - lava_callback - INFO - Received callback for node 69b7ced500b80c8ffdcb833c INFO: 172.21.0.1:39048 - "POST /node/69b7ced500b80c8ffdcb833c HTTP/1.0" 202 Accepted 2026-03-18 09:35:39,477 - lava_callback - INFO - Starting async job submit for node 69b7ced500b80c8ffdcb833c 2026-03-18 09:35:39,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:35:39,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ced500b80c8ffdcb833c HTTP/1.1" 200 None 2026-03-18 09:35:39,493 - lava_callback - DEBUG - Processing node 69b7ced500b80c8ffdcb833c: baseline-arm-clabbe 2026-03-18 09:35:39,494 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7ced500b80c8ffdcb833c 2026-03-18 09:35:39,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:35:39,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7ced500b80c8ffdcb833c HTTP/1.1" 200 None 2026-03-18 09:35:39,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:35:39,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-18 09:35:39,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:35:39,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7ced500b80c8ffdcb833c HTTP/1.1" 200 None 2026-03-18 09:35:39,549 - lava_callback - ERROR - Error processing callback for node 69b7ced500b80c8ffdcb833c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:35:59,451 - lava_callback - INFO - Received callback for node 69b7cefb00b80c8ffdcb8349 INFO: 172.21.0.1:53434 - "POST /node/69b7cefb00b80c8ffdcb8349 HTTP/1.0" 202 Accepted 2026-03-18 09:35:59,457 - lava_callback - INFO - Starting async job submit for node 69b7cefb00b80c8ffdcb8349 2026-03-18 09:35:59,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:35:59,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cefb00b80c8ffdcb8349 HTTP/1.1" 200 None 2026-03-18 09:35:59,482 - lava_callback - DEBUG - Processing node 69b7cefb00b80c8ffdcb8349: baseline-arm-clabbe 2026-03-18 09:35:59,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cefb00b80c8ffdcb8349 2026-03-18 09:35:59,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:35:59,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cefb00b80c8ffdcb8349 HTTP/1.1" 200 None 2026-03-18 09:35:59,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:35:59,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-18 09:35:59,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:35:59,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cefb00b80c8ffdcb8349 HTTP/1.1" 200 None 2026-03-18 09:35:59,557 - lava_callback - ERROR - Error processing callback for node 69b7cefb00b80c8ffdcb8349: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:36:39,526 - lava_callback - INFO - Received callback for node 69b7cf1f00b80c8ffdcb8355 INFO: 172.21.0.1:39028 - "POST /node/69b7cf1f00b80c8ffdcb8355 HTTP/1.0" 202 Accepted 2026-03-18 09:36:39,531 - lava_callback - INFO - Starting async job submit for node 69b7cf1f00b80c8ffdcb8355 2026-03-18 09:36:39,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:36:39,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cf1f00b80c8ffdcb8355 HTTP/1.1" 200 None 2026-03-18 09:36:39,547 - lava_callback - DEBUG - Processing node 69b7cf1f00b80c8ffdcb8355: baseline-arm-clabbe 2026-03-18 09:36:39,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7cf1f00b80c8ffdcb8355 2026-03-18 09:36:39,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:36:39,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cf1f00b80c8ffdcb8355 HTTP/1.1" 200 None 2026-03-18 09:36:39,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:36:39,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd3a3c9209b146d8e1d68 HTTP/1.1" 200 None 2026-03-18 09:36:39,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:36:39,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7cf1f00b80c8ffdcb8355 HTTP/1.1" 200 None 2026-03-18 09:36:39,617 - lava_callback - ERROR - Error processing callback for node 69b7cf1f00b80c8ffdcb8355: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 09:38:15,333 - lava_callback - INFO - Received callback for node 69ba1847d5731cbd74148ddb INFO: 172.21.0.1:55460 - "POST /node/69ba1847d5731cbd74148ddb HTTP/1.0" 202 Accepted 2026-03-18 09:38:15,340 - lava_callback - INFO - Starting async job submit for node 69ba1847d5731cbd74148ddb 2026-03-18 09:38:15,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:38:15,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba1847d5731cbd74148ddb HTTP/1.1" 200 None 2026-03-18 09:38:15,382 - lava_callback - DEBUG - Processing node 69ba1847d5731cbd74148ddb: baseline-arm64-broonie 2026-03-18 09:38:15,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:38:15,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:38:15,799 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba1847d5731cbd74148ddb/log.txt.gz 2026-03-18 09:38:15,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:38:16,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:38:16,212 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba1847d5731cbd74148ddb/lava-logs.yaml 2026-03-18 09:38:16,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:38:16,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:38:16,391 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba1847d5731cbd74148ddb/lava_callback.json.gz 2026-03-18 09:38:16,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:38:16,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba1847d5731cbd74148ddb HTTP/1.1" 200 None 2026-03-18 09:38:16,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:38:16,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-18 09:38:16,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:38:16,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba1847d5731cbd74148ddb HTTP/1.1" 200 None 2026-03-18 09:38:16,472 - lava_callback - INFO - Completed processing callback for node 69ba1847d5731cbd74148ddb INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:38:18,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:38:18,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:41:49,279 - lava_callback - INFO - Received callback for node 69b7d04e00b80c8ffdcb8920 INFO: 172.21.0.1:57114 - "POST /node/69b7d04e00b80c8ffdcb8920 HTTP/1.0" 202 Accepted 2026-03-18 09:41:49,284 - lava_callback - INFO - Starting async job submit for node 69b7d04e00b80c8ffdcb8920 2026-03-18 09:41:49,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:41:49,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d04e00b80c8ffdcb8920 HTTP/1.1" 200 None 2026-03-18 09:41:49,311 - lava_callback - DEBUG - Processing node 69b7d04e00b80c8ffdcb8920: baseline-arm-baylibre 2026-03-18 09:41:49,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d04e00b80c8ffdcb8920 2026-03-18 09:41:49,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:41:49,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d04e00b80c8ffdcb8920 HTTP/1.1" 200 None 2026-03-18 09:41:49,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:41:49,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-18 09:41:49,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:41:49,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d04e00b80c8ffdcb8920 HTTP/1.1" 200 None 2026-03-18 09:41:49,408 - lava_callback - ERROR - Error processing callback for node 69b7d04e00b80c8ffdcb8920: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45782 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:42:29,260 - lava_callback - INFO - Received callback for node 69b7d07600b80c8ffdcb892b INFO: 172.21.0.1:45786 - "POST /node/69b7d07600b80c8ffdcb892b HTTP/1.0" 202 Accepted 2026-03-18 09:42:29,286 - lava_callback - INFO - Starting async job submit for node 69b7d07600b80c8ffdcb892b 2026-03-18 09:42:29,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:42:29,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d07600b80c8ffdcb892b HTTP/1.1" 200 None 2026-03-18 09:42:29,320 - lava_callback - DEBUG - Processing node 69b7d07600b80c8ffdcb892b: baseline-arm-baylibre 2026-03-18 09:42:29,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d07600b80c8ffdcb892b 2026-03-18 09:42:29,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:42:29,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d07600b80c8ffdcb892b HTTP/1.1" 200 None 2026-03-18 09:42:29,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:42:29,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-18 09:42:29,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:42:29,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d07600b80c8ffdcb892b HTTP/1.1" 200 None 2026-03-18 09:42:29,395 - lava_callback - ERROR - Error processing callback for node 69b7d07600b80c8ffdcb892b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:42:44,017 - lava_callback - INFO - Received callback for node 69ba6fc9537ae4d3c8237902 INFO: 172.21.0.1:39386 - "POST /node/69ba6fc9537ae4d3c8237902 HTTP/1.0" 202 Accepted 2026-03-18 09:42:44,023 - lava_callback - INFO - Starting async job submit for node 69ba6fc9537ae4d3c8237902 2026-03-18 09:42:44,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:42:44,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6fc9537ae4d3c8237902 HTTP/1.1" 200 None 2026-03-18 09:42:44,118 - lava_callback - DEBUG - Processing node 69ba6fc9537ae4d3c8237902: baseline-arm 2026-03-18 09:42:44,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:42:44,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:42:44,890 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6fc9537ae4d3c8237902/log.txt.gz 2026-03-18 09:42:45,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:42:45,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:42:45,543 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6fc9537ae4d3c8237902/lava-logs.yaml 2026-03-18 09:42:45,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:42:45,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:42:45,714 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba6fc9537ae4d3c8237902/lava_callback.json.gz DEBUG: Setup failed for 69ba6fc9537ae4d3c8237902. Transitting job node result: incomplete -> fail 2026-03-18 09:42:45,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:42:45,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6fc9537ae4d3c8237902 HTTP/1.1" 200 None 2026-03-18 09:42:45,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:42:45,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 09:42:45,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:42:45,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6fc9537ae4d3c8237902 HTTP/1.1" 200 None 2026-03-18 09:42:46,043 - lava_callback - INFO - Completed processing callback for node 69ba6fc9537ae4d3c8237902 INFO: 172.21.0.1:39398 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:42:48,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:42:48,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33256 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:43:09,304 - lava_callback - INFO - Received callback for node 69b7d09f00b80c8ffdcb8940 INFO: 172.21.0.1:33268 - "POST /node/69b7d09f00b80c8ffdcb8940 HTTP/1.0" 202 Accepted 2026-03-18 09:43:09,320 - lava_callback - INFO - Starting async job submit for node 69b7d09f00b80c8ffdcb8940 2026-03-18 09:43:09,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:09,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d09f00b80c8ffdcb8940 HTTP/1.1" 200 None 2026-03-18 09:43:09,338 - lava_callback - DEBUG - Processing node 69b7d09f00b80c8ffdcb8940: baseline-arm-baylibre 2026-03-18 09:43:09,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d09f00b80c8ffdcb8940 2026-03-18 09:43:09,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:09,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d09f00b80c8ffdcb8940 HTTP/1.1" 200 None 2026-03-18 09:43:09,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:09,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-18 09:43:09,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:09,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d09f00b80c8ffdcb8940 HTTP/1.1" 200 None 2026-03-18 09:43:09,401 - lava_callback - ERROR - Error processing callback for node 69b7d09f00b80c8ffdcb8940: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57264 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:43:21,061 - lava_callback - INFO - Received callback for node 69ba7390537ae4d3c82379ca INFO: 172.21.0.1:50896 - "POST /node/69ba7390537ae4d3c82379ca HTTP/1.0" 202 Accepted 2026-03-18 09:43:21,068 - lava_callback - INFO - Starting async job submit for node 69ba7390537ae4d3c82379ca 2026-03-18 09:43:21,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:21,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7390537ae4d3c82379ca HTTP/1.1" 200 None 2026-03-18 09:43:21,101 - lava_callback - DEBUG - Processing node 69ba7390537ae4d3c82379ca: baseline-arm64 2026-03-18 09:43:21,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:21,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:21,384 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7390537ae4d3c82379ca/log.txt.gz 2026-03-18 09:43:21,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:21,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:21,709 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7390537ae4d3c82379ca/lava-logs.yaml 2026-03-18 09:43:21,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:21,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:21,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7390537ae4d3c82379ca/lava_callback.json.gz 2026-03-18 09:43:21,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:21,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7390537ae4d3c82379ca HTTP/1.1" 200 None 2026-03-18 09:43:21,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:21,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:43:21,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:21,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7390537ae4d3c82379ca HTTP/1.1" 200 None 2026-03-18 09:43:21,940 - lava_callback - INFO - Completed processing callback for node 69ba7390537ae4d3c82379ca 2026-03-18 09:43:25,658 - lava_callback - INFO - Received callback for node 69ba73a0537ae4d3c82379fa INFO: 172.21.0.1:50900 - "POST /node/69ba73a0537ae4d3c82379fa HTTP/1.0" 202 Accepted 2026-03-18 09:43:25,667 - lava_callback - INFO - Starting async job submit for node 69ba73a0537ae4d3c82379fa 2026-03-18 09:43:25,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:25,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a0537ae4d3c82379fa HTTP/1.1" 200 None 2026-03-18 09:43:25,686 - lava_callback - DEBUG - Processing node 69ba73a0537ae4d3c82379fa: baseline-nfs-arm64 2026-03-18 09:43:25,687 - lava_callback - WARNING - Failed to upload log 2026-03-18 09:43:25,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:25,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:25,837 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a0537ae4d3c82379fa/lava-logs.yaml 2026-03-18 09:43:25,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:25,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:25,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a0537ae4d3c82379fa/lava_callback.json.gz 2026-03-18 09:43:25,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:26,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a0537ae4d3c82379fa HTTP/1.1" 200 None 2026-03-18 09:43:26,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:26,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:43:26,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:26,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73a0537ae4d3c82379fa HTTP/1.1" 200 None 2026-03-18 09:43:26,054 - lava_callback - INFO - Completed processing callback for node 69ba73a0537ae4d3c82379fa INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:43:34,351 - lava_callback - INFO - Received callback for node 69ba7383537ae4d3c8237993 INFO: 172.21.0.1:45918 - "POST /node/69ba7383537ae4d3c8237993 HTTP/1.0" 202 Accepted 2026-03-18 09:43:34,358 - lava_callback - INFO - Starting async job submit for node 69ba7383537ae4d3c8237993 2026-03-18 09:43:34,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:34,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7383537ae4d3c8237993 HTTP/1.1" 200 None 2026-03-18 09:43:34,444 - lava_callback - DEBUG - Processing node 69ba7383537ae4d3c8237993: baseline-arm64 2026-03-18 09:43:34,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:34,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:34,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7383537ae4d3c8237993/log.txt.gz 2026-03-18 09:43:34,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:35,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:35,112 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7383537ae4d3c8237993/lava-logs.yaml 2026-03-18 09:43:35,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:35,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:35,354 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7383537ae4d3c8237993/lava_callback.json.gz 2026-03-18 09:43:35,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:35,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7383537ae4d3c8237993 HTTP/1.1" 200 None 2026-03-18 09:43:35,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:35,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:43:35,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:35,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7383537ae4d3c8237993 HTTP/1.1" 200 None 2026-03-18 09:43:35,457 - lava_callback - INFO - Completed processing callback for node 69ba7383537ae4d3c8237993 INFO: 172.21.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:43:48,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:48,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-18 09:43:49,337 - lava_callback - INFO - Received callback for node 69b7d0c800b80c8ffdcb894b INFO: 172.21.0.1:37210 - "POST /node/69b7d0c800b80c8ffdcb894b HTTP/1.0" 202 Accepted 2026-03-18 09:43:49,343 - lava_callback - INFO - Starting async job submit for node 69b7d0c800b80c8ffdcb894b 2026-03-18 09:43:49,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:49,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d0c800b80c8ffdcb894b HTTP/1.1" 200 None 2026-03-18 09:43:49,360 - lava_callback - DEBUG - Processing node 69b7d0c800b80c8ffdcb894b: baseline-arm-baylibre 2026-03-18 09:43:49,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d0c800b80c8ffdcb894b 2026-03-18 09:43:49,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:49,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d0c800b80c8ffdcb894b HTTP/1.1" 200 None 2026-03-18 09:43:49,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:49,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-18 09:43:49,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:49,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d0c800b80c8ffdcb894b HTTP/1.1" 200 None 2026-03-18 09:43:49,424 - lava_callback - ERROR - Error processing callback for node 69b7d0c800b80c8ffdcb894b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:43:50,448 - lava_callback - INFO - Received callback for node 69ba7384537ae4d3c8237999 INFO: 172.21.0.1:57638 - "POST /node/69ba7384537ae4d3c8237999 HTTP/1.0" 202 Accepted 2026-03-18 09:43:50,454 - lava_callback - INFO - Starting async job submit for node 69ba7384537ae4d3c8237999 2026-03-18 09:43:50,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:50,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7384537ae4d3c8237999 HTTP/1.1" 200 None 2026-03-18 09:43:50,490 - lava_callback - DEBUG - Processing node 69ba7384537ae4d3c8237999: baseline-arm64 2026-03-18 09:43:50,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:50,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:50,903 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7384537ae4d3c8237999/log.txt.gz 2026-03-18 09:43:51,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:51,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:51,307 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7384537ae4d3c8237999/lava-logs.yaml 2026-03-18 09:43:51,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:51,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:51,441 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7384537ae4d3c8237999/lava_callback.json.gz 2026-03-18 09:43:51,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:51,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7384537ae4d3c8237999 HTTP/1.1" 200 None 2026-03-18 09:43:51,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:51,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:43:51,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:51,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7384537ae4d3c8237999 HTTP/1.1" 200 None 2026-03-18 09:43:51,527 - lava_callback - INFO - Completed processing callback for node 69ba7384537ae4d3c8237999 2026-03-18 09:43:55,126 - lava_callback - INFO - Received callback for node 69ba7383537ae4d3c8237996 INFO: 172.21.0.1:57648 - "POST /node/69ba7383537ae4d3c8237996 HTTP/1.0" 202 Accepted 2026-03-18 09:43:55,132 - lava_callback - INFO - Starting async job submit for node 69ba7383537ae4d3c8237996 2026-03-18 09:43:55,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:55,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7383537ae4d3c8237996 HTTP/1.1" 200 None 2026-03-18 09:43:55,188 - lava_callback - DEBUG - Processing node 69ba7383537ae4d3c8237996: baseline-arm64 2026-03-18 09:43:55,276 - lava_callback - INFO - Received callback for node 69ba7388537ae4d3c82379a1 INFO: 172.21.0.1:57656 - "POST /node/69ba7388537ae4d3c82379a1 HTTP/1.0" 202 Accepted 2026-03-18 09:43:55,303 - lava_callback - INFO - Starting async job submit for node 69ba7388537ae4d3c82379a1 2026-03-18 09:43:55,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:55,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7388537ae4d3c82379a1 HTTP/1.1" 200 None 2026-03-18 09:43:55,462 - lava_callback - DEBUG - Processing node 69ba7388537ae4d3c82379a1: baseline-arm64 2026-03-18 09:43:55,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:55,609 - lava_callback - WARNING - Failed to upload log 2026-03-18 09:43:55,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:55,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:55,797 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7383537ae4d3c8237996/log.txt.gz 2026-03-18 09:43:55,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:55,948 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7388537ae4d3c82379a1/lava-logs.yaml 2026-03-18 09:43:55,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:55,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:56,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:56,110 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7388537ae4d3c82379a1/lava_callback.json.gz 2026-03-18 09:43:56,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:56,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7388537ae4d3c82379a1 HTTP/1.1" 200 None 2026-03-18 09:43:56,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:56,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:56,185 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7383537ae4d3c8237996/lava-logs.yaml 2026-03-18 09:43:56,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:56,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:43:56,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:56,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7388537ae4d3c82379a1 HTTP/1.1" 200 None 2026-03-18 09:43:56,316 - lava_callback - INFO - Completed processing callback for node 69ba7388537ae4d3c82379a1 2026-03-18 09:43:56,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:56,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7383537ae4d3c8237996/lava_callback.json.gz 2026-03-18 09:43:56,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:56,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7383537ae4d3c8237996 HTTP/1.1" 200 None 2026-03-18 09:43:56,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:43:56,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:43:56,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:56,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7383537ae4d3c8237996 HTTP/1.1" 200 None 2026-03-18 09:43:56,553 - lava_callback - INFO - Completed processing callback for node 69ba7383537ae4d3c8237996 2026-03-18 09:43:57,918 - lava_callback - INFO - Received callback for node 69ba738d537ae4d3c82379c1 INFO: 172.21.0.1:57672 - "POST /node/69ba738d537ae4d3c82379c1 HTTP/1.0" 202 Accepted 2026-03-18 09:43:57,924 - lava_callback - INFO - Starting async job submit for node 69ba738d537ae4d3c82379c1 2026-03-18 09:43:57,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:57,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba738d537ae4d3c82379c1 HTTP/1.1" 200 None 2026-03-18 09:43:57,963 - lava_callback - DEBUG - Processing node 69ba738d537ae4d3c82379c1: baseline-arm64 2026-03-18 09:43:58,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:58,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:58,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738d537ae4d3c82379c1/log.txt.gz 2026-03-18 09:43:58,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:58,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:58,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738d537ae4d3c82379c1/lava-logs.yaml 2026-03-18 09:43:58,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:43:59,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:43:59,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738d537ae4d3c82379c1/lava_callback.json.gz 2026-03-18 09:43:59,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:59,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba738d537ae4d3c82379c1 HTTP/1.1" 200 None 2026-03-18 09:43:59,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:59,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:43:59,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:43:59,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba738d537ae4d3c82379c1 HTTP/1.1" 200 None 2026-03-18 09:43:59,152 - lava_callback - INFO - Completed processing callback for node 69ba738d537ae4d3c82379c1 2026-03-18 09:44:05,052 - lava_callback - INFO - Received callback for node 69ba7391537ae4d3c82379cd INFO: 172.21.0.1:56642 - "POST /node/69ba7391537ae4d3c82379cd HTTP/1.0" 202 Accepted 2026-03-18 09:44:05,058 - lava_callback - INFO - Starting async job submit for node 69ba7391537ae4d3c82379cd 2026-03-18 09:44:05,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:05,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7391537ae4d3c82379cd HTTP/1.1" 200 None 2026-03-18 09:44:05,098 - lava_callback - DEBUG - Processing node 69ba7391537ae4d3c82379cd: baseline-arm64 2026-03-18 09:44:05,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:05,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:05,450 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7391537ae4d3c82379cd/log.txt.gz 2026-03-18 09:44:05,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:05,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:05,778 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7391537ae4d3c82379cd/lava-logs.yaml 2026-03-18 09:44:05,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:05,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:05,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7391537ae4d3c82379cd/lava_callback.json.gz 2026-03-18 09:44:05,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:05,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7391537ae4d3c82379cd HTTP/1.1" 200 None 2026-03-18 09:44:05,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:05,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:05,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:06,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7391537ae4d3c82379cd HTTP/1.1" 200 None 2026-03-18 09:44:06,011 - lava_callback - INFO - Completed processing callback for node 69ba7391537ae4d3c82379cd INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56658 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:44:09,764 - lava_callback - INFO - Received callback for node 69ba738c537ae4d3c82379be INFO: 172.21.0.1:51630 - "POST /node/69ba738c537ae4d3c82379be HTTP/1.0" 202 Accepted 2026-03-18 09:44:09,770 - lava_callback - INFO - Starting async job submit for node 69ba738c537ae4d3c82379be 2026-03-18 09:44:09,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:09,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba738c537ae4d3c82379be HTTP/1.1" 200 None 2026-03-18 09:44:09,811 - lava_callback - DEBUG - Processing node 69ba738c537ae4d3c82379be: baseline-arm64 2026-03-18 09:44:10,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:10,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:10,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738c537ae4d3c82379be/log.txt.gz 2026-03-18 09:44:10,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:10,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:10,550 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738c537ae4d3c82379be/lava-logs.yaml 2026-03-18 09:44:10,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:10,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:10,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738c537ae4d3c82379be/lava_callback.json.gz 2026-03-18 09:44:10,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:10,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba738c537ae4d3c82379be HTTP/1.1" 200 None 2026-03-18 09:44:10,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:10,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:10,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:10,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba738c537ae4d3c82379be HTTP/1.1" 200 None 2026-03-18 09:44:10,870 - lava_callback - INFO - Completed processing callback for node 69ba738c537ae4d3c82379be INFO: 172.21.0.1:51644 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 09:44:16,163 - lava_callback - INFO - Received callback for node 69ba7396537ae4d3c82379df INFO: 172.21.0.1:51646 - "POST /node/69ba7396537ae4d3c82379df HTTP/1.0" 202 Accepted 2026-03-18 09:44:16,169 - lava_callback - INFO - Starting async job submit for node 69ba7396537ae4d3c82379df 2026-03-18 09:44:16,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:16,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7396537ae4d3c82379df HTTP/1.1" 200 None 2026-03-18 09:44:16,213 - lava_callback - DEBUG - Processing node 69ba7396537ae4d3c82379df: baseline-arm64 2026-03-18 09:44:16,494 - lava_callback - INFO - Received callback for node 69ba7394537ae4d3c82379d3 INFO: 172.21.0.1:51662 - "POST /node/69ba7394537ae4d3c82379d3 HTTP/1.0" 202 Accepted 2026-03-18 09:44:16,501 - lava_callback - INFO - Starting async job submit for node 69ba7394537ae4d3c82379d3 2026-03-18 09:44:16,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:16,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51672 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:44:16,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7394537ae4d3c82379d3 HTTP/1.1" 200 None 2026-03-18 09:44:16,549 - lava_callback - DEBUG - Processing node 69ba7394537ae4d3c82379d3: baseline-arm64 2026-03-18 09:44:16,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:16,716 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7396537ae4d3c82379df/log.txt.gz 2026-03-18 09:44:17,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:17,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:17,165 - lava_callback - INFO - Received callback for node 69ba7389537ae4d3c82379a6 2026-03-18 09:44:17,173 - lava_callback - INFO - Starting async job submit for node 69ba7389537ae4d3c82379a6 INFO: 172.21.0.1:51686 - "POST /node/69ba7389537ae4d3c82379a6 HTTP/1.0" 202 Accepted 2026-03-18 09:44:17,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:17,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:17,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7394537ae4d3c82379d3/log.txt.gz 2026-03-18 09:44:17,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7389537ae4d3c82379a6 HTTP/1.1" 200 None 2026-03-18 09:44:17,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:17,302 - lava_callback - DEBUG - Processing node 69ba7389537ae4d3c82379a6: baseline-arm64 2026-03-18 09:44:17,396 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7396537ae4d3c82379df/lava-logs.yaml 2026-03-18 09:44:17,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:17,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:17,613 - lava_callback - WARNING - Failed to upload log 2026-03-18 09:44:17,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:17,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:17,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7396537ae4d3c82379df/lava_callback.json.gz 2026-03-18 09:44:17,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:17,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7396537ae4d3c82379df HTTP/1.1" 200 None 2026-03-18 09:44:17,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:17,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:17,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:17,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7396537ae4d3c82379df HTTP/1.1" 200 None 2026-03-18 09:44:17,920 - lava_callback - INFO - Completed processing callback for node 69ba7396537ae4d3c82379df 2026-03-18 09:44:17,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:17,927 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7394537ae4d3c82379d3/lava-logs.yaml 2026-03-18 09:44:17,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:17,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:17,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7389537ae4d3c82379a6/lava-logs.yaml 2026-03-18 09:44:17,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:18,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:18,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:18,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7389537ae4d3c82379a6/lava_callback.json.gz 2026-03-18 09:44:18,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:18,169 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7394537ae4d3c82379d3/lava_callback.json.gz 2026-03-18 09:44:18,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:18,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-18 09:44:18,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:18,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7394537ae4d3c82379d3 HTTP/1.1" 200 None 2026-03-18 09:44:18,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7389537ae4d3c82379a6 HTTP/1.1" 200 None 2026-03-18 09:44:18,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:18,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:18,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:18,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:18,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:18,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:18,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7389537ae4d3c82379a6 HTTP/1.1" 200 None 2026-03-18 09:44:18,390 - lava_callback - INFO - Completed processing callback for node 69ba7389537ae4d3c82379a6 2026-03-18 09:44:18,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7394537ae4d3c82379d3 HTTP/1.1" 200 None 2026-03-18 09:44:18,404 - lava_callback - INFO - Completed processing callback for node 69ba7394537ae4d3c82379d3 2026-03-18 09:44:24,812 - lava_callback - INFO - Received callback for node 69ba738f537ae4d3c82379c7 INFO: 172.21.0.1:47650 - "POST /node/69ba738f537ae4d3c82379c7 HTTP/1.0" 202 Accepted 2026-03-18 09:44:24,818 - lava_callback - INFO - Starting async job submit for node 69ba738f537ae4d3c82379c7 2026-03-18 09:44:24,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:24,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba738f537ae4d3c82379c7 HTTP/1.1" 200 None 2026-03-18 09:44:24,855 - lava_callback - DEBUG - Processing node 69ba738f537ae4d3c82379c7: baseline-arm64 2026-03-18 09:44:25,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:25,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:25,395 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738f537ae4d3c82379c7/log.txt.gz 2026-03-18 09:44:25,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:25,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:25,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738f537ae4d3c82379c7/lava-logs.yaml 2026-03-18 09:44:25,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:25,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:25,982 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738f537ae4d3c82379c7/lava_callback.json.gz 2026-03-18 09:44:26,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:26,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba738f537ae4d3c82379c7 HTTP/1.1" 200 None 2026-03-18 09:44:26,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:26,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:26,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:26,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba738f537ae4d3c82379c7 HTTP/1.1" 200 None 2026-03-18 09:44:26,161 - lava_callback - INFO - Completed processing callback for node 69ba738f537ae4d3c82379c7 INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:44:29,383 - lava_callback - INFO - Received callback for node 69b7d0f100b80c8ffdcb895a INFO: 172.21.0.1:47670 - "POST /node/69b7d0f100b80c8ffdcb895a HTTP/1.0" 202 Accepted 2026-03-18 09:44:29,388 - lava_callback - INFO - Starting async job submit for node 69b7d0f100b80c8ffdcb895a 2026-03-18 09:44:29,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:29,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d0f100b80c8ffdcb895a HTTP/1.1" 200 None 2026-03-18 09:44:29,404 - lava_callback - DEBUG - Processing node 69b7d0f100b80c8ffdcb895a: baseline-arm-baylibre 2026-03-18 09:44:29,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d0f100b80c8ffdcb895a 2026-03-18 09:44:29,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:29,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d0f100b80c8ffdcb895a HTTP/1.1" 200 None 2026-03-18 09:44:29,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:29,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-18 09:44:29,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:29,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d0f100b80c8ffdcb895a HTTP/1.1" 200 None 2026-03-18 09:44:29,467 - lava_callback - ERROR - Error processing callback for node 69b7d0f100b80c8ffdcb895a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:44:30,712 - lava_callback - INFO - Received callback for node 69ba73a4537ae4d3c8237a03 INFO: 172.21.0.1:55656 - "POST /node/69ba73a4537ae4d3c8237a03 HTTP/1.0" 202 Accepted 2026-03-18 09:44:30,718 - lava_callback - INFO - Starting async job submit for node 69ba73a4537ae4d3c8237a03 2026-03-18 09:44:30,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:30,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a4537ae4d3c8237a03 HTTP/1.1" 200 None 2026-03-18 09:44:30,757 - lava_callback - DEBUG - Processing node 69ba73a4537ae4d3c8237a03: baseline-nfs-arm64 2026-03-18 09:44:31,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:31,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:31,327 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a4537ae4d3c8237a03/log.txt.gz 2026-03-18 09:44:31,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:31,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:31,758 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a4537ae4d3c8237a03/lava-logs.yaml 2026-03-18 09:44:31,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:31,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:31,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a4537ae4d3c8237a03/lava_callback.json.gz 2026-03-18 09:44:31,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:31,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a4537ae4d3c8237a03 HTTP/1.1" 200 None 2026-03-18 09:44:31,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:32,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:32,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:32,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73a4537ae4d3c8237a03 HTTP/1.1" 200 None 2026-03-18 09:44:32,048 - lava_callback - INFO - Completed processing callback for node 69ba73a4537ae4d3c8237a03 2026-03-18 09:44:33,745 - lava_callback - INFO - Received callback for node 69ba73ce537ae4d3c8237a9a INFO: 172.21.0.1:55670 - "POST /node/69ba73ce537ae4d3c8237a9a HTTP/1.0" 202 Accepted 2026-03-18 09:44:33,751 - lava_callback - INFO - Starting async job submit for node 69ba73ce537ae4d3c8237a9a 2026-03-18 09:44:33,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:33,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73ce537ae4d3c8237a9a HTTP/1.1" 200 None 2026-03-18 09:44:33,797 - lava_callback - DEBUG - Processing node 69ba73ce537ae4d3c8237a9a: baseline-arm64-foundriesio 2026-03-18 09:44:34,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:34,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:34,166 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ba73ce537ae4d3c8237a9a/log.txt.gz 2026-03-18 09:44:34,203 - lava_callback - INFO - Received callback for node 69ba73cf537ae4d3c8237a9d INFO: 172.21.0.1:55684 - "POST /node/69ba73cf537ae4d3c8237a9d HTTP/1.0" 202 Accepted 2026-03-18 09:44:34,222 - lava_callback - INFO - Starting async job submit for node 69ba73cf537ae4d3c8237a9d 2026-03-18 09:44:34,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:34,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73cf537ae4d3c8237a9d HTTP/1.1" 200 None 2026-03-18 09:44:34,353 - lava_callback - DEBUG - Processing node 69ba73cf537ae4d3c8237a9d: baseline-arm64-foundriesio 2026-03-18 09:44:34,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:34,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:34,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ba73ce537ae4d3c8237a9a/lava-logs.yaml 2026-03-18 09:44:34,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:34,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:34,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:34,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ba73ce537ae4d3c8237a9a/lava_callback.json.gz 2026-03-18 09:44:35,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:35,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:35,015 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ba73cf537ae4d3c8237a9d/log.txt.gz 2026-03-18 09:44:35,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73ce537ae4d3c8237a9a HTTP/1.1" 200 None 2026-03-18 09:44:35,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:35,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:35,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:35,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73ce537ae4d3c8237a9a HTTP/1.1" 200 None 2026-03-18 09:44:35,286 - lava_callback - INFO - Completed processing callback for node 69ba73ce537ae4d3c8237a9a 2026-03-18 09:44:35,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:35,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:35,671 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ba73cf537ae4d3c8237a9d/lava-logs.yaml 2026-03-18 09:44:35,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:35,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:35,867 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ba73cf537ae4d3c8237a9d/lava_callback.json.gz 2026-03-18 09:44:35,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:35,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73cf537ae4d3c8237a9d HTTP/1.1" 200 None 2026-03-18 09:44:35,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:35,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:35,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:35,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73cf537ae4d3c8237a9d HTTP/1.1" 200 None 2026-03-18 09:44:35,979 - lava_callback - INFO - Completed processing callback for node 69ba73cf537ae4d3c8237a9d INFO: 172.21.0.1:55698 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:44:37,602 - lava_callback - INFO - Received callback for node 69ba739e537ae4d3c82379f4 INFO: 172.21.0.1:55704 - "POST /node/69ba739e537ae4d3c82379f4 HTTP/1.0" 202 Accepted 2026-03-18 09:44:37,609 - lava_callback - INFO - Starting async job submit for node 69ba739e537ae4d3c82379f4 2026-03-18 09:44:37,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:37,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba739e537ae4d3c82379f4 HTTP/1.1" 200 None 2026-03-18 09:44:37,649 - lava_callback - DEBUG - Processing node 69ba739e537ae4d3c82379f4: baseline-nfs-arm64 2026-03-18 09:44:38,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:38,090 - lava_callback - INFO - Received callback for node 69ba73a6537ae4d3c8237a0a INFO: 172.21.0.1:55706 - "POST /node/69ba73a6537ae4d3c8237a0a HTTP/1.0" 202 Accepted 2026-03-18 09:44:38,096 - lava_callback - INFO - Starting async job submit for node 69ba73a6537ae4d3c8237a0a 2026-03-18 09:44:38,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:38,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a6537ae4d3c8237a0a HTTP/1.1" 200 None 2026-03-18 09:44:38,135 - lava_callback - DEBUG - Processing node 69ba73a6537ae4d3c8237a0a: baseline-nfs-arm64 2026-03-18 09:44:38,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:38,285 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739e537ae4d3c82379f4/log.txt.gz 2026-03-18 09:44:38,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:38,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:38,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:38,919 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a6537ae4d3c8237a0a/log.txt.gz 2026-03-18 09:44:39,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:39,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:39,249 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739e537ae4d3c82379f4/lava-logs.yaml 2026-03-18 09:44:39,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:39,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:39,423 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a6537ae4d3c8237a0a/lava-logs.yaml 2026-03-18 09:44:39,433 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:39,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:39,435 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739e537ae4d3c82379f4/lava_callback.json.gz 2026-03-18 09:44:39,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:39,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba739e537ae4d3c82379f4 HTTP/1.1" 200 None 2026-03-18 09:44:39,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:39,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:39,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:39,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba739e537ae4d3c82379f4 HTTP/1.1" 200 None 2026-03-18 09:44:39,536 - lava_callback - INFO - Completed processing callback for node 69ba739e537ae4d3c82379f4 2026-03-18 09:44:39,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:39,682 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a6537ae4d3c8237a0a/lava_callback.json.gz 2026-03-18 09:44:39,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:39,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a6537ae4d3c8237a0a HTTP/1.1" 200 None 2026-03-18 09:44:39,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:39,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:39,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:39,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73a6537ae4d3c8237a0a HTTP/1.1" 200 None 2026-03-18 09:44:39,784 - lava_callback - INFO - Completed processing callback for node 69ba73a6537ae4d3c8237a0a 2026-03-18 09:44:39,928 - lava_callback - INFO - Received callback for node 69ba73bd537ae4d3c8237a54 INFO: 172.21.0.1:34416 - "POST /node/69ba73bd537ae4d3c8237a54 HTTP/1.0" 202 Accepted 2026-03-18 09:44:39,935 - lava_callback - INFO - Starting async job submit for node 69ba73bd537ae4d3c8237a54 2026-03-18 09:44:39,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:39,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73bd537ae4d3c8237a54 HTTP/1.1" 200 None 2026-03-18 09:44:39,982 - lava_callback - DEBUG - Processing node 69ba73bd537ae4d3c8237a54: baseline-arm64-broonie 2026-03-18 09:44:40,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:40,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:40,392 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73bd537ae4d3c8237a54/log.txt.gz 2026-03-18 09:44:40,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:40,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:40,751 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73bd537ae4d3c8237a54/lava-logs.yaml 2026-03-18 09:44:40,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:40,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:40,892 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73bd537ae4d3c8237a54/lava_callback.json.gz 2026-03-18 09:44:40,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:40,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73bd537ae4d3c8237a54 HTTP/1.1" 200 None 2026-03-18 09:44:40,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:40,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:40,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:40,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73bd537ae4d3c8237a54 HTTP/1.1" 200 None 2026-03-18 09:44:40,979 - lava_callback - INFO - Completed processing callback for node 69ba73bd537ae4d3c8237a54 INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:44:48,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:48,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-18 09:44:49,574 - lava_callback - INFO - Received callback for node 69ba73a1537ae4d3c82379fd INFO: 172.21.0.1:34434 - "POST /node/69ba73a1537ae4d3c82379fd HTTP/1.0" 202 Accepted 2026-03-18 09:44:49,581 - lava_callback - INFO - Starting async job submit for node 69ba73a1537ae4d3c82379fd 2026-03-18 09:44:49,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:49,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a1537ae4d3c82379fd HTTP/1.1" 200 None 2026-03-18 09:44:49,621 - lava_callback - DEBUG - Processing node 69ba73a1537ae4d3c82379fd: baseline-nfs-arm64 2026-03-18 09:44:49,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:50,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:50,050 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a1537ae4d3c82379fd/log.txt.gz 2026-03-18 09:44:50,137 - lava_callback - INFO - Received callback for node 69ba73cc537ae4d3c8237a94 INFO: 172.21.0.1:49552 - "POST /node/69ba73cc537ae4d3c8237a94 HTTP/1.0" 202 Accepted 2026-03-18 09:44:50,161 - lava_callback - INFO - Starting async job submit for node 69ba73cc537ae4d3c8237a94 2026-03-18 09:44:50,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:50,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:50,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73cc537ae4d3c8237a94 HTTP/1.1" 200 None 2026-03-18 09:44:50,285 - lava_callback - DEBUG - Processing node 69ba73cc537ae4d3c8237a94: baseline-arm64-pengutronix 2026-03-18 09:44:50,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:50,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:50,590 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a1537ae4d3c82379fd/lava-logs.yaml 2026-03-18 09:44:50,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:50,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:50,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ba73cc537ae4d3c8237a94/log.txt.gz 2026-03-18 09:44:50,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:50,789 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a1537ae4d3c82379fd/lava_callback.json.gz 2026-03-18 09:44:50,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:50,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:50,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a1537ae4d3c82379fd HTTP/1.1" 200 None 2026-03-18 09:44:50,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:50,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:50,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:50,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73a1537ae4d3c82379fd HTTP/1.1" 200 None 2026-03-18 09:44:50,885 - lava_callback - INFO - Completed processing callback for node 69ba73a1537ae4d3c82379fd 2026-03-18 09:44:51,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:51,051 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ba73cc537ae4d3c8237a94/lava-logs.yaml 2026-03-18 09:44:51,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:51,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:51,240 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ba73cc537ae4d3c8237a94/lava_callback.json.gz 2026-03-18 09:44:51,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:51,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73cc537ae4d3c8237a94 HTTP/1.1" 200 None 2026-03-18 09:44:51,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:51,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:51,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:51,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73cc537ae4d3c8237a94 HTTP/1.1" 200 None 2026-03-18 09:44:51,333 - lava_callback - INFO - Completed processing callback for node 69ba73cc537ae4d3c8237a94 2026-03-18 09:44:51,346 - lava_callback - INFO - Received callback for node 69ba739b537ae4d3c82379ee INFO: 172.21.0.1:49566 - "POST /node/69ba739b537ae4d3c82379ee HTTP/1.0" 202 Accepted 2026-03-18 09:44:51,406 - lava_callback - INFO - Starting async job submit for node 69ba739b537ae4d3c82379ee 2026-03-18 09:44:51,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:51,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba739b537ae4d3c82379ee HTTP/1.1" 200 None 2026-03-18 09:44:51,454 - lava_callback - DEBUG - Processing node 69ba739b537ae4d3c82379ee: baseline-nfs-arm64 2026-03-18 09:44:51,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:51,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:51,911 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739b537ae4d3c82379ee/log.txt.gz 2026-03-18 09:44:52,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:52,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:52,318 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739b537ae4d3c82379ee/lava-logs.yaml 2026-03-18 09:44:52,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:52,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:52,465 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739b537ae4d3c82379ee/lava_callback.json.gz 2026-03-18 09:44:52,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:52,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba739b537ae4d3c82379ee HTTP/1.1" 200 None 2026-03-18 09:44:52,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:52,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:52,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:52,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba739b537ae4d3c82379ee HTTP/1.1" 200 None 2026-03-18 09:44:52,585 - lava_callback - INFO - Completed processing callback for node 69ba739b537ae4d3c82379ee 2026-03-18 09:44:54,257 - lava_callback - INFO - Received callback for node 69ba73cb537ae4d3c8237a91 INFO: 172.21.0.1:49574 - "POST /node/69ba73cb537ae4d3c8237a91 HTTP/1.0" 202 Accepted 2026-03-18 09:44:54,263 - lava_callback - INFO - Starting async job submit for node 69ba73cb537ae4d3c8237a91 2026-03-18 09:44:54,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:54,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73cb537ae4d3c8237a91 HTTP/1.1" 200 None 2026-03-18 09:44:54,302 - lava_callback - DEBUG - Processing node 69ba73cb537ae4d3c8237a91: baseline-arm64-pengutronix 2026-03-18 09:44:54,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:54,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:54,618 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ba73cb537ae4d3c8237a91/log.txt.gz 2026-03-18 09:44:54,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:54,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:54,907 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ba73cb537ae4d3c8237a91/lava-logs.yaml 2026-03-18 09:44:54,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:55,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:55,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ba73cb537ae4d3c8237a91/lava_callback.json.gz 2026-03-18 09:44:55,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:55,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73cb537ae4d3c8237a91 HTTP/1.1" 200 None 2026-03-18 09:44:55,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:55,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:55,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:55,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73cb537ae4d3c8237a91 HTTP/1.1" 200 None 2026-03-18 09:44:55,149 - lava_callback - INFO - Completed processing callback for node 69ba73cb537ae4d3c8237a91 2026-03-18 09:44:55,607 - lava_callback - INFO - Received callback for node 69ba73c0537ae4d3c8237a5c INFO: 172.21.0.1:49584 - "POST /node/69ba73c0537ae4d3c8237a5c HTTP/1.0" 202 Accepted 2026-03-18 09:44:55,613 - lava_callback - INFO - Starting async job submit for node 69ba73c0537ae4d3c8237a5c 2026-03-18 09:44:55,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:55,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c0537ae4d3c8237a5c HTTP/1.1" 200 None 2026-03-18 09:44:55,654 - lava_callback - DEBUG - Processing node 69ba73c0537ae4d3c8237a5c: baseline-arm64-broonie 2026-03-18 09:44:55,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:56,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:56,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73c0537ae4d3c8237a5c/log.txt.gz 2026-03-18 09:44:56,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:56,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:56,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73c0537ae4d3c8237a5c/lava-logs.yaml 2026-03-18 09:44:56,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:44:56,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:56,563 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73c0537ae4d3c8237a5c/lava_callback.json.gz 2026-03-18 09:44:56,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:56,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c0537ae4d3c8237a5c HTTP/1.1" 200 None 2026-03-18 09:44:56,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:56,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:56,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:56,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73c0537ae4d3c8237a5c HTTP/1.1" 200 None 2026-03-18 09:44:56,658 - lava_callback - INFO - Completed processing callback for node 69ba73c0537ae4d3c8237a5c 2026-03-18 09:44:58,449 - lava_callback - INFO - Received callback for node 69ba738e537ae4d3c82379c4 INFO: 172.21.0.1:49602 - "POST /node/69ba738e537ae4d3c82379c4 HTTP/1.0" 202 Accepted 2026-03-18 09:44:58,455 - lava_callback - INFO - Starting async job submit for node 69ba738e537ae4d3c82379c4 2026-03-18 09:44:58,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:58,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba738e537ae4d3c82379c4 HTTP/1.1" 200 None 2026-03-18 09:44:58,492 - lava_callback - DEBUG - Processing node 69ba738e537ae4d3c82379c4: baseline-arm64 2026-03-18 09:44:58,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:58,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:58,949 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738e537ae4d3c82379c4/log.txt.gz 2026-03-18 09:44:59,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:59,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:59,335 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738e537ae4d3c82379c4/lava-logs.yaml 2026-03-18 09:44:59,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:44:59,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:44:59,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738e537ae4d3c82379c4/lava_callback.json.gz 2026-03-18 09:44:59,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:59,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba738e537ae4d3c82379c4 HTTP/1.1" 200 None 2026-03-18 09:44:59,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:59,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:44:59,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:44:59,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba738e537ae4d3c82379c4 HTTP/1.1" 200 None 2026-03-18 09:44:59,636 - lava_callback - INFO - Completed processing callback for node 69ba738e537ae4d3c82379c4 INFO: 172.21.0.1:58530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:45:09,386 - lava_callback - INFO - Received callback for node 69b7d11900b80c8ffdcb8968 INFO: 172.21.0.1:58548 - "POST /node/69b7d11900b80c8ffdcb8968 HTTP/1.0" 202 Accepted 2026-03-18 09:45:09,392 - lava_callback - INFO - Starting async job submit for node 69b7d11900b80c8ffdcb8968 2026-03-18 09:45:09,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:09,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d11900b80c8ffdcb8968 HTTP/1.1" 200 None 2026-03-18 09:45:09,408 - lava_callback - DEBUG - Processing node 69b7d11900b80c8ffdcb8968: baseline-arm-baylibre 2026-03-18 09:45:09,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d11900b80c8ffdcb8968 2026-03-18 09:45:09,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:09,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d11900b80c8ffdcb8968 HTTP/1.1" 200 None 2026-03-18 09:45:09,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:09,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-18 09:45:09,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:09,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d11900b80c8ffdcb8968 HTTP/1.1" 200 None 2026-03-18 09:45:09,464 - lava_callback - ERROR - Error processing callback for node 69b7d11900b80c8ffdcb8968: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:45:10,208 - lava_callback - INFO - Received callback for node 69ba73cd537ae4d3c8237a97 INFO: 172.21.0.1:56380 - "POST /node/69ba73cd537ae4d3c8237a97 HTTP/1.0" 202 Accepted 2026-03-18 09:45:10,214 - lava_callback - INFO - Starting async job submit for node 69ba73cd537ae4d3c8237a97 2026-03-18 09:45:10,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:10,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73cd537ae4d3c8237a97 HTTP/1.1" 200 None 2026-03-18 09:45:10,249 - lava_callback - DEBUG - Processing node 69ba73cd537ae4d3c8237a97: baseline-arm64-pengutronix 2026-03-18 09:45:10,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:10,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:10,582 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ba73cd537ae4d3c8237a97/log.txt.gz 2026-03-18 09:45:10,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:10,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:10,903 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ba73cd537ae4d3c8237a97/lava-logs.yaml 2026-03-18 09:45:10,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:11,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:11,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ba73cd537ae4d3c8237a97/lava_callback.json.gz 2026-03-18 09:45:11,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:11,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73cd537ae4d3c8237a97 HTTP/1.1" 200 None 2026-03-18 09:45:11,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:11,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:45:11,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:11,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73cd537ae4d3c8237a97 HTTP/1.1" 200 None 2026-03-18 09:45:11,135 - lava_callback - INFO - Completed processing callback for node 69ba73cd537ae4d3c8237a97 INFO: 172.21.0.1:56388 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 09:45:16,486 - lava_callback - INFO - Received callback for node 69ba73b8537ae4d3c8237a47 INFO: 172.21.0.1:56398 - "POST /node/69ba73b8537ae4d3c8237a47 HTTP/1.0" 202 Accepted 2026-03-18 09:45:16,492 - lava_callback - INFO - Starting async job submit for node 69ba73b8537ae4d3c8237a47 2026-03-18 09:45:16,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:16,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73b8537ae4d3c8237a47 HTTP/1.1" 200 None 2026-03-18 09:45:16,540 - lava_callback - DEBUG - Processing node 69ba73b8537ae4d3c8237a47: baseline-arm64-broonie INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:45:16,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:16,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:16,949 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73b8537ae4d3c8237a47/log.txt.gz 2026-03-18 09:45:17,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:17,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:17,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73b8537ae4d3c8237a47/lava-logs.yaml 2026-03-18 09:45:17,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:17,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:17,520 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73b8537ae4d3c8237a47/lava_callback.json.gz 2026-03-18 09:45:17,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:17,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73b8537ae4d3c8237a47 HTTP/1.1" 200 None 2026-03-18 09:45:17,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:17,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:45:17,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:17,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73b8537ae4d3c8237a47 HTTP/1.1" 200 None 2026-03-18 09:45:17,604 - lava_callback - INFO - Completed processing callback for node 69ba73b8537ae4d3c8237a47 2026-03-18 09:45:17,955 - lava_callback - INFO - Received callback for node 69ba73ba537ae4d3c8237a4e INFO: 172.21.0.1:56410 - "POST /node/69ba73ba537ae4d3c8237a4e HTTP/1.0" 202 Accepted 2026-03-18 09:45:17,968 - lava_callback - INFO - Starting async job submit for node 69ba73ba537ae4d3c8237a4e 2026-03-18 09:45:18,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:18,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73ba537ae4d3c8237a4e HTTP/1.1" 200 None 2026-03-18 09:45:18,045 - lava_callback - DEBUG - Processing node 69ba73ba537ae4d3c8237a4e: baseline-arm64-broonie 2026-03-18 09:45:18,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:18,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:18,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-18 09:45:18,429 - lava_callback - INFO - Received callback for node 69ba73c7537ae4d3c8237a6e INFO: 172.21.0.1:56416 - "POST /node/69ba73c7537ae4d3c8237a6e HTTP/1.0" 202 Accepted 2026-03-18 09:45:18,435 - lava_callback - INFO - Starting async job submit for node 69ba73c7537ae4d3c8237a6e 2026-03-18 09:45:18,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:18,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:18,461 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73ba537ae4d3c8237a4e/log.txt.gz 2026-03-18 09:45:18,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c7537ae4d3c8237a6e HTTP/1.1" 200 None 2026-03-18 09:45:18,534 - lava_callback - DEBUG - Processing node 69ba73c7537ae4d3c8237a6e: baseline-arm64-clabbe 2026-03-18 09:45:18,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:18,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:18,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:18,990 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73ba537ae4d3c8237a4e/lava-logs.yaml 2026-03-18 09:45:18,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:19,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:19,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ba73c7537ae4d3c8237a6e/log.txt.gz 2026-03-18 09:45:19,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:19,180 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73ba537ae4d3c8237a4e/lava_callback.json.gz 2026-03-18 09:45:19,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:19,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:19,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73ba537ae4d3c8237a4e HTTP/1.1" 200 None 2026-03-18 09:45:19,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:19,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:45:19,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:19,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73ba537ae4d3c8237a4e HTTP/1.1" 200 None 2026-03-18 09:45:19,287 - lava_callback - INFO - Completed processing callback for node 69ba73ba537ae4d3c8237a4e 2026-03-18 09:45:19,342 - lava_callback - INFO - Received callback for node 69ba73be537ae4d3c8237a59 INFO: 172.21.0.1:56422 - "POST /node/69ba73be537ae4d3c8237a59 HTTP/1.0" 202 Accepted 2026-03-18 09:45:19,354 - lava_callback - INFO - Starting async job submit for node 69ba73be537ae4d3c8237a59 2026-03-18 09:45:19,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:19,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73be537ae4d3c8237a59 HTTP/1.1" 200 None 2026-03-18 09:45:19,425 - lava_callback - DEBUG - Processing node 69ba73be537ae4d3c8237a59: baseline-arm64-broonie 2026-03-18 09:45:19,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:19,507 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ba73c7537ae4d3c8237a6e/lava-logs.yaml 2026-03-18 09:45:19,555 - lava_callback - INFO - Received callback for node 69ba73c2537ae4d3c8237a5f INFO: 172.21.0.1:56424 - "POST /node/69ba73c2537ae4d3c8237a5f HTTP/1.0" 202 Accepted 2026-03-18 09:45:19,572 - lava_callback - INFO - Starting async job submit for node 69ba73c2537ae4d3c8237a5f 2026-03-18 09:45:19,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:19,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:19,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c2537ae4d3c8237a5f HTTP/1.1" 200 None 2026-03-18 09:45:19,722 - lava_callback - DEBUG - Processing node 69ba73c2537ae4d3c8237a5f: baseline-arm64-broonie 2026-03-18 09:45:20,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:20,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ba73c7537ae4d3c8237a6e/lava_callback.json.gz 2026-03-18 09:45:20,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:20,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:20,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:20,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c7537ae4d3c8237a6e HTTP/1.1" 200 None 2026-03-18 09:45:20,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:20,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:45:20,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:20,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73c7537ae4d3c8237a6e HTTP/1.1" 200 None 2026-03-18 09:45:20,228 - lava_callback - INFO - Completed processing callback for node 69ba73c7537ae4d3c8237a6e 2026-03-18 09:45:20,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:20,350 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73c2537ae4d3c8237a5f/log.txt.gz 2026-03-18 09:45:20,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:20,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73be537ae4d3c8237a59/log.txt.gz 2026-03-18 09:45:20,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:20,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:20,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:20,907 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73be537ae4d3c8237a59/lava-logs.yaml 2026-03-18 09:45:20,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:20,910 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73c2537ae4d3c8237a5f/lava-logs.yaml 2026-03-18 09:45:20,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:20,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:45:21,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:21,086 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73be537ae4d3c8237a59/lava_callback.json.gz 2026-03-18 09:45:21,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:45:21,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:21,126 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73c2537ae4d3c8237a5f/lava_callback.json.gz 2026-03-18 09:45:21,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:21,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73be537ae4d3c8237a59 HTTP/1.1" 200 None 2026-03-18 09:45:21,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c2537ae4d3c8237a5f HTTP/1.1" 200 None 2026-03-18 09:45:21,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:21,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:21,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:45:21,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:45:21,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:21,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:21,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73c2537ae4d3c8237a5f HTTP/1.1" 200 None 2026-03-18 09:45:21,225 - lava_callback - INFO - Completed processing callback for node 69ba73c2537ae4d3c8237a5f 2026-03-18 09:45:21,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73be537ae4d3c8237a59 HTTP/1.1" 200 None 2026-03-18 09:45:21,233 - lava_callback - INFO - Completed processing callback for node 69ba73be537ae4d3c8237a59 INFO: 172.21.0.1:34698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59084 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:45:39,906 - lava_callback - INFO - Received callback for node 69b7d13e00b80c8ffdcb8975 INFO: 172.21.0.1:49902 - "POST /node/69b7d13e00b80c8ffdcb8975 HTTP/1.0" 202 Accepted 2026-03-18 09:45:39,912 - lava_callback - INFO - Starting async job submit for node 69b7d13e00b80c8ffdcb8975 2026-03-18 09:45:39,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:39,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d13e00b80c8ffdcb8975 HTTP/1.1" 200 None 2026-03-18 09:45:39,928 - lava_callback - DEBUG - Processing node 69b7d13e00b80c8ffdcb8975: baseline-arm-clabbe 2026-03-18 09:45:39,928 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d13e00b80c8ffdcb8975 2026-03-18 09:45:39,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:39,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d13e00b80c8ffdcb8975 HTTP/1.1" 200 None 2026-03-18 09:45:39,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:39,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-18 09:45:39,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:39,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d13e00b80c8ffdcb8975 HTTP/1.1" 200 None 2026-03-18 09:45:39,986 - lava_callback - ERROR - Error processing callback for node 69b7d13e00b80c8ffdcb8975: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:45:48,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:45:48,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:46:19,688 - lava_callback - INFO - Received callback for node 69ba738a537ae4d3c82379aa INFO: 172.21.0.1:60316 - "POST /node/69ba738a537ae4d3c82379aa HTTP/1.0" 202 Accepted 2026-03-18 09:46:19,694 - lava_callback - INFO - Starting async job submit for node 69ba738a537ae4d3c82379aa 2026-03-18 09:46:19,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:46:19,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba738a537ae4d3c82379aa HTTP/1.1" 200 None 2026-03-18 09:46:19,727 - lava_callback - DEBUG - Processing node 69ba738a537ae4d3c82379aa: baseline-arm64 2026-03-18 09:46:20,037 - lava_callback - INFO - Received callback for node 69b7d16400b80c8ffdcb897f INFO: 172.21.0.1:57874 - "POST /node/69b7d16400b80c8ffdcb897f HTTP/1.0" 202 Accepted 2026-03-18 09:46:20,053 - lava_callback - INFO - Starting async job submit for node 69b7d16400b80c8ffdcb897f 2026-03-18 09:46:20,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:46:20,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:46:20,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d16400b80c8ffdcb897f HTTP/1.1" 200 None 2026-03-18 09:46:20,097 - lava_callback - DEBUG - Processing node 69b7d16400b80c8ffdcb897f: baseline-arm-clabbe 2026-03-18 09:46:20,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d16400b80c8ffdcb897f 2026-03-18 09:46:20,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:46:20,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d16400b80c8ffdcb897f HTTP/1.1" 200 None 2026-03-18 09:46:20,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:46:20,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-18 09:46:20,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:46:20,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d16400b80c8ffdcb897f HTTP/1.1" 200 None 2026-03-18 09:46:20,159 - lava_callback - ERROR - Error processing callback for node 69b7d16400b80c8ffdcb897f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:46:20,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:46:20,314 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738a537ae4d3c82379aa/log.txt.gz 2026-03-18 09:46:20,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:46:20,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:46:20,768 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738a537ae4d3c82379aa/lava-logs.yaml 2026-03-18 09:46:20,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:46:20,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:46:20,951 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba738a537ae4d3c82379aa/lava_callback.json.gz 2026-03-18 09:46:20,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:46:20,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba738a537ae4d3c82379aa HTTP/1.1" 200 None 2026-03-18 09:46:20,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:46:20,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:46:21,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:46:21,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba738a537ae4d3c82379aa HTTP/1.1" 200 None 2026-03-18 09:46:21,028 - lava_callback - INFO - Completed processing callback for node 69ba738a537ae4d3c82379aa INFO: 172.21.0.1:57882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:46:48,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:46:48,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:46:59,695 - lava_callback - INFO - Received callback for node 69ba73bb537ae4d3c8237a51 INFO: 172.21.0.1:42338 - "POST /node/69ba73bb537ae4d3c8237a51 HTTP/1.0" 202 Accepted 2026-03-18 09:46:59,701 - lava_callback - INFO - Starting async job submit for node 69ba73bb537ae4d3c8237a51 2026-03-18 09:46:59,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:46:59,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73bb537ae4d3c8237a51 HTTP/1.1" 200 None 2026-03-18 09:46:59,739 - lava_callback - DEBUG - Processing node 69ba73bb537ae4d3c8237a51: baseline-arm64-broonie 2026-03-18 09:46:59,965 - lava_callback - INFO - Received callback for node 69b7d18a00b80c8ffdcb898b INFO: 172.21.0.1:53974 - "POST /node/69b7d18a00b80c8ffdcb898b HTTP/1.0" 202 Accepted 2026-03-18 09:46:59,991 - lava_callback - INFO - Starting async job submit for node 69b7d18a00b80c8ffdcb898b 2026-03-18 09:47:00,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:00,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:47:00,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d18a00b80c8ffdcb898b HTTP/1.1" 200 None 2026-03-18 09:47:00,031 - lava_callback - DEBUG - Processing node 69b7d18a00b80c8ffdcb898b: baseline-arm-clabbe 2026-03-18 09:47:00,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d18a00b80c8ffdcb898b 2026-03-18 09:47:00,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:00,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d18a00b80c8ffdcb898b HTTP/1.1" 200 None 2026-03-18 09:47:00,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:00,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-18 09:47:00,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:00,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d18a00b80c8ffdcb898b HTTP/1.1" 200 None 2026-03-18 09:47:00,111 - lava_callback - ERROR - Error processing callback for node 69b7d18a00b80c8ffdcb898b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:47:00,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:47:00,192 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73bb537ae4d3c8237a51/log.txt.gz 2026-03-18 09:47:00,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:47:00,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:47:00,579 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73bb537ae4d3c8237a51/lava-logs.yaml 2026-03-18 09:47:00,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:47:00,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:47:00,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73bb537ae4d3c8237a51/lava_callback.json.gz 2026-03-18 09:47:00,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:00,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73bb537ae4d3c8237a51 HTTP/1.1" 200 None 2026-03-18 09:47:00,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:00,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:47:00,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:00,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73bb537ae4d3c8237a51 HTTP/1.1" 200 None 2026-03-18 09:47:00,827 - lava_callback - INFO - Completed processing callback for node 69ba73bb537ae4d3c8237a51 INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42058 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:47:18,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:18,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:47:30,418 - lava_callback - INFO - Received callback for node 69ba739a537ae4d3c82379eb INFO: 172.21.0.1:51256 - "POST /node/69ba739a537ae4d3c82379eb HTTP/1.0" 202 Accepted 2026-03-18 09:47:30,425 - lava_callback - INFO - Starting async job submit for node 69ba739a537ae4d3c82379eb 2026-03-18 09:47:30,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:30,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba739a537ae4d3c82379eb HTTP/1.1" 200 None 2026-03-18 09:47:30,459 - lava_callback - DEBUG - Processing node 69ba739a537ae4d3c82379eb: baseline-nfs-arm64 2026-03-18 09:47:30,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:47:31,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:47:31,100 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739a537ae4d3c82379eb/log.txt.gz 2026-03-18 09:47:31,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:47:31,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:47:31,624 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739a537ae4d3c82379eb/lava-logs.yaml 2026-03-18 09:47:31,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:47:31,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:47:31,812 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739a537ae4d3c82379eb/lava_callback.json.gz 2026-03-18 09:47:31,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:31,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba739a537ae4d3c82379eb HTTP/1.1" 200 None 2026-03-18 09:47:31,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:31,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:47:31,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:31,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba739a537ae4d3c82379eb HTTP/1.1" 200 None 2026-03-18 09:47:31,898 - lava_callback - INFO - Completed processing callback for node 69ba739a537ae4d3c82379eb INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:47:39,993 - lava_callback - INFO - Received callback for node 69b7d1b000b80c8ffdcb8996 INFO: 172.21.0.1:35572 - "POST /node/69b7d1b000b80c8ffdcb8996 HTTP/1.0" 202 Accepted 2026-03-18 09:47:39,998 - lava_callback - INFO - Starting async job submit for node 69b7d1b000b80c8ffdcb8996 2026-03-18 09:47:39,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:40,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d1b000b80c8ffdcb8996 HTTP/1.1" 200 None 2026-03-18 09:47:40,014 - lava_callback - DEBUG - Processing node 69b7d1b000b80c8ffdcb8996: baseline-arm-clabbe 2026-03-18 09:47:40,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d1b000b80c8ffdcb8996 2026-03-18 09:47:40,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:40,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d1b000b80c8ffdcb8996 HTTP/1.1" 200 None 2026-03-18 09:47:40,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:40,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-18 09:47:40,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:40,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d1b000b80c8ffdcb8996 HTTP/1.1" 200 None 2026-03-18 09:47:40,111 - lava_callback - ERROR - Error processing callback for node 69b7d1b000b80c8ffdcb8996: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:47:48,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:47:48,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41348 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:48:20,023 - lava_callback - INFO - Received callback for node 69b7d1d500b80c8ffdcb89a5 INFO: 172.21.0.1:47022 - "POST /node/69b7d1d500b80c8ffdcb89a5 HTTP/1.0" 202 Accepted 2026-03-18 09:48:20,029 - lava_callback - INFO - Starting async job submit for node 69b7d1d500b80c8ffdcb89a5 2026-03-18 09:48:20,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:48:20,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d1d500b80c8ffdcb89a5 HTTP/1.1" 200 None 2026-03-18 09:48:20,045 - lava_callback - DEBUG - Processing node 69b7d1d500b80c8ffdcb89a5: baseline-arm-clabbe 2026-03-18 09:48:20,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d1d500b80c8ffdcb89a5 2026-03-18 09:48:20,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:48:20,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d1d500b80c8ffdcb89a5 HTTP/1.1" 200 None 2026-03-18 09:48:20,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:48:20,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd826ae557f2600f0f036 HTTP/1.1" 200 None 2026-03-18 09:48:20,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:48:20,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d1d500b80c8ffdcb89a5 HTTP/1.1" 200 None 2026-03-18 09:48:20,101 - lava_callback - ERROR - Error processing callback for node 69b7d1d500b80c8ffdcb89a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:51:49,962 - lava_callback - INFO - Received callback for node 69b7d2af00b80c8ffdcb89d0 INFO: 172.21.0.1:41850 - "POST /node/69b7d2af00b80c8ffdcb89d0 HTTP/1.0" 202 Accepted 2026-03-18 09:51:49,967 - lava_callback - INFO - Starting async job submit for node 69b7d2af00b80c8ffdcb89d0 2026-03-18 09:51:49,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:49,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2af00b80c8ffdcb89d0 HTTP/1.1" 200 None 2026-03-18 09:51:49,984 - lava_callback - DEBUG - Processing node 69b7d2af00b80c8ffdcb89d0: baseline-arm-baylibre 2026-03-18 09:51:49,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d2af00b80c8ffdcb89d0 2026-03-18 09:51:49,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:49,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2af00b80c8ffdcb89d0 HTTP/1.1" 200 None 2026-03-18 09:51:50,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:50,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 09:51:50,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:50,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d2af00b80c8ffdcb89d0 HTTP/1.1" 200 None 2026-03-18 09:51:50,061 - lava_callback - ERROR - Error processing callback for node 69b7d2af00b80c8ffdcb89d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:51:50,604 - lava_callback - INFO - Received callback for node 69b7d2b000b80c8ffdcb89d7 INFO: 172.21.0.1:41852 - "POST /node/69b7d2b000b80c8ffdcb89d7 HTTP/1.0" 202 Accepted 2026-03-18 09:51:50,610 - lava_callback - INFO - Starting async job submit for node 69b7d2b000b80c8ffdcb89d7 2026-03-18 09:51:50,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:50,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2b000b80c8ffdcb89d7 HTTP/1.1" 200 None 2026-03-18 09:51:50,625 - lava_callback - DEBUG - Processing node 69b7d2b000b80c8ffdcb89d7: baseline-arm-baylibre 2026-03-18 09:51:50,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d2b000b80c8ffdcb89d7 2026-03-18 09:51:50,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:50,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2b000b80c8ffdcb89d7 HTTP/1.1" 200 None 2026-03-18 09:51:50,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:50,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 09:51:50,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:50,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d2b000b80c8ffdcb89d7 HTTP/1.1" 200 None 2026-03-18 09:51:50,682 - lava_callback - ERROR - Error processing callback for node 69b7d2b000b80c8ffdcb89d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:51:51,247 - lava_callback - INFO - Received callback for node 69b7d2b200b80c8ffdcb89da INFO: 172.21.0.1:41862 - "POST /node/69b7d2b200b80c8ffdcb89da HTTP/1.0" 202 Accepted 2026-03-18 09:51:51,253 - lava_callback - INFO - Starting async job submit for node 69b7d2b200b80c8ffdcb89da 2026-03-18 09:51:51,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:51,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2b200b80c8ffdcb89da HTTP/1.1" 200 None 2026-03-18 09:51:51,269 - lava_callback - DEBUG - Processing node 69b7d2b200b80c8ffdcb89da: baseline-arm-baylibre 2026-03-18 09:51:51,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d2b200b80c8ffdcb89da 2026-03-18 09:51:51,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:51,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2b200b80c8ffdcb89da HTTP/1.1" 200 None 2026-03-18 09:51:51,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:51,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 09:51:51,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:51,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d2b200b80c8ffdcb89da HTTP/1.1" 200 None 2026-03-18 09:51:51,320 - lava_callback - ERROR - Error processing callback for node 69b7d2b200b80c8ffdcb89da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:51:51,893 - lava_callback - INFO - Received callback for node 69b7d2b300b80c8ffdcb89dd INFO: 172.21.0.1:41870 - "POST /node/69b7d2b300b80c8ffdcb89dd HTTP/1.0" 202 Accepted 2026-03-18 09:51:51,898 - lava_callback - INFO - Starting async job submit for node 69b7d2b300b80c8ffdcb89dd 2026-03-18 09:51:51,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:51,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2b300b80c8ffdcb89dd HTTP/1.1" 200 None 2026-03-18 09:51:51,914 - lava_callback - DEBUG - Processing node 69b7d2b300b80c8ffdcb89dd: baseline-arm-baylibre 2026-03-18 09:51:51,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d2b300b80c8ffdcb89dd 2026-03-18 09:51:51,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:51,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2b300b80c8ffdcb89dd HTTP/1.1" 200 None 2026-03-18 09:51:51,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:51,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 09:51:51,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:51:51,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d2b300b80c8ffdcb89dd HTTP/1.1" 200 None 2026-03-18 09:51:51,967 - lava_callback - ERROR - Error processing callback for node 69b7d2b300b80c8ffdcb89dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:52:09,801 - lava_callback - INFO - Received callback for node 69b7d2b600b80c8ffdcb89e8 INFO: 172.21.0.1:38926 - "POST /node/69b7d2b600b80c8ffdcb89e8 HTTP/1.0" 202 Accepted 2026-03-18 09:52:09,807 - lava_callback - INFO - Starting async job submit for node 69b7d2b600b80c8ffdcb89e8 2026-03-18 09:52:09,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:09,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2b600b80c8ffdcb89e8 HTTP/1.1" 200 None 2026-03-18 09:52:09,823 - lava_callback - DEBUG - Processing node 69b7d2b600b80c8ffdcb89e8: baseline-arm-baylibre 2026-03-18 09:52:09,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d2b600b80c8ffdcb89e8 2026-03-18 09:52:09,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:09,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2b600b80c8ffdcb89e8 HTTP/1.1" 200 None 2026-03-18 09:52:09,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:09,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 09:52:09,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:09,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d2b600b80c8ffdcb89e8 HTTP/1.1" 200 None 2026-03-18 09:52:09,892 - lava_callback - ERROR - Error processing callback for node 69b7d2b600b80c8ffdcb89e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:52:10,463 - lava_callback - INFO - Received callback for node 69b7d2b700b80c8ffdcb89eb INFO: 172.21.0.1:38942 - "POST /node/69b7d2b700b80c8ffdcb89eb HTTP/1.0" 202 Accepted 2026-03-18 09:52:10,472 - lava_callback - INFO - Starting async job submit for node 69b7d2b700b80c8ffdcb89eb 2026-03-18 09:52:10,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:10,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2b700b80c8ffdcb89eb HTTP/1.1" 200 None 2026-03-18 09:52:10,490 - lava_callback - DEBUG - Processing node 69b7d2b700b80c8ffdcb89eb: baseline-arm-baylibre 2026-03-18 09:52:10,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d2b700b80c8ffdcb89eb 2026-03-18 09:52:10,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:10,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2b700b80c8ffdcb89eb HTTP/1.1" 200 None 2026-03-18 09:52:10,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:10,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 09:52:10,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:10,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d2b700b80c8ffdcb89eb HTTP/1.1" 200 None 2026-03-18 09:52:10,565 - lava_callback - ERROR - Error processing callback for node 69b7d2b700b80c8ffdcb89eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38950 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:52:20,233 - lava_callback - INFO - Received callback for node 69b7d2bf00b80c8ffdcb8a00 INFO: 172.21.0.1:42730 - "POST /node/69b7d2bf00b80c8ffdcb8a00 HTTP/1.0" 202 Accepted 2026-03-18 09:52:20,239 - lava_callback - INFO - Starting async job submit for node 69b7d2bf00b80c8ffdcb8a00 2026-03-18 09:52:20,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:20,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2bf00b80c8ffdcb8a00 HTTP/1.1" 200 None 2026-03-18 09:52:20,255 - lava_callback - DEBUG - Processing node 69b7d2bf00b80c8ffdcb8a00: baseline-arm-clabbe 2026-03-18 09:52:20,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d2bf00b80c8ffdcb8a00 2026-03-18 09:52:20,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:20,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2bf00b80c8ffdcb8a00 HTTP/1.1" 200 None 2026-03-18 09:52:20,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:20,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 09:52:20,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:20,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d2bf00b80c8ffdcb8a00 HTTP/1.1" 200 None 2026-03-18 09:52:20,319 - lava_callback - ERROR - Error processing callback for node 69b7d2bf00b80c8ffdcb8a00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:52:20,892 - lava_callback - INFO - Received callback for node 69b7d2c300b80c8ffdcb8a34 INFO: 172.21.0.1:42736 - "POST /node/69b7d2c300b80c8ffdcb8a34 HTTP/1.0" 202 Accepted 2026-03-18 09:52:20,898 - lava_callback - INFO - Starting async job submit for node 69b7d2c300b80c8ffdcb8a34 2026-03-18 09:52:20,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:20,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2c300b80c8ffdcb8a34 HTTP/1.1" 200 None 2026-03-18 09:52:20,914 - lava_callback - DEBUG - Processing node 69b7d2c300b80c8ffdcb8a34: baseline-arm-clabbe 2026-03-18 09:52:20,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d2c300b80c8ffdcb8a34 2026-03-18 09:52:20,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:20,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2c300b80c8ffdcb8a34 HTTP/1.1" 200 None 2026-03-18 09:52:20,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:20,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 09:52:20,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:20,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d2c300b80c8ffdcb8a34 HTTP/1.1" 200 None 2026-03-18 09:52:20,965 - lava_callback - ERROR - Error processing callback for node 69b7d2c300b80c8ffdcb8a34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:52:21,537 - lava_callback - INFO - Received callback for node 69b7d2c400b80c8ffdcb8a37 INFO: 172.21.0.1:42750 - "POST /node/69b7d2c400b80c8ffdcb8a37 HTTP/1.0" 202 Accepted 2026-03-18 09:52:21,543 - lava_callback - INFO - Starting async job submit for node 69b7d2c400b80c8ffdcb8a37 2026-03-18 09:52:21,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:21,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2c400b80c8ffdcb8a37 HTTP/1.1" 200 None 2026-03-18 09:52:21,559 - lava_callback - DEBUG - Processing node 69b7d2c400b80c8ffdcb8a37: baseline-arm-clabbe 2026-03-18 09:52:21,559 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d2c400b80c8ffdcb8a37 2026-03-18 09:52:21,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:21,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2c400b80c8ffdcb8a37 HTTP/1.1" 200 None 2026-03-18 09:52:21,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:21,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 09:52:21,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:21,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d2c400b80c8ffdcb8a37 HTTP/1.1" 200 None 2026-03-18 09:52:21,627 - lava_callback - ERROR - Error processing callback for node 69b7d2c400b80c8ffdcb8a37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:52:22,202 - lava_callback - INFO - Received callback for node 69b7d2c500b80c8ffdcb8a3a INFO: 172.21.0.1:42762 - "POST /node/69b7d2c500b80c8ffdcb8a3a HTTP/1.0" 202 Accepted 2026-03-18 09:52:22,207 - lava_callback - INFO - Starting async job submit for node 69b7d2c500b80c8ffdcb8a3a 2026-03-18 09:52:22,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:22,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2c500b80c8ffdcb8a3a HTTP/1.1" 200 None 2026-03-18 09:52:22,224 - lava_callback - DEBUG - Processing node 69b7d2c500b80c8ffdcb8a3a: baseline-arm-clabbe 2026-03-18 09:52:22,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d2c500b80c8ffdcb8a3a 2026-03-18 09:52:22,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:22,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2c500b80c8ffdcb8a3a HTTP/1.1" 200 None 2026-03-18 09:52:22,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:22,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 09:52:22,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:22,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d2c500b80c8ffdcb8a3a HTTP/1.1" 200 None 2026-03-18 09:52:22,291 - lava_callback - ERROR - Error processing callback for node 69b7d2c500b80c8ffdcb8a3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 09:52:22,855 - lava_callback - INFO - Received callback for node 69b7d2c700b80c8ffdcb8a43 INFO: 172.21.0.1:42770 - "POST /node/69b7d2c700b80c8ffdcb8a43 HTTP/1.0" 202 Accepted 2026-03-18 09:52:22,861 - lava_callback - INFO - Starting async job submit for node 69b7d2c700b80c8ffdcb8a43 2026-03-18 09:52:22,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:22,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2c700b80c8ffdcb8a43 HTTP/1.1" 200 None 2026-03-18 09:52:22,877 - lava_callback - DEBUG - Processing node 69b7d2c700b80c8ffdcb8a43: baseline-arm-clabbe 2026-03-18 09:52:22,878 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d2c700b80c8ffdcb8a43 2026-03-18 09:52:22,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:22,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d2c700b80c8ffdcb8a43 HTTP/1.1" 200 None 2026-03-18 09:52:22,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:22,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 09:52:22,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:52:22,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d2c700b80c8ffdcb8a43 HTTP/1.1" 200 None 2026-03-18 09:52:22,933 - lava_callback - ERROR - Error processing callback for node 69b7d2c700b80c8ffdcb8a43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50854 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:53:14,763 - lava_callback - INFO - Received callback for node 69ba7398537ae4d3c82379e5 INFO: 172.21.0.1:59066 - "POST /node/69ba7398537ae4d3c82379e5 HTTP/1.0" 202 Accepted 2026-03-18 09:53:14,774 - lava_callback - INFO - Starting async job submit for node 69ba7398537ae4d3c82379e5 2026-03-18 09:53:14,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:53:14,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7398537ae4d3c82379e5 HTTP/1.1" 200 None 2026-03-18 09:53:14,851 - lava_callback - DEBUG - Processing node 69ba7398537ae4d3c82379e5: baseline-arm64 INFO: 172.21.0.1:59082 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 09:53:15,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:53:15,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:53:15,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7398537ae4d3c82379e5/log.txt.gz 2026-03-18 09:53:15,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:53:15,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:53:15,933 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7398537ae4d3c82379e5/lava-logs.yaml 2026-03-18 09:53:15,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 09:53:16,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 09:53:16,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7398537ae4d3c82379e5/lava_callback.json.gz DEBUG: Setup failed for 69ba7398537ae4d3c82379e5. Transitting job node result: incomplete -> fail 2026-03-18 09:53:16,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:53:16,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7398537ae4d3c82379e5 HTTP/1.1" 200 None 2026-03-18 09:53:16,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:53:16,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 09:53:16,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:53:16,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7398537ae4d3c82379e5 HTTP/1.1" 200 None 2026-03-18 09:53:16,341 - lava_callback - INFO - Completed processing callback for node 69ba7398537ae4d3c82379e5 INFO: 172.21.0.1:59092 - "GET / HTTP/1.0" 200 OK 2026-03-18 09:53:18,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 09:53:18,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50872 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:00:07,188 - lava_callback - INFO - Received callback for node 69ba7784537ae4d3c8237c1a INFO: 172.21.0.1:50888 - "POST /node/69ba7784537ae4d3c8237c1a HTTP/1.0" 202 Accepted 2026-03-18 10:00:07,194 - lava_callback - INFO - Starting async job submit for node 69ba7784537ae4d3c8237c1a 2026-03-18 10:00:07,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:00:07,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7784537ae4d3c8237c1a HTTP/1.1" 200 None 2026-03-18 10:00:07,212 - lava_callback - DEBUG - Processing node 69ba7784537ae4d3c8237c1a: baseline-nfs-arm64 2026-03-18 10:00:07,213 - lava_callback - WARNING - Failed to upload log 2026-03-18 10:00:07,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:00:07,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:00:07,354 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7784537ae4d3c8237c1a/lava-logs.yaml 2026-03-18 10:00:07,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:00:07,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:00:07,509 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7784537ae4d3c8237c1a/lava_callback.json.gz 2026-03-18 10:00:07,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:00:07,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7784537ae4d3c8237c1a HTTP/1.1" 200 None 2026-03-18 10:00:07,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:00:07,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:00:07,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:00:07,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7784537ae4d3c8237c1a HTTP/1.1" 200 None 2026-03-18 10:00:07,574 - lava_callback - INFO - Completed processing callback for node 69ba7784537ae4d3c8237c1a INFO: 172.21.0.1:57754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:00:18,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:00:18,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43442 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:01:30,435 - lava_callback - INFO - Received callback for node 69b7d4e900b80c8ffdcb8c34 INFO: 172.21.0.1:40284 - "POST /node/69b7d4e900b80c8ffdcb8c34 HTTP/1.0" 202 Accepted 2026-03-18 10:01:30,441 - lava_callback - INFO - Starting async job submit for node 69b7d4e900b80c8ffdcb8c34 2026-03-18 10:01:30,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:01:30,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d4e900b80c8ffdcb8c34 HTTP/1.1" 200 None 2026-03-18 10:01:30,466 - lava_callback - DEBUG - Processing node 69b7d4e900b80c8ffdcb8c34: baseline-arm64-baylibre 2026-03-18 10:01:30,466 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d4e900b80c8ffdcb8c34 2026-03-18 10:01:30,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:01:30,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d4e900b80c8ffdcb8c34 HTTP/1.1" 200 None 2026-03-18 10:01:30,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:01:30,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:01:30,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:01:30,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d4e900b80c8ffdcb8c34 HTTP/1.1" 200 None 2026-03-18 10:01:30,526 - lava_callback - ERROR - Error processing callback for node 69b7d4e900b80c8ffdcb8c34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40286 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:01:40,646 - lava_callback - INFO - Received callback for node 69ba77cf537ae4d3c8237c2b INFO: 172.21.0.1:60042 - "POST /node/69ba77cf537ae4d3c8237c2b HTTP/1.0" 202 Accepted 2026-03-18 10:01:40,653 - lava_callback - INFO - Starting async job submit for node 69ba77cf537ae4d3c8237c2b 2026-03-18 10:01:40,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:01:40,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba77cf537ae4d3c8237c2b HTTP/1.1" 200 None 2026-03-18 10:01:40,701 - lava_callback - DEBUG - Processing node 69ba77cf537ae4d3c8237c2b: baseline-arm64 2026-03-18 10:01:40,838 - lava_callback - WARNING - Failed to upload log 2026-03-18 10:01:40,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:01:41,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:01:41,119 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba77cf537ae4d3c8237c2b/lava-logs.yaml 2026-03-18 10:01:41,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:01:41,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:01:41,290 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba77cf537ae4d3c8237c2b/lava_callback.json.gz 2026-03-18 10:01:41,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:01:41,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba77cf537ae4d3c8237c2b HTTP/1.1" 200 None 2026-03-18 10:01:41,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:01:41,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:01:41,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:01:41,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba77cf537ae4d3c8237c2b HTTP/1.1" 200 None 2026-03-18 10:01:41,450 - lava_callback - INFO - Completed processing callback for node 69ba77cf537ae4d3c8237c2b INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:01:48,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:01:48,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57516 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:03:02,677 - lava_callback - INFO - Received callback for node 69ba739d537ae4d3c82379f1 INFO: 172.21.0.1:58924 - "POST /node/69ba739d537ae4d3c82379f1 HTTP/1.0" 202 Accepted 2026-03-18 10:03:02,685 - lava_callback - INFO - Starting async job submit for node 69ba739d537ae4d3c82379f1 2026-03-18 10:03:02,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:02,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba739d537ae4d3c82379f1 HTTP/1.1" 200 None 2026-03-18 10:03:02,744 - lava_callback - DEBUG - Processing node 69ba739d537ae4d3c82379f1: baseline-nfs-arm64 2026-03-18 10:03:03,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:03:03,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:03:03,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739d537ae4d3c82379f1/log.txt.gz 2026-03-18 10:03:04,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:03:04,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:03:04,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739d537ae4d3c82379f1/lava-logs.yaml 2026-03-18 10:03:04,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:03:05,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:03:05,014 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739d537ae4d3c82379f1/lava_callback.json.gz DEBUG: Setup failed for 69ba739d537ae4d3c82379f1. Transitting job node result: incomplete -> fail 2026-03-18 10:03:05,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:05,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba739d537ae4d3c82379f1 HTTP/1.1" 200 None 2026-03-18 10:03:05,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:05,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:03:05,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:05,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba739d537ae4d3c82379f1 HTTP/1.1" 200 None 2026-03-18 10:03:05,285 - lava_callback - INFO - Completed processing callback for node 69ba739d537ae4d3c82379f1 INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 10:03:16,487 - lava_callback - INFO - Received callback for node 69ba739f537ae4d3c82379f7 INFO: 172.21.0.1:41110 - "POST /node/69ba739f537ae4d3c82379f7 HTTP/1.0" 202 Accepted 2026-03-18 10:03:16,495 - lava_callback - INFO - Starting async job submit for node 69ba739f537ae4d3c82379f7 INFO: 172.21.0.1:41124 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:03:16,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:16,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba739f537ae4d3c82379f7 HTTP/1.1" 200 None 2026-03-18 10:03:16,557 - lava_callback - DEBUG - Processing node 69ba739f537ae4d3c82379f7: baseline-nfs-arm64 2026-03-18 10:03:17,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:03:17,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:03:17,713 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739f537ae4d3c82379f7/log.txt.gz 2026-03-18 10:03:18,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:03:18,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:18,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-18 10:03:18,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:03:18,522 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739f537ae4d3c82379f7/lava-logs.yaml 2026-03-18 10:03:18,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:03:18,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:03:18,710 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba739f537ae4d3c82379f7/lava_callback.json.gz DEBUG: Setup failed for 69ba739f537ae4d3c82379f7. Transitting job node result: incomplete -> fail 2026-03-18 10:03:18,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:18,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba739f537ae4d3c82379f7 HTTP/1.1" 200 None 2026-03-18 10:03:18,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:18,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:03:18,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:18,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba739f537ae4d3c82379f7 HTTP/1.1" 200 None 2026-03-18 10:03:18,959 - lava_callback - INFO - Completed processing callback for node 69ba739f537ae4d3c82379f7 2026-03-18 10:03:24,975 - lava_callback - INFO - Received callback for node 69ba7823537ae4d3c8237c3a INFO: 172.21.0.1:54648 - "POST /node/69ba7823537ae4d3c8237c3a HTTP/1.0" 202 Accepted 2026-03-18 10:03:24,982 - lava_callback - INFO - Starting async job submit for node 69ba7823537ae4d3c8237c3a 2026-03-18 10:03:25,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:25,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7823537ae4d3c8237c3a HTTP/1.1" 200 None 2026-03-18 10:03:25,032 - lava_callback - DEBUG - Processing node 69ba7823537ae4d3c8237c3a: baseline-arm64 2026-03-18 10:03:25,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:03:25,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:03:25,306 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7823537ae4d3c8237c3a/log.txt.gz 2026-03-18 10:03:25,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:03:25,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:03:25,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7823537ae4d3c8237c3a/lava-logs.yaml 2026-03-18 10:03:25,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:03:25,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:03:25,656 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7823537ae4d3c8237c3a/lava_callback.json.gz 2026-03-18 10:03:25,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:25,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7823537ae4d3c8237c3a HTTP/1.1" 200 None 2026-03-18 10:03:25,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:25,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:03:25,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:25,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7823537ae4d3c8237c3a HTTP/1.1" 200 None 2026-03-18 10:03:25,816 - lava_callback - INFO - Completed processing callback for node 69ba7823537ae4d3c8237c3a INFO: 172.21.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33714 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:03:48,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:03:48,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36366 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:04:39,630 - lava_callback - INFO - Received callback for node 69ba7878537ae4d3c8237c56 INFO: 172.21.0.1:36368 - "POST /node/69ba7878537ae4d3c8237c56 HTTP/1.0" 202 Accepted 2026-03-18 10:04:39,636 - lava_callback - INFO - Starting async job submit for node 69ba7878537ae4d3c8237c56 2026-03-18 10:04:39,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:04:39,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7878537ae4d3c8237c56 HTTP/1.1" 200 None 2026-03-18 10:04:39,717 - lava_callback - DEBUG - Processing node 69ba7878537ae4d3c8237c56: baseline-arm64 2026-03-18 10:04:40,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:04:40,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:04:40,213 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7878537ae4d3c8237c56/log.txt.gz 2026-03-18 10:04:40,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:04:40,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:04:40,651 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7878537ae4d3c8237c56/lava-logs.yaml 2026-03-18 10:04:40,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:04:40,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:04:40,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7878537ae4d3c8237c56/lava_callback.json.gz 2026-03-18 10:04:40,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:04:40,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7878537ae4d3c8237c56 HTTP/1.1" 200 None 2026-03-18 10:04:40,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:04:40,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:04:40,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:04:40,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7878537ae4d3c8237c56 HTTP/1.1" 200 None 2026-03-18 10:04:40,893 - lava_callback - INFO - Completed processing callback for node 69ba7878537ae4d3c8237c56 INFO: 172.21.0.1:56096 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:04:48,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:04:48,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-18 10:04:50,544 - lava_callback - INFO - Received callback for node 69b7d5c000b80c8ffdcb8c85 INFO: 172.21.0.1:38468 - "POST /node/69b7d5c000b80c8ffdcb8c85 HTTP/1.0" 202 Accepted 2026-03-18 10:04:50,549 - lava_callback - INFO - Starting async job submit for node 69b7d5c000b80c8ffdcb8c85 2026-03-18 10:04:50,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:04:50,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d5c000b80c8ffdcb8c85 HTTP/1.1" 200 None 2026-03-18 10:04:50,564 - lava_callback - DEBUG - Processing node 69b7d5c000b80c8ffdcb8c85: baseline-arm64-baylibre 2026-03-18 10:04:50,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d5c000b80c8ffdcb8c85 2026-03-18 10:04:50,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:04:50,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d5c000b80c8ffdcb8c85 HTTP/1.1" 200 None 2026-03-18 10:04:50,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:04:50,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:04:50,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:04:50,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d5c000b80c8ffdcb8c85 HTTP/1.1" 200 None 2026-03-18 10:04:50,633 - lava_callback - ERROR - Error processing callback for node 69b7d5c000b80c8ffdcb8c85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:07:30,728 - lava_callback - INFO - Received callback for node 69b7d65300b80c8ffdcb8cc7 INFO: 172.21.0.1:37438 - "POST /node/69b7d65300b80c8ffdcb8cc7 HTTP/1.0" 202 Accepted 2026-03-18 10:07:30,734 - lava_callback - INFO - Starting async job submit for node 69b7d65300b80c8ffdcb8cc7 2026-03-18 10:07:30,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:07:30,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d65300b80c8ffdcb8cc7 HTTP/1.1" 200 None 2026-03-18 10:07:30,753 - lava_callback - DEBUG - Processing node 69b7d65300b80c8ffdcb8cc7: baseline-arm64-baylibre 2026-03-18 10:07:30,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d65300b80c8ffdcb8cc7 2026-03-18 10:07:30,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:07:30,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d65300b80c8ffdcb8cc7 HTTP/1.1" 200 None 2026-03-18 10:07:30,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:07:30,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:07:30,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:07:30,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d65300b80c8ffdcb8cc7 HTTP/1.1" 200 None 2026-03-18 10:07:30,826 - lava_callback - ERROR - Error processing callback for node 69b7d65300b80c8ffdcb8cc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39528 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:09:10,781 - lava_callback - INFO - Received callback for node 69b7d6c500b80c8ffdcb8cdf INFO: 172.21.0.1:42780 - "POST /node/69b7d6c500b80c8ffdcb8cdf HTTP/1.0" 202 Accepted 2026-03-18 10:09:10,786 - lava_callback - INFO - Starting async job submit for node 69b7d6c500b80c8ffdcb8cdf 2026-03-18 10:09:10,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:09:10,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d6c500b80c8ffdcb8cdf HTTP/1.1" 200 None 2026-03-18 10:09:10,803 - lava_callback - DEBUG - Processing node 69b7d6c500b80c8ffdcb8cdf: baseline-arm64-baylibre 2026-03-18 10:09:10,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d6c500b80c8ffdcb8cdf 2026-03-18 10:09:10,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:09:10,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d6c500b80c8ffdcb8cdf HTTP/1.1" 200 None 2026-03-18 10:09:10,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:09:10,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:09:10,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:09:10,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d6c500b80c8ffdcb8cdf HTTP/1.1" 200 None 2026-03-18 10:09:10,876 - lava_callback - ERROR - Error processing callback for node 69b7d6c500b80c8ffdcb8cdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:10:31,830 - lava_callback - INFO - Received callback for node 69ba7386537ae4d3c823799d INFO: 172.21.0.1:36324 - "POST /node/69ba7386537ae4d3c823799d HTTP/1.0" 202 Accepted 2026-03-18 10:10:31,836 - lava_callback - INFO - Starting async job submit for node 69ba7386537ae4d3c823799d 2026-03-18 10:10:31,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:10:31,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7386537ae4d3c823799d HTTP/1.1" 200 None 2026-03-18 10:10:31,873 - lava_callback - DEBUG - Processing node 69ba7386537ae4d3c823799d: baseline-arm64 2026-03-18 10:10:32,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:10:32,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:10:32,261 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7386537ae4d3c823799d/log.txt.gz 2026-03-18 10:10:32,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:10:32,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:10:32,613 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7386537ae4d3c823799d/lava-logs.yaml 2026-03-18 10:10:32,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:10:32,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:10:32,803 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7386537ae4d3c823799d/lava_callback.json.gz 2026-03-18 10:10:32,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:10:32,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7386537ae4d3c823799d HTTP/1.1" 200 None 2026-03-18 10:10:32,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:10:32,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:10:32,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:10:32,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7386537ae4d3c823799d HTTP/1.1" 200 None 2026-03-18 10:10:32,882 - lava_callback - INFO - Completed processing callback for node 69ba7386537ae4d3c823799d INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:10:48,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:10:48,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33060 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:11:58,389 - lava_callback - INFO - Received callback for node 69ba7399537ae4d3c82379e8 INFO: 172.21.0.1:33076 - "POST /node/69ba7399537ae4d3c82379e8 HTTP/1.0" 202 Accepted 2026-03-18 10:11:58,396 - lava_callback - INFO - Starting async job submit for node 69ba7399537ae4d3c82379e8 2026-03-18 10:11:58,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:11:58,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7399537ae4d3c82379e8 HTTP/1.1" 200 None 2026-03-18 10:11:58,435 - lava_callback - DEBUG - Processing node 69ba7399537ae4d3c82379e8: baseline-nfs-arm64 2026-03-18 10:11:58,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:11:58,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:11:58,935 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7399537ae4d3c82379e8/log.txt.gz 2026-03-18 10:11:59,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:11:59,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:11:59,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7399537ae4d3c82379e8/lava-logs.yaml 2026-03-18 10:11:59,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:11:59,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:11:59,553 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7399537ae4d3c82379e8/lava_callback.json.gz 2026-03-18 10:11:59,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:11:59,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7399537ae4d3c82379e8 HTTP/1.1" 200 None 2026-03-18 10:11:59,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:11:59,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:11:59,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:11:59,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7399537ae4d3c82379e8 HTTP/1.1" 200 None 2026-03-18 10:11:59,633 - lava_callback - INFO - Completed processing callback for node 69ba7399537ae4d3c82379e8 INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:12:18,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:12:18,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60738 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:12:51,190 - lava_callback - INFO - Received callback for node 69b7d7a100b80c8ffdcb8d13 INFO: 172.21.0.1:32870 - "POST /node/69b7d7a100b80c8ffdcb8d13 HTTP/1.0" 202 Accepted 2026-03-18 10:12:51,196 - lava_callback - INFO - Starting async job submit for node 69b7d7a100b80c8ffdcb8d13 2026-03-18 10:12:51,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:12:51,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d7a100b80c8ffdcb8d13 HTTP/1.1" 200 None 2026-03-18 10:12:51,213 - lava_callback - DEBUG - Processing node 69b7d7a100b80c8ffdcb8d13: baseline-arm64-baylibre 2026-03-18 10:12:51,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d7a100b80c8ffdcb8d13 2026-03-18 10:12:51,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:12:51,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d7a100b80c8ffdcb8d13 HTTP/1.1" 200 None 2026-03-18 10:12:51,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:12:51,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:12:51,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:12:51,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d7a100b80c8ffdcb8d13 HTTP/1.1" 200 None 2026-03-18 10:12:51,268 - lava_callback - ERROR - Error processing callback for node 69b7d7a100b80c8ffdcb8d13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:14:11,048 - lava_callback - INFO - Received callback for node 69b7d7f000b80c8ffdcb8d23 INFO: 172.21.0.1:35304 - "POST /node/69b7d7f000b80c8ffdcb8d23 HTTP/1.0" 202 Accepted 2026-03-18 10:14:11,054 - lava_callback - INFO - Starting async job submit for node 69b7d7f000b80c8ffdcb8d23 2026-03-18 10:14:11,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:14:11,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d7f000b80c8ffdcb8d23 HTTP/1.1" 200 None 2026-03-18 10:14:11,070 - lava_callback - DEBUG - Processing node 69b7d7f000b80c8ffdcb8d23: baseline-arm64-baylibre 2026-03-18 10:14:11,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d7f000b80c8ffdcb8d23 2026-03-18 10:14:11,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:14:11,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d7f000b80c8ffdcb8d23 HTTP/1.1" 200 None 2026-03-18 10:14:11,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:14:11,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:14:11,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:14:11,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d7f000b80c8ffdcb8d23 HTTP/1.1" 200 None 2026-03-18 10:14:11,127 - lava_callback - ERROR - Error processing callback for node 69b7d7f000b80c8ffdcb8d23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50538 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:16:18,055 - lava_callback - INFO - Received callback for node 69ba7663537ae4d3c8237bea INFO: 172.21.0.1:50542 - "POST /node/69ba7663537ae4d3c8237bea HTTP/1.0" 202 Accepted 2026-03-18 10:16:18,061 - lava_callback - INFO - Starting async job submit for node 69ba7663537ae4d3c8237bea 2026-03-18 10:16:18,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:16:18,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7663537ae4d3c8237bea HTTP/1.1" 200 None 2026-03-18 10:16:18,113 - lava_callback - DEBUG - Processing node 69ba7663537ae4d3c8237bea: baseline-arm 2026-03-18 10:16:18,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:16:18,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:16:18,683 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ba7663537ae4d3c8237bea/log.txt.gz 2026-03-18 10:16:18,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:16:19,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:16:19,130 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ba7663537ae4d3c8237bea/lava-logs.yaml 2026-03-18 10:16:19,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:16:19,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:16:19,305 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ba7663537ae4d3c8237bea/lava_callback.json.gz DEBUG: Setup failed for 69ba7663537ae4d3c8237bea. Transitting job node result: incomplete -> fail 2026-03-18 10:16:19,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:16:19,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7663537ae4d3c8237bea HTTP/1.1" 200 None 2026-03-18 10:16:19,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:16:19,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-18 10:16:19,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:16:19,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7663537ae4d3c8237bea HTTP/1.1" 200 None 2026-03-18 10:16:19,529 - lava_callback - INFO - Completed processing callback for node 69ba7663537ae4d3c8237bea INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:16:48,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:16:48,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:17:01,546 - lava_callback - INFO - Received callback for node 69b7d88c00b80c8ffdcb8d3f INFO: 172.21.0.1:39464 - "POST /node/69b7d88c00b80c8ffdcb8d3f HTTP/1.0" 202 Accepted 2026-03-18 10:17:01,552 - lava_callback - INFO - Starting async job submit for node 69b7d88c00b80c8ffdcb8d3f 2026-03-18 10:17:01,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:17:01,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d88c00b80c8ffdcb8d3f HTTP/1.1" 200 None 2026-03-18 10:17:01,569 - lava_callback - DEBUG - Processing node 69b7d88c00b80c8ffdcb8d3f: baseline-arm64-clabbe 2026-03-18 10:17:01,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d88c00b80c8ffdcb8d3f 2026-03-18 10:17:01,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:17:01,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d88c00b80c8ffdcb8d3f HTTP/1.1" 200 None 2026-03-18 10:17:01,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:17:01,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:17:01,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:17:01,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d88c00b80c8ffdcb8d3f HTTP/1.1" 200 None 2026-03-18 10:17:01,647 - lava_callback - ERROR - Error processing callback for node 69b7d88c00b80c8ffdcb8d3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:18:21,367 - lava_callback - INFO - Received callback for node 69b7d8d900b80c8ffdcb8d44 INFO: 172.21.0.1:49484 - "POST /node/69b7d8d900b80c8ffdcb8d44 HTTP/1.0" 202 Accepted 2026-03-18 10:18:21,372 - lava_callback - INFO - Starting async job submit for node 69b7d8d900b80c8ffdcb8d44 2026-03-18 10:18:21,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:18:21,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d8d900b80c8ffdcb8d44 HTTP/1.1" 200 None 2026-03-18 10:18:21,398 - lava_callback - DEBUG - Processing node 69b7d8d900b80c8ffdcb8d44: baseline-arm64-clabbe 2026-03-18 10:18:21,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d8d900b80c8ffdcb8d44 2026-03-18 10:18:21,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:18:21,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d8d900b80c8ffdcb8d44 HTTP/1.1" 200 None 2026-03-18 10:18:21,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:18:21,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:18:21,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:18:21,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d8d900b80c8ffdcb8d44 HTTP/1.1" 200 None 2026-03-18 10:18:21,462 - lava_callback - ERROR - Error processing callback for node 69b7d8d900b80c8ffdcb8d44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49676 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:19:41,521 - lava_callback - INFO - Received callback for node 69b7d92700b80c8ffdcb8d4f INFO: 172.21.0.1:58934 - "POST /node/69b7d92700b80c8ffdcb8d4f HTTP/1.0" 202 Accepted 2026-03-18 10:19:41,526 - lava_callback - INFO - Starting async job submit for node 69b7d92700b80c8ffdcb8d4f 2026-03-18 10:19:41,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:19:41,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d92700b80c8ffdcb8d4f HTTP/1.1" 200 None 2026-03-18 10:19:41,553 - lava_callback - DEBUG - Processing node 69b7d92700b80c8ffdcb8d4f: baseline-arm64-clabbe 2026-03-18 10:19:41,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d92700b80c8ffdcb8d4f 2026-03-18 10:19:41,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:19:41,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d92700b80c8ffdcb8d4f HTTP/1.1" 200 None 2026-03-18 10:19:41,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:19:41,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:19:41,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:19:41,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d92700b80c8ffdcb8d4f HTTP/1.1" 200 None 2026-03-18 10:19:41,615 - lava_callback - ERROR - Error processing callback for node 69b7d92700b80c8ffdcb8d4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:20:17,683 - lava_callback - INFO - Received callback for node 69ba7aa9537ae4d3c8237cf5 INFO: 172.21.0.1:42804 - "POST /node/69ba7aa9537ae4d3c8237cf5 HTTP/1.0" 202 Accepted 2026-03-18 10:20:17,690 - lava_callback - INFO - Starting async job submit for node 69ba7aa9537ae4d3c8237cf5 2026-03-18 10:20:17,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:20:17,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7aa9537ae4d3c8237cf5 HTTP/1.1" 200 None 2026-03-18 10:20:17,766 - lava_callback - DEBUG - Processing node 69ba7aa9537ae4d3c8237cf5: baseline-arm64 2026-03-18 10:20:18,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:20:18,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:20:18,293 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7aa9537ae4d3c8237cf5/log.txt.gz 2026-03-18 10:20:18,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:20:18,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:20:18,744 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7aa9537ae4d3c8237cf5/lava-logs.yaml 2026-03-18 10:20:18,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:20:18,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:20:18,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7aa9537ae4d3c8237cf5/lava_callback.json.gz DEBUG: Setup failed for 69ba7aa9537ae4d3c8237cf5. Transitting job node result: incomplete -> fail 2026-03-18 10:20:19,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:20:19,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7aa9537ae4d3c8237cf5 HTTP/1.1" 200 None 2026-03-18 10:20:19,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:20:19,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:20:19,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:20:19,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7aa9537ae4d3c8237cf5 HTTP/1.1" 200 None 2026-03-18 10:20:19,158 - lava_callback - INFO - Completed processing callback for node 69ba7aa9537ae4d3c8237cf5 INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38980 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:20:48,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:20:48,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:22:01,519 - lava_callback - INFO - Received callback for node 69b7d9bd00b80c8ffdcb8d73 INFO: 172.21.0.1:34142 - "POST /node/69b7d9bd00b80c8ffdcb8d73 HTTP/1.0" 202 Accepted 2026-03-18 10:22:01,525 - lava_callback - INFO - Starting async job submit for node 69b7d9bd00b80c8ffdcb8d73 2026-03-18 10:22:01,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:22:01,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d9bd00b80c8ffdcb8d73 HTTP/1.1" 200 None 2026-03-18 10:22:01,542 - lava_callback - DEBUG - Processing node 69b7d9bd00b80c8ffdcb8d73: baseline-arm64-clabbe 2026-03-18 10:22:01,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7d9bd00b80c8ffdcb8d73 2026-03-18 10:22:01,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:22:01,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7d9bd00b80c8ffdcb8d73 HTTP/1.1" 200 None 2026-03-18 10:22:01,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:22:01,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:22:01,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:22:01,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7d9bd00b80c8ffdcb8d73 HTTP/1.1" 200 None 2026-03-18 10:22:01,606 - lava_callback - ERROR - Error processing callback for node 69b7d9bd00b80c8ffdcb8d73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:22:07,524 - lava_callback - INFO - Received callback for node 69ba7cbd537ae4d3c8237d5d INFO: 172.21.0.1:34176 - "POST /node/69ba7cbd537ae4d3c8237d5d HTTP/1.0" 202 Accepted 2026-03-18 10:22:07,529 - lava_callback - INFO - Starting async job submit for node 69ba7cbd537ae4d3c8237d5d 2026-03-18 10:22:07,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:22:07,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7cbd537ae4d3c8237d5d HTTP/1.1" 200 None 2026-03-18 10:22:07,548 - lava_callback - DEBUG - Processing node 69ba7cbd537ae4d3c8237d5d: baseline-nfs-arm64 2026-03-18 10:22:07,549 - lava_callback - WARNING - Failed to upload log 2026-03-18 10:22:07,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:22:07,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:22:07,706 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7cbd537ae4d3c8237d5d/lava-logs.yaml 2026-03-18 10:22:07,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:22:07,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:22:07,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7cbd537ae4d3c8237d5d/lava_callback.json.gz 2026-03-18 10:22:07,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:22:07,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7cbd537ae4d3c8237d5d HTTP/1.1" 200 None 2026-03-18 10:22:07,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:22:07,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:22:07,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:22:07,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7cbd537ae4d3c8237d5d HTTP/1.1" 200 None 2026-03-18 10:22:07,950 - lava_callback - INFO - Completed processing callback for node 69ba7cbd537ae4d3c8237d5d INFO: 172.21.0.1:57102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:22:18,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:22:18,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:23:21,583 - lava_callback - INFO - Received callback for node 69b7da0b00b80c8ffdcb8d7d INFO: 172.21.0.1:55034 - "POST /node/69b7da0b00b80c8ffdcb8d7d HTTP/1.0" 202 Accepted 2026-03-18 10:23:21,589 - lava_callback - INFO - Starting async job submit for node 69b7da0b00b80c8ffdcb8d7d 2026-03-18 10:23:21,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:23:21,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7da0b00b80c8ffdcb8d7d HTTP/1.1" 200 None 2026-03-18 10:23:21,605 - lava_callback - DEBUG - Processing node 69b7da0b00b80c8ffdcb8d7d: baseline-arm64-clabbe 2026-03-18 10:23:21,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7da0b00b80c8ffdcb8d7d 2026-03-18 10:23:21,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:23:21,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7da0b00b80c8ffdcb8d7d HTTP/1.1" 200 None 2026-03-18 10:23:21,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:23:21,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:23:21,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:23:21,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7da0b00b80c8ffdcb8d7d HTTP/1.1" 200 None 2026-03-18 10:23:21,663 - lava_callback - ERROR - Error processing callback for node 69b7da0b00b80c8ffdcb8d7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:25:21,687 - lava_callback - INFO - Received callback for node 69b7da7e00b80c8ffdcb8d8d INFO: 172.21.0.1:47390 - "POST /node/69b7da7e00b80c8ffdcb8d8d HTTP/1.0" 202 Accepted 2026-03-18 10:25:21,692 - lava_callback - INFO - Starting async job submit for node 69b7da7e00b80c8ffdcb8d8d 2026-03-18 10:25:21,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:25:21,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7da7e00b80c8ffdcb8d8d HTTP/1.1" 200 None 2026-03-18 10:25:21,725 - lava_callback - DEBUG - Processing node 69b7da7e00b80c8ffdcb8d8d: baseline-arm64-clabbe 2026-03-18 10:25:21,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7da7e00b80c8ffdcb8d8d 2026-03-18 10:25:21,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:25:21,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7da7e00b80c8ffdcb8d8d HTTP/1.1" 200 None 2026-03-18 10:25:21,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:25:21,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69afd839ae557f2600f0f045 HTTP/1.1" 200 None 2026-03-18 10:25:21,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:25:21,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7da7e00b80c8ffdcb8d8d HTTP/1.1" 200 None 2026-03-18 10:25:21,783 - lava_callback - ERROR - Error processing callback for node 69b7da7e00b80c8ffdcb8d8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47398 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:25:32,436 - lava_callback - INFO - Received callback for node 69ba7d4d537ae4d3c8237d7c INFO: 172.21.0.1:33748 - "POST /node/69ba7d4d537ae4d3c8237d7c HTTP/1.0" 202 Accepted 2026-03-18 10:25:32,442 - lava_callback - INFO - Starting async job submit for node 69ba7d4d537ae4d3c8237d7c 2026-03-18 10:25:32,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:25:32,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7d4d537ae4d3c8237d7c HTTP/1.1" 200 None 2026-03-18 10:25:32,488 - lava_callback - DEBUG - Processing node 69ba7d4d537ae4d3c8237d7c: baseline-arm64 2026-03-18 10:25:32,634 - lava_callback - WARNING - Failed to upload log 2026-03-18 10:25:32,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:25:32,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:25:32,948 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7d4d537ae4d3c8237d7c/lava-logs.yaml 2026-03-18 10:25:32,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:25:33,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:25:33,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7d4d537ae4d3c8237d7c/lava_callback.json.gz 2026-03-18 10:25:33,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:25:33,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7d4d537ae4d3c8237d7c HTTP/1.1" 200 None 2026-03-18 10:25:33,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:25:33,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:25:33,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:25:33,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7d4d537ae4d3c8237d7c HTTP/1.1" 200 None 2026-03-18 10:25:33,261 - lava_callback - INFO - Completed processing callback for node 69ba7d4d537ae4d3c8237d7c INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:25:48,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:25:48,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:30:14,796 - lava_callback - INFO - Received callback for node 69ba7e5e537ae4d3c8237dab INFO: 172.21.0.1:33406 - "POST /node/69ba7e5e537ae4d3c8237dab HTTP/1.0" 202 Accepted 2026-03-18 10:30:14,803 - lava_callback - INFO - Starting async job submit for node 69ba7e5e537ae4d3c8237dab 2026-03-18 10:30:14,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:30:14,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7e5e537ae4d3c8237dab HTTP/1.1" 200 None 2026-03-18 10:30:14,841 - lava_callback - DEBUG - Processing node 69ba7e5e537ae4d3c8237dab: baseline-nfs-arm64 INFO: 172.21.0.1:33410 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 10:30:15,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:30:15,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:30:15,449 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7e5e537ae4d3c8237dab/log.txt.gz 2026-03-18 10:30:15,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:30:16,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:30:16,014 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7e5e537ae4d3c8237dab/lava-logs.yaml 2026-03-18 10:30:16,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:30:17,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:30:17,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7e5e537ae4d3c8237dab/lava_callback.json.gz 2026-03-18 10:30:17,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:30:17,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7e5e537ae4d3c8237dab HTTP/1.1" 200 None 2026-03-18 10:30:17,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:30:17,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:30:17,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:30:17,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7e5e537ae4d3c8237dab HTTP/1.1" 200 None 2026-03-18 10:30:17,394 - lava_callback - INFO - Completed processing callback for node 69ba7e5e537ae4d3c8237dab 2026-03-18 10:30:18,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:30:18,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54550 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:31:06,587 - lava_callback - INFO - Received callback for node 69ba7ea7537ae4d3c8237db2 INFO: 172.21.0.1:54556 - "POST /node/69ba7ea7537ae4d3c8237db2 HTTP/1.0" 202 Accepted 2026-03-18 10:31:06,594 - lava_callback - INFO - Starting async job submit for node 69ba7ea7537ae4d3c8237db2 2026-03-18 10:31:06,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:31:06,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7ea7537ae4d3c8237db2 HTTP/1.1" 200 None 2026-03-18 10:31:06,641 - lava_callback - DEBUG - Processing node 69ba7ea7537ae4d3c8237db2: baseline-arm64 INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:31:06,863 - lava_callback - WARNING - Failed to upload log 2026-03-18 10:31:06,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:31:07,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:31:07,151 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7ea7537ae4d3c8237db2/lava-logs.yaml 2026-03-18 10:31:07,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:31:07,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:31:07,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7ea7537ae4d3c8237db2/lava_callback.json.gz 2026-03-18 10:31:07,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:31:07,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7ea7537ae4d3c8237db2 HTTP/1.1" 200 None 2026-03-18 10:31:07,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:31:07,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:31:07,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:31:07,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7ea7537ae4d3c8237db2 HTTP/1.1" 200 None 2026-03-18 10:31:07,441 - lava_callback - INFO - Completed processing callback for node 69ba7ea7537ae4d3c8237db2 INFO: 172.21.0.1:40754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:31:18,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:31:18,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51422 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:41:03,852 - lava_callback - INFO - Received callback for node 69ba812c537ae4d3c8237e20 INFO: 172.21.0.1:54864 - "POST /node/69ba812c537ae4d3c8237e20 HTTP/1.0" 202 Accepted 2026-03-18 10:41:03,858 - lava_callback - INFO - Starting async job submit for node 69ba812c537ae4d3c8237e20 2026-03-18 10:41:03,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:41:03,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba812c537ae4d3c8237e20 HTTP/1.1" 200 None 2026-03-18 10:41:03,875 - lava_callback - DEBUG - Processing node 69ba812c537ae4d3c8237e20: baseline-nfs-arm64 2026-03-18 10:41:03,876 - lava_callback - WARNING - Failed to upload log 2026-03-18 10:41:03,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:41:04,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:41:04,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba812c537ae4d3c8237e20/lava-logs.yaml 2026-03-18 10:41:04,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:41:04,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:41:04,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba812c537ae4d3c8237e20/lava_callback.json.gz 2026-03-18 10:41:04,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:41:04,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba812c537ae4d3c8237e20 HTTP/1.1" 200 None 2026-03-18 10:41:04,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:41:04,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:41:04,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:41:04,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba812c537ae4d3c8237e20 HTTP/1.1" 200 None 2026-03-18 10:41:04,277 - lava_callback - INFO - Completed processing callback for node 69ba812c537ae4d3c8237e20 INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40674 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:41:18,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:41:18,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:43:00,606 - lava_callback - INFO - Received callback for node 69ba8175537ae4d3c8237e2b INFO: 172.21.0.1:60148 - "POST /node/69ba8175537ae4d3c8237e2b HTTP/1.0" 202 Accepted 2026-03-18 10:43:00,613 - lava_callback - INFO - Starting async job submit for node 69ba8175537ae4d3c8237e2b 2026-03-18 10:43:00,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:43:00,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8175537ae4d3c8237e2b HTTP/1.1" 200 None 2026-03-18 10:43:00,681 - lava_callback - DEBUG - Processing node 69ba8175537ae4d3c8237e2b: baseline-arm64 2026-03-18 10:43:00,815 - lava_callback - WARNING - Failed to upload log 2026-03-18 10:43:00,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:43:01,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:43:01,119 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba8175537ae4d3c8237e2b/lava-logs.yaml 2026-03-18 10:43:01,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:43:01,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:43:01,262 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba8175537ae4d3c8237e2b/lava_callback.json.gz 2026-03-18 10:43:01,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:43:01,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8175537ae4d3c8237e2b HTTP/1.1" 200 None 2026-03-18 10:43:01,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:43:01,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:43:01,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:43:01,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8175537ae4d3c8237e2b HTTP/1.1" 200 None 2026-03-18 10:43:01,488 - lava_callback - INFO - Completed processing callback for node 69ba8175537ae4d3c8237e2b INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:43:18,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:43:18,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:44:37,989 - lava_callback - INFO - Received callback for node 69ba80d8537ae4d3c8237e17 INFO: 172.21.0.1:55166 - "POST /node/69ba80d8537ae4d3c8237e17 HTTP/1.0" 202 Accepted 2026-03-18 10:44:37,997 - lava_callback - INFO - Starting async job submit for node 69ba80d8537ae4d3c8237e17 2026-03-18 10:44:38,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:44:38,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba80d8537ae4d3c8237e17 HTTP/1.1" 200 None 2026-03-18 10:44:38,047 - lava_callback - DEBUG - Processing node 69ba80d8537ae4d3c8237e17: baseline-arm64 2026-03-18 10:44:38,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:44:38,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:44:38,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba80d8537ae4d3c8237e17/log.txt.gz 2026-03-18 10:44:38,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:44:39,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:44:39,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba80d8537ae4d3c8237e17/lava-logs.yaml 2026-03-18 10:44:39,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:44:39,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:44:39,436 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba80d8537ae4d3c8237e17/lava_callback.json.gz DEBUG: Setup failed for 69ba80d8537ae4d3c8237e17. Transitting job node result: incomplete -> fail 2026-03-18 10:44:39,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:44:39,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba80d8537ae4d3c8237e17 HTTP/1.1" 200 None 2026-03-18 10:44:39,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:44:39,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:44:39,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:44:39,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba80d8537ae4d3c8237e17 HTTP/1.1" 200 None 2026-03-18 10:44:39,646 - lava_callback - INFO - Completed processing callback for node 69ba80d8537ae4d3c8237e17 INFO: 172.21.0.1:37894 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:44:48,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:44:48,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:45:25,080 - lava_callback - INFO - Received callback for node 69ba81c7537ae4d3c8237e38 INFO: 172.21.0.1:56390 - "POST /node/69ba81c7537ae4d3c8237e38 HTTP/1.0" 202 Accepted 2026-03-18 10:45:25,087 - lava_callback - INFO - Starting async job submit for node 69ba81c7537ae4d3c8237e38 2026-03-18 10:45:25,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:45:25,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba81c7537ae4d3c8237e38 HTTP/1.1" 200 None 2026-03-18 10:45:25,133 - lava_callback - DEBUG - Processing node 69ba81c7537ae4d3c8237e38: baseline-arm64 2026-03-18 10:45:25,335 - lava_callback - WARNING - Failed to upload log 2026-03-18 10:45:25,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:45:25,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:45:25,623 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba81c7537ae4d3c8237e38/lava-logs.yaml 2026-03-18 10:45:25,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:45:25,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:45:25,762 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba81c7537ae4d3c8237e38/lava_callback.json.gz 2026-03-18 10:45:25,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:45:25,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba81c7537ae4d3c8237e38 HTTP/1.1" 200 None 2026-03-18 10:45:25,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:45:25,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:45:25,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:45:25,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba81c7537ae4d3c8237e38 HTTP/1.1" 200 None 2026-03-18 10:45:25,924 - lava_callback - INFO - Completed processing callback for node 69ba81c7537ae4d3c8237e38 INFO: 172.21.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:45:48,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:45:48,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53992 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:46:42,318 - lava_callback - INFO - Received callback for node 69ba7de9537ae4d3c8237d9a INFO: 172.21.0.1:57168 - "POST /node/69ba7de9537ae4d3c8237d9a HTTP/1.0" 202 Accepted 2026-03-18 10:46:42,326 - lava_callback - INFO - Starting async job submit for node 69ba7de9537ae4d3c8237d9a 2026-03-18 10:46:42,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:46:42,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7de9537ae4d3c8237d9a HTTP/1.1" 200 None 2026-03-18 10:46:42,385 - lava_callback - DEBUG - Processing node 69ba7de9537ae4d3c8237d9a: baseline-nfs-arm64 2026-03-18 10:46:43,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:46:43,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:46:43,659 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7de9537ae4d3c8237d9a/log.txt.gz 2026-03-18 10:46:44,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:46:44,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:46:44,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7de9537ae4d3c8237d9a/lava-logs.yaml 2026-03-18 10:46:44,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:46:44,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:46:44,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba7de9537ae4d3c8237d9a/lava_callback.json.gz DEBUG: Setup failed for 69ba7de9537ae4d3c8237d9a. Transitting job node result: incomplete -> fail 2026-03-18 10:46:44,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:46:44,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7de9537ae4d3c8237d9a HTTP/1.1" 200 None 2026-03-18 10:46:44,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:46:44,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:46:44,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:46:44,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7de9537ae4d3c8237d9a HTTP/1.1" 200 None 2026-03-18 10:46:44,993 - lava_callback - INFO - Completed processing callback for node 69ba7de9537ae4d3c8237d9a INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:46:48,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:46:48,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:55:13,322 - lava_callback - INFO - Received callback for node 69b7e18f00b80c8ffdcb8e93 INFO: 172.21.0.1:40074 - "POST /node/69b7e18f00b80c8ffdcb8e93 HTTP/1.0" 202 Accepted 2026-03-18 10:55:13,328 - lava_callback - INFO - Starting async job submit for node 69b7e18f00b80c8ffdcb8e93 2026-03-18 10:55:13,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:13,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18f00b80c8ffdcb8e93 HTTP/1.1" 200 None 2026-03-18 10:55:13,347 - lava_callback - DEBUG - Processing node 69b7e18f00b80c8ffdcb8e93: baseline-arm64-baylibre 2026-03-18 10:55:13,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e18f00b80c8ffdcb8e93 2026-03-18 10:55:13,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:13,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e18f00b80c8ffdcb8e93 HTTP/1.1" 200 None 2026-03-18 10:55:13,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:13,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:13,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:13,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e18f00b80c8ffdcb8e93 HTTP/1.1" 200 None 2026-03-18 10:55:13,405 - lava_callback - ERROR - Error processing callback for node 69b7e18f00b80c8ffdcb8e93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:55:33,288 - lava_callback - INFO - Received callback for node 69b7e19000b80c8ffdcb8e96 INFO: 172.21.0.1:48312 - "POST /node/69b7e19000b80c8ffdcb8e96 HTTP/1.0" 202 Accepted 2026-03-18 10:55:33,294 - lava_callback - INFO - Starting async job submit for node 69b7e19000b80c8ffdcb8e96 2026-03-18 10:55:33,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:33,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19000b80c8ffdcb8e96 HTTP/1.1" 200 None 2026-03-18 10:55:33,310 - lava_callback - DEBUG - Processing node 69b7e19000b80c8ffdcb8e96: baseline-arm64-baylibre 2026-03-18 10:55:33,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e19000b80c8ffdcb8e96 2026-03-18 10:55:33,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:33,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19000b80c8ffdcb8e96 HTTP/1.1" 200 None 2026-03-18 10:55:33,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:33,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:33,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:33,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e19000b80c8ffdcb8e96 HTTP/1.1" 200 None 2026-03-18 10:55:33,369 - lava_callback - ERROR - Error processing callback for node 69b7e19000b80c8ffdcb8e96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 10:55:33,930 - lava_callback - INFO - Received callback for node 69b7e19200b80c8ffdcb8e99 INFO: 172.21.0.1:48320 - "POST /node/69b7e19200b80c8ffdcb8e99 HTTP/1.0" 202 Accepted 2026-03-18 10:55:33,936 - lava_callback - INFO - Starting async job submit for node 69b7e19200b80c8ffdcb8e99 2026-03-18 10:55:33,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:33,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19200b80c8ffdcb8e99 HTTP/1.1" 200 None 2026-03-18 10:55:33,953 - lava_callback - DEBUG - Processing node 69b7e19200b80c8ffdcb8e99: baseline-arm64-baylibre 2026-03-18 10:55:33,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e19200b80c8ffdcb8e99 2026-03-18 10:55:33,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:33,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19200b80c8ffdcb8e99 HTTP/1.1" 200 None 2026-03-18 10:55:33,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:33,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:33,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:34,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e19200b80c8ffdcb8e99 HTTP/1.1" 200 None 2026-03-18 10:55:34,015 - lava_callback - ERROR - Error processing callback for node 69b7e19200b80c8ffdcb8e99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 10:55:34,589 - lava_callback - INFO - Received callback for node 69b7e19400b80c8ffdcb8ea0 INFO: 172.21.0.1:48328 - "POST /node/69b7e19400b80c8ffdcb8ea0 HTTP/1.0" 202 Accepted 2026-03-18 10:55:34,594 - lava_callback - INFO - Starting async job submit for node 69b7e19400b80c8ffdcb8ea0 2026-03-18 10:55:34,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:34,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19400b80c8ffdcb8ea0 HTTP/1.1" 200 None 2026-03-18 10:55:34,613 - lava_callback - DEBUG - Processing node 69b7e19400b80c8ffdcb8ea0: baseline-arm64-baylibre 2026-03-18 10:55:34,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e19400b80c8ffdcb8ea0 2026-03-18 10:55:34,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:34,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19400b80c8ffdcb8ea0 HTTP/1.1" 200 None 2026-03-18 10:55:34,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:34,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:34,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:34,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e19400b80c8ffdcb8ea0 HTTP/1.1" 200 None 2026-03-18 10:55:34,681 - lava_callback - ERROR - Error processing callback for node 69b7e19400b80c8ffdcb8ea0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 10:55:35,252 - lava_callback - INFO - Received callback for node 69b7e19600b80c8ffdcb8ea3 INFO: 172.21.0.1:48338 - "POST /node/69b7e19600b80c8ffdcb8ea3 HTTP/1.0" 202 Accepted 2026-03-18 10:55:35,258 - lava_callback - INFO - Starting async job submit for node 69b7e19600b80c8ffdcb8ea3 2026-03-18 10:55:35,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:35,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19600b80c8ffdcb8ea3 HTTP/1.1" 200 None 2026-03-18 10:55:35,280 - lava_callback - DEBUG - Processing node 69b7e19600b80c8ffdcb8ea3: baseline-arm64-baylibre 2026-03-18 10:55:35,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e19600b80c8ffdcb8ea3 2026-03-18 10:55:35,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:35,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19600b80c8ffdcb8ea3 HTTP/1.1" 200 None 2026-03-18 10:55:35,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:35,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:35,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:35,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e19600b80c8ffdcb8ea3 HTTP/1.1" 200 None 2026-03-18 10:55:35,357 - lava_callback - ERROR - Error processing callback for node 69b7e19600b80c8ffdcb8ea3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 10:55:35,896 - lava_callback - INFO - Received callback for node 69b7e19700b80c8ffdcb8ea6 INFO: 172.21.0.1:48350 - "POST /node/69b7e19700b80c8ffdcb8ea6 HTTP/1.0" 202 Accepted 2026-03-18 10:55:35,902 - lava_callback - INFO - Starting async job submit for node 69b7e19700b80c8ffdcb8ea6 2026-03-18 10:55:35,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:35,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19700b80c8ffdcb8ea6 HTTP/1.1" 200 None 2026-03-18 10:55:35,918 - lava_callback - DEBUG - Processing node 69b7e19700b80c8ffdcb8ea6: baseline-arm64-baylibre 2026-03-18 10:55:35,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e19700b80c8ffdcb8ea6 2026-03-18 10:55:35,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:35,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e19700b80c8ffdcb8ea6 HTTP/1.1" 200 None 2026-03-18 10:55:35,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:35,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:35,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:35,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e19700b80c8ffdcb8ea6 HTTP/1.1" 200 None 2026-03-18 10:55:35,968 - lava_callback - ERROR - Error processing callback for node 69b7e19700b80c8ffdcb8ea6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:55:43,198 - lava_callback - INFO - Received callback for node 69b7e1a700b80c8ffdcb8ee4 INFO: 172.21.0.1:53110 - "POST /node/69b7e1a700b80c8ffdcb8ee4 HTTP/1.0" 202 Accepted 2026-03-18 10:55:43,203 - lava_callback - INFO - Starting async job submit for node 69b7e1a700b80c8ffdcb8ee4 2026-03-18 10:55:43,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:43,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1a700b80c8ffdcb8ee4 HTTP/1.1" 200 None 2026-03-18 10:55:43,219 - lava_callback - DEBUG - Processing node 69b7e1a700b80c8ffdcb8ee4: baseline-arm64-clabbe 2026-03-18 10:55:43,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e1a700b80c8ffdcb8ee4 2026-03-18 10:55:43,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:43,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1a700b80c8ffdcb8ee4 HTTP/1.1" 200 None 2026-03-18 10:55:43,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:43,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:43,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:43,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e1a700b80c8ffdcb8ee4 HTTP/1.1" 200 None 2026-03-18 10:55:43,278 - lava_callback - ERROR - Error processing callback for node 69b7e1a700b80c8ffdcb8ee4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 10:55:43,844 - lava_callback - INFO - Received callback for node 69b7e1a900b80c8ffdcb8ee7 INFO: 172.21.0.1:53126 - "POST /node/69b7e1a900b80c8ffdcb8ee7 HTTP/1.0" 202 Accepted 2026-03-18 10:55:43,849 - lava_callback - INFO - Starting async job submit for node 69b7e1a900b80c8ffdcb8ee7 2026-03-18 10:55:43,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:43,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1a900b80c8ffdcb8ee7 HTTP/1.1" 200 None 2026-03-18 10:55:43,866 - lava_callback - DEBUG - Processing node 69b7e1a900b80c8ffdcb8ee7: baseline-arm64-clabbe 2026-03-18 10:55:43,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e1a900b80c8ffdcb8ee7 2026-03-18 10:55:43,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:43,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1a900b80c8ffdcb8ee7 HTTP/1.1" 200 None 2026-03-18 10:55:43,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:43,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:43,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:43,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e1a900b80c8ffdcb8ee7 HTTP/1.1" 200 None 2026-03-18 10:55:43,920 - lava_callback - ERROR - Error processing callback for node 69b7e1a900b80c8ffdcb8ee7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 10:55:44,502 - lava_callback - INFO - Received callback for node 69b7e1a900b80c8ffdcb8eea INFO: 172.21.0.1:53138 - "POST /node/69b7e1a900b80c8ffdcb8eea HTTP/1.0" 202 Accepted 2026-03-18 10:55:44,509 - lava_callback - INFO - Starting async job submit for node 69b7e1a900b80c8ffdcb8eea 2026-03-18 10:55:44,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:44,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1a900b80c8ffdcb8eea HTTP/1.1" 200 None 2026-03-18 10:55:44,532 - lava_callback - DEBUG - Processing node 69b7e1a900b80c8ffdcb8eea: baseline-arm64-clabbe 2026-03-18 10:55:44,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e1a900b80c8ffdcb8eea 2026-03-18 10:55:44,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:44,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1a900b80c8ffdcb8eea HTTP/1.1" 200 None 2026-03-18 10:55:44,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:44,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:44,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:44,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e1a900b80c8ffdcb8eea HTTP/1.1" 200 None 2026-03-18 10:55:44,597 - lava_callback - ERROR - Error processing callback for node 69b7e1a900b80c8ffdcb8eea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 10:55:45,156 - lava_callback - INFO - Received callback for node 69b7e1aa00b80c8ffdcb8eed INFO: 172.21.0.1:53144 - "POST /node/69b7e1aa00b80c8ffdcb8eed HTTP/1.0" 202 Accepted 2026-03-18 10:55:45,161 - lava_callback - INFO - Starting async job submit for node 69b7e1aa00b80c8ffdcb8eed 2026-03-18 10:55:45,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:45,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1aa00b80c8ffdcb8eed HTTP/1.1" 200 None 2026-03-18 10:55:45,183 - lava_callback - DEBUG - Processing node 69b7e1aa00b80c8ffdcb8eed: baseline-arm64-clabbe 2026-03-18 10:55:45,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e1aa00b80c8ffdcb8eed 2026-03-18 10:55:45,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:45,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1aa00b80c8ffdcb8eed HTTP/1.1" 200 None 2026-03-18 10:55:45,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:45,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:45,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:45,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e1aa00b80c8ffdcb8eed HTTP/1.1" 200 None 2026-03-18 10:55:45,236 - lava_callback - ERROR - Error processing callback for node 69b7e1aa00b80c8ffdcb8eed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 10:55:45,820 - lava_callback - INFO - Received callback for node 69b7e1ad00b80c8ffdcb8ef6 INFO: 172.21.0.1:53158 - "POST /node/69b7e1ad00b80c8ffdcb8ef6 HTTP/1.0" 202 Accepted 2026-03-18 10:55:45,826 - lava_callback - INFO - Starting async job submit for node 69b7e1ad00b80c8ffdcb8ef6 2026-03-18 10:55:45,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:45,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1ad00b80c8ffdcb8ef6 HTTP/1.1" 200 None 2026-03-18 10:55:45,843 - lava_callback - DEBUG - Processing node 69b7e1ad00b80c8ffdcb8ef6: baseline-arm64-clabbe 2026-03-18 10:55:45,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e1ad00b80c8ffdcb8ef6 2026-03-18 10:55:45,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:45,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1ad00b80c8ffdcb8ef6 HTTP/1.1" 200 None 2026-03-18 10:55:45,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:45,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:45,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:45,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e1ad00b80c8ffdcb8ef6 HTTP/1.1" 200 None 2026-03-18 10:55:45,935 - lava_callback - ERROR - Error processing callback for node 69b7e1ad00b80c8ffdcb8ef6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 10:55:46,449 - lava_callback - INFO - Received callback for node 69b7e1ac00b80c8ffdcb8ef3 INFO: 172.21.0.1:53170 - "POST /node/69b7e1ac00b80c8ffdcb8ef3 HTTP/1.0" 202 Accepted 2026-03-18 10:55:46,455 - lava_callback - INFO - Starting async job submit for node 69b7e1ac00b80c8ffdcb8ef3 2026-03-18 10:55:46,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:46,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1ac00b80c8ffdcb8ef3 HTTP/1.1" 200 None 2026-03-18 10:55:46,470 - lava_callback - DEBUG - Processing node 69b7e1ac00b80c8ffdcb8ef3: baseline-arm64-clabbe 2026-03-18 10:55:46,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7e1ac00b80c8ffdcb8ef3 2026-03-18 10:55:46,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:46,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e1ac00b80c8ffdcb8ef3 HTTP/1.1" 200 None 2026-03-18 10:55:46,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:55:46,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-18 10:55:46,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:55:46,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7e1ac00b80c8ffdcb8ef3 HTTP/1.1" 200 None 2026-03-18 10:55:46,527 - lava_callback - ERROR - Error processing callback for node 69b7e1ac00b80c8ffdcb8ef3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:56:15,112 - lava_callback - INFO - Received callback for node 69ba830c537ae4d3c8237e71 INFO: 172.21.0.1:53028 - "POST /node/69ba830c537ae4d3c8237e71 HTTP/1.0" 202 Accepted 2026-03-18 10:56:15,119 - lava_callback - INFO - Starting async job submit for node 69ba830c537ae4d3c8237e71 2026-03-18 10:56:15,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:53032 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 10:56:15,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba830c537ae4d3c8237e71 HTTP/1.1" 200 None 2026-03-18 10:56:15,172 - lava_callback - DEBUG - Processing node 69ba830c537ae4d3c8237e71: baseline-arm64 2026-03-18 10:56:15,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:56:15,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:56:15,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba830c537ae4d3c8237e71/log.txt.gz 2026-03-18 10:56:16,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:56:16,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:56:16,248 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba830c537ae4d3c8237e71/lava-logs.yaml 2026-03-18 10:56:16,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 10:56:16,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 10:56:16,449 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba830c537ae4d3c8237e71/lava_callback.json.gz DEBUG: Setup failed for 69ba830c537ae4d3c8237e71. Transitting job node result: incomplete -> fail 2026-03-18 10:56:16,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK 2026-03-18 10:56:16,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba830c537ae4d3c8237e71 HTTP/1.1" 200 None 2026-03-18 10:56:16,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:56:16,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 10:56:16,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:56:16,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba830c537ae4d3c8237e71 HTTP/1.1" 200 None 2026-03-18 10:56:16,663 - lava_callback - INFO - Completed processing callback for node 69ba830c537ae4d3c8237e71 2026-03-18 10:56:18,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 10:56:18,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK 2026-03-18 11:11:22,977 - lava_callback - INFO - Received callback for node 69ba83b2537ae4d3c8237e85 INFO: 172.21.0.1:55342 - "POST /node/69ba83b2537ae4d3c8237e85 HTTP/1.0" 202 Accepted 2026-03-18 11:11:22,984 - lava_callback - INFO - Starting async job submit for node 69ba83b2537ae4d3c8237e85 2026-03-18 11:11:23,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:11:23,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba83b2537ae4d3c8237e85 HTTP/1.1" 200 None 2026-03-18 11:11:23,043 - lava_callback - DEBUG - Processing node 69ba83b2537ae4d3c8237e85: baseline-nfs-arm64 2026-03-18 11:11:24,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 11:11:24,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 11:11:24,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba83b2537ae4d3c8237e85/log.txt.gz 2026-03-18 11:11:24,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 11:11:25,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 11:11:25,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba83b2537ae4d3c8237e85/lava-logs.yaml 2026-03-18 11:11:25,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 11:11:25,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 11:11:25,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba83b2537ae4d3c8237e85/lava_callback.json.gz DEBUG: Setup failed for 69ba83b2537ae4d3c8237e85. Transitting job node result: incomplete -> fail 2026-03-18 11:11:25,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:11:25,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba83b2537ae4d3c8237e85 HTTP/1.1" 200 None 2026-03-18 11:11:25,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:11:25,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 11:11:25,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:11:25,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba83b2537ae4d3c8237e85 HTTP/1.1" 200 None 2026-03-18 11:11:25,561 - lava_callback - INFO - Completed processing callback for node 69ba83b2537ae4d3c8237e85 INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39468 - "GET / HTTP/1.0" 200 OK 2026-03-18 11:11:48,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:11:48,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK 2026-03-18 11:45:42,986 - lava_callback - INFO - Received callback for node 69ba8bb4537ae4d3c8237f91 INFO: 172.21.0.1:48816 - "POST /node/69ba8bb4537ae4d3c8237f91 HTTP/1.0" 202 Accepted 2026-03-18 11:45:42,994 - lava_callback - INFO - Starting async job submit for node 69ba8bb4537ae4d3c8237f91 2026-03-18 11:45:43,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:45:43,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8bb4537ae4d3c8237f91 HTTP/1.1" 200 None 2026-03-18 11:45:43,054 - lava_callback - DEBUG - Processing node 69ba8bb4537ae4d3c8237f91: baseline-nfs-arm64 2026-03-18 11:45:44,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 11:45:44,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 11:45:44,254 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba8bb4537ae4d3c8237f91/log.txt.gz 2026-03-18 11:45:44,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 11:45:45,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 11:45:45,112 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba8bb4537ae4d3c8237f91/lava-logs.yaml 2026-03-18 11:45:45,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 11:45:45,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 11:45:45,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba8bb4537ae4d3c8237f91/lava_callback.json.gz DEBUG: Setup failed for 69ba8bb4537ae4d3c8237f91. Transitting job node result: incomplete -> fail 2026-03-18 11:45:45,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:45:45,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8bb4537ae4d3c8237f91 HTTP/1.1" 200 None 2026-03-18 11:45:45,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:45:45,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 11:45:45,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:45:45,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8bb4537ae4d3c8237f91 HTTP/1.1" 200 None 2026-03-18 11:45:45,635 - lava_callback - INFO - Completed processing callback for node 69ba8bb4537ae4d3c8237f91 INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK 2026-03-18 11:45:48,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:45:48,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET / HTTP/1.0" 200 OK 2026-03-18 11:59:04,344 - lava_callback - INFO - Received callback for node 69ba73b5537ae4d3c8237a41 INFO: 172.21.0.1:46176 - "POST /node/69ba73b5537ae4d3c8237a41 HTTP/1.0" 202 Accepted 2026-03-18 11:59:04,350 - lava_callback - INFO - Starting async job submit for node 69ba73b5537ae4d3c8237a41 2026-03-18 11:59:04,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:59:04,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73b5537ae4d3c8237a41 HTTP/1.1" 200 None 2026-03-18 11:59:04,410 - lava_callback - DEBUG - Processing node 69ba73b5537ae4d3c8237a41: baseline-arm64-broonie 2026-03-18 11:59:04,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 11:59:04,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 11:59:04,779 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73b5537ae4d3c8237a41/log.txt.gz 2026-03-18 11:59:04,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 11:59:05,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 11:59:05,127 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73b5537ae4d3c8237a41/lava-logs.yaml 2026-03-18 11:59:05,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 11:59:05,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 11:59:05,294 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ba73b5537ae4d3c8237a41/lava_callback.json.gz 2026-03-18 11:59:05,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:59:05,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73b5537ae4d3c8237a41 HTTP/1.1" 200 None 2026-03-18 11:59:05,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:59:05,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 11:59:05,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:59:05,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73b5537ae4d3c8237a41 HTTP/1.1" 200 None 2026-03-18 11:59:05,402 - lava_callback - INFO - Completed processing callback for node 69ba73b5537ae4d3c8237a41 INFO: 172.21.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK 2026-03-18 11:59:18,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 11:59:18,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK 2026-03-18 12:35:52,408 - lava_callback - INFO - Received callback for node 69b9c0f9151254d948ef1b58 INFO: 172.21.0.1:48596 - "POST /node/69b9c0f9151254d948ef1b58 HTTP/1.0" 202 Accepted 2026-03-18 12:35:52,415 - lava_callback - INFO - Starting async job submit for node 69b9c0f9151254d948ef1b58 2026-03-18 12:35:52,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:35:52,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9c0f9151254d948ef1b58 HTTP/1.1" 200 None 2026-03-18 12:35:52,456 - lava_callback - DEBUG - Processing node 69b9c0f9151254d948ef1b58: baseline-nfs-arm64 2026-03-18 12:35:53,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 12:35:53,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 12:35:53,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b9c0f9151254d948ef1b58/log.txt.gz 2026-03-18 12:35:53,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 12:35:53,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 12:35:53,723 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b9c0f9151254d948ef1b58/lava-logs.yaml 2026-03-18 12:35:53,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 12:35:53,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 12:35:53,928 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b9c0f9151254d948ef1b58/lava_callback.json.gz 2026-03-18 12:35:53,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:35:53,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9c0f9151254d948ef1b58 HTTP/1.1" 200 None 2026-03-18 12:35:53,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:35:54,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-18 12:35:54,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:35:54,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9c0f9151254d948ef1b58 HTTP/1.1" 200 None 2026-03-18 12:35:54,134 - lava_callback - INFO - Completed processing callback for node 69b9c0f9151254d948ef1b58 INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK 2026-03-18 12:36:19,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:36:19,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK 2026-03-18 12:39:18,072 - lava_callback - INFO - Received callback for node 69b9c36f151254d948ef1ba0 INFO: 172.21.0.1:51844 - "POST /node/69b9c36f151254d948ef1ba0 HTTP/1.0" 202 Accepted 2026-03-18 12:39:18,078 - lava_callback - INFO - Starting async job submit for node 69b9c36f151254d948ef1ba0 2026-03-18 12:39:18,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:39:18,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9c36f151254d948ef1ba0 HTTP/1.1" 200 None 2026-03-18 12:39:18,124 - lava_callback - DEBUG - Processing node 69b9c36f151254d948ef1ba0: baseline-arm64 2026-03-18 12:39:18,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 12:39:18,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 12:39:18,873 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b9c36f151254d948ef1ba0/log.txt.gz 2026-03-18 12:39:19,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 12:39:19,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 12:39:19,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b9c36f151254d948ef1ba0/lava-logs.yaml 2026-03-18 12:39:19,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 12:39:19,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 12:39:19,576 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b9c36f151254d948ef1ba0/lava_callback.json.gz 2026-03-18 12:39:19,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:39:19,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9c36f151254d948ef1ba0 HTTP/1.1" 200 None 2026-03-18 12:39:19,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:39:19,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-18 12:39:19,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:39:19,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9c36f151254d948ef1ba0 HTTP/1.1" 200 None 2026-03-18 12:39:19,700 - lava_callback - INFO - Completed processing callback for node 69b9c36f151254d948ef1ba0 INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39820 - "GET / HTTP/1.0" 200 OK 2026-03-18 12:39:49,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:39:49,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK 2026-03-18 12:48:19,613 - lava_callback - INFO - Received callback for node 69b7fc11113612b7716bc572 INFO: 172.21.0.1:49066 - "POST /node/69b7fc11113612b7716bc572 HTTP/1.0" 202 Accepted 2026-03-18 12:48:19,618 - lava_callback - INFO - Starting async job submit for node 69b7fc11113612b7716bc572 2026-03-18 12:48:19,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:19,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc11113612b7716bc572 HTTP/1.1" 200 None 2026-03-18 12:48:19,635 - lava_callback - DEBUG - Processing node 69b7fc11113612b7716bc572: baseline-arm-baylibre 2026-03-18 12:48:19,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7fc11113612b7716bc572 2026-03-18 12:48:19,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:19,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc11113612b7716bc572 HTTP/1.1" 200 None 2026-03-18 12:48:19,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:19,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-18 12:48:19,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:19,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc11113612b7716bc572 HTTP/1.1" 200 None 2026-03-18 12:48:19,711 - lava_callback - ERROR - Error processing callback for node 69b7fc11113612b7716bc572: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59462 - "GET / HTTP/1.0" 200 OK 2026-03-18 12:48:39,519 - lava_callback - INFO - Received callback for node 69b7fc12113612b7716bc575 INFO: 172.21.0.1:59474 - "POST /node/69b7fc12113612b7716bc575 HTTP/1.0" 202 Accepted 2026-03-18 12:48:39,524 - lava_callback - INFO - Starting async job submit for node 69b7fc12113612b7716bc575 2026-03-18 12:48:39,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:39,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc12113612b7716bc575 HTTP/1.1" 200 None 2026-03-18 12:48:39,547 - lava_callback - DEBUG - Processing node 69b7fc12113612b7716bc575: baseline-arm-baylibre 2026-03-18 12:48:39,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7fc12113612b7716bc575 2026-03-18 12:48:39,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:39,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc12113612b7716bc575 HTTP/1.1" 200 None 2026-03-18 12:48:39,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:39,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-18 12:48:39,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:39,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc12113612b7716bc575 HTTP/1.1" 200 None 2026-03-18 12:48:39,599 - lava_callback - ERROR - Error processing callback for node 69b7fc12113612b7716bc575: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 12:48:40,179 - lava_callback - INFO - Received callback for node 69b7fc13113612b7716bc578 INFO: 172.21.0.1:33074 - "POST /node/69b7fc13113612b7716bc578 HTTP/1.0" 202 Accepted 2026-03-18 12:48:40,184 - lava_callback - INFO - Starting async job submit for node 69b7fc13113612b7716bc578 2026-03-18 12:48:40,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:40,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc13113612b7716bc578 HTTP/1.1" 200 None 2026-03-18 12:48:40,200 - lava_callback - DEBUG - Processing node 69b7fc13113612b7716bc578: baseline-arm-baylibre 2026-03-18 12:48:40,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7fc13113612b7716bc578 2026-03-18 12:48:40,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:40,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc13113612b7716bc578 HTTP/1.1" 200 None 2026-03-18 12:48:40,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:40,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-18 12:48:40,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:40,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc13113612b7716bc578 HTTP/1.1" 200 None 2026-03-18 12:48:40,266 - lava_callback - ERROR - Error processing callback for node 69b7fc13113612b7716bc578: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 12:48:40,823 - lava_callback - INFO - Received callback for node 69b7fc15113612b7716bc57b INFO: 172.21.0.1:33084 - "POST /node/69b7fc15113612b7716bc57b HTTP/1.0" 202 Accepted 2026-03-18 12:48:40,829 - lava_callback - INFO - Starting async job submit for node 69b7fc15113612b7716bc57b 2026-03-18 12:48:40,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:40,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc15113612b7716bc57b HTTP/1.1" 200 None 2026-03-18 12:48:40,845 - lava_callback - DEBUG - Processing node 69b7fc15113612b7716bc57b: baseline-arm-baylibre 2026-03-18 12:48:40,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7fc15113612b7716bc57b 2026-03-18 12:48:40,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:40,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc15113612b7716bc57b HTTP/1.1" 200 None 2026-03-18 12:48:40,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:40,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-18 12:48:40,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:40,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc15113612b7716bc57b HTTP/1.1" 200 None 2026-03-18 12:48:40,896 - lava_callback - ERROR - Error processing callback for node 69b7fc15113612b7716bc57b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 12:48:41,491 - lava_callback - INFO - Received callback for node 69b7fc17113612b7716bc594 INFO: 172.21.0.1:33092 - "POST /node/69b7fc17113612b7716bc594 HTTP/1.0" 202 Accepted 2026-03-18 12:48:41,496 - lava_callback - INFO - Starting async job submit for node 69b7fc17113612b7716bc594 2026-03-18 12:48:41,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:41,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc17113612b7716bc594 HTTP/1.1" 200 None 2026-03-18 12:48:41,511 - lava_callback - DEBUG - Processing node 69b7fc17113612b7716bc594: baseline-arm-baylibre 2026-03-18 12:48:41,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7fc17113612b7716bc594 2026-03-18 12:48:41,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:41,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc17113612b7716bc594 HTTP/1.1" 200 None 2026-03-18 12:48:41,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:41,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-18 12:48:41,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:41,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc17113612b7716bc594 HTTP/1.1" 200 None 2026-03-18 12:48:41,579 - lava_callback - ERROR - Error processing callback for node 69b7fc17113612b7716bc594: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 12:48:42,153 - lava_callback - INFO - Received callback for node 69b7fc19113612b7716bc597 INFO: 172.21.0.1:33106 - "POST /node/69b7fc19113612b7716bc597 HTTP/1.0" 202 Accepted 2026-03-18 12:48:42,158 - lava_callback - INFO - Starting async job submit for node 69b7fc19113612b7716bc597 2026-03-18 12:48:42,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:42,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc19113612b7716bc597 HTTP/1.1" 200 None 2026-03-18 12:48:42,174 - lava_callback - DEBUG - Processing node 69b7fc19113612b7716bc597: baseline-arm-baylibre 2026-03-18 12:48:42,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7fc19113612b7716bc597 2026-03-18 12:48:42,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:42,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc19113612b7716bc597 HTTP/1.1" 200 None 2026-03-18 12:48:42,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:42,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-18 12:48:42,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:42,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc19113612b7716bc597 HTTP/1.1" 200 None 2026-03-18 12:48:42,239 - lava_callback - ERROR - Error processing callback for node 69b7fc19113612b7716bc597: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK 2026-03-18 12:48:48,543 - lava_callback - INFO - Received callback for node 69b7fc20113612b7716bc5b0 INFO: 172.21.0.1:33128 - "POST /node/69b7fc20113612b7716bc5b0 HTTP/1.0" 202 Accepted 2026-03-18 12:48:48,548 - lava_callback - INFO - Starting async job submit for node 69b7fc20113612b7716bc5b0 2026-03-18 12:48:48,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:48,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc20113612b7716bc5b0 HTTP/1.1" 200 None 2026-03-18 12:48:48,577 - lava_callback - DEBUG - Processing node 69b7fc20113612b7716bc5b0: baseline-arm-clabbe 2026-03-18 12:48:48,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7fc20113612b7716bc5b0 2026-03-18 12:48:48,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:48,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc20113612b7716bc5b0 HTTP/1.1" 200 None 2026-03-18 12:48:48,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:48,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-18 12:48:48,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:48,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc20113612b7716bc5b0 HTTP/1.1" 200 None 2026-03-18 12:48:48,639 - lava_callback - ERROR - Error processing callback for node 69b7fc20113612b7716bc5b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 12:48:49,198 - lava_callback - INFO - Received callback for node 69b7fc25113612b7716bc5c0 INFO: 172.21.0.1:33130 - "POST /node/69b7fc25113612b7716bc5c0 HTTP/1.0" 202 Accepted 2026-03-18 12:48:49,204 - lava_callback - INFO - Starting async job submit for node 69b7fc25113612b7716bc5c0 2026-03-18 12:48:49,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:49,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc25113612b7716bc5c0 HTTP/1.1" 200 None 2026-03-18 12:48:49,221 - lava_callback - DEBUG - Processing node 69b7fc25113612b7716bc5c0: baseline-arm-clabbe 2026-03-18 12:48:49,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7fc25113612b7716bc5c0 2026-03-18 12:48:49,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:49,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc25113612b7716bc5c0 HTTP/1.1" 200 None 2026-03-18 12:48:49,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:49,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-18 12:48:49,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:49,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc25113612b7716bc5c0 HTTP/1.1" 200 None 2026-03-18 12:48:49,275 - lava_callback - ERROR - Error processing callback for node 69b7fc25113612b7716bc5c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 12:48:49,855 - lava_callback - INFO - Received callback for node 69b7fc26113612b7716bc5c3 INFO: 172.21.0.1:43638 - "POST /node/69b7fc26113612b7716bc5c3 HTTP/1.0" 202 Accepted 2026-03-18 12:48:49,861 - lava_callback - INFO - Starting async job submit for node 69b7fc26113612b7716bc5c3 2026-03-18 12:48:49,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:49,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc26113612b7716bc5c3 HTTP/1.1" 200 None 2026-03-18 12:48:49,877 - lava_callback - DEBUG - Processing node 69b7fc26113612b7716bc5c3: baseline-arm-clabbe 2026-03-18 12:48:49,878 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7fc26113612b7716bc5c3 2026-03-18 12:48:49,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:49,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc26113612b7716bc5c3 HTTP/1.1" 200 None 2026-03-18 12:48:49,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:49,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-18 12:48:49,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:49,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc26113612b7716bc5c3 HTTP/1.1" 200 None 2026-03-18 12:48:49,936 - lava_callback - ERROR - Error processing callback for node 69b7fc26113612b7716bc5c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 12:48:50,531 - lava_callback - INFO - Received callback for node 69b7fc26113612b7716bc5c6 INFO: 172.21.0.1:43644 - "POST /node/69b7fc26113612b7716bc5c6 HTTP/1.0" 202 Accepted 2026-03-18 12:48:50,536 - lava_callback - INFO - Starting async job submit for node 69b7fc26113612b7716bc5c6 2026-03-18 12:48:50,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:50,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc26113612b7716bc5c6 HTTP/1.1" 200 None 2026-03-18 12:48:50,557 - lava_callback - DEBUG - Processing node 69b7fc26113612b7716bc5c6: baseline-arm-clabbe 2026-03-18 12:48:50,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7fc26113612b7716bc5c6 2026-03-18 12:48:50,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:50,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc26113612b7716bc5c6 HTTP/1.1" 200 None 2026-03-18 12:48:50,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:50,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-18 12:48:50,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:50,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc26113612b7716bc5c6 HTTP/1.1" 200 None 2026-03-18 12:48:50,616 - lava_callback - ERROR - Error processing callback for node 69b7fc26113612b7716bc5c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 12:48:51,243 - lava_callback - INFO - Received callback for node 69b7fc29113612b7716bc5cf INFO: 172.21.0.1:43650 - "POST /node/69b7fc29113612b7716bc5cf HTTP/1.0" 202 Accepted 2026-03-18 12:48:51,248 - lava_callback - INFO - Starting async job submit for node 69b7fc29113612b7716bc5cf 2026-03-18 12:48:51,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:51,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc29113612b7716bc5cf HTTP/1.1" 200 None 2026-03-18 12:48:51,264 - lava_callback - DEBUG - Processing node 69b7fc29113612b7716bc5cf: baseline-arm-clabbe 2026-03-18 12:48:51,264 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b7fc29113612b7716bc5cf 2026-03-18 12:48:51,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:51,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7fc29113612b7716bc5cf HTTP/1.1" 200 None 2026-03-18 12:48:51,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:51,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-18 12:48:51,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:48:51,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b7fc29113612b7716bc5cf HTTP/1.1" 200 None 2026-03-18 12:48:51,329 - lava_callback - ERROR - Error processing callback for node 69b7fc29113612b7716bc5cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43056 - "GET / HTTP/1.0" 200 OK 2026-03-18 12:52:44,126 - lava_callback - INFO - Received callback for node 69ba159ad5731cbd74148cf4 INFO: 172.21.0.1:54532 - "POST /node/69ba159ad5731cbd74148cf4 HTTP/1.0" 202 Accepted 2026-03-18 12:52:44,133 - lava_callback - INFO - Starting async job submit for node 69ba159ad5731cbd74148cf4 2026-03-18 12:52:44,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:52:44,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba159ad5731cbd74148cf4 HTTP/1.1" 200 None 2026-03-18 12:52:44,173 - lava_callback - DEBUG - Processing node 69ba159ad5731cbd74148cf4: baseline-nfs-arm64 2026-03-18 12:52:44,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 12:52:44,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 12:52:44,900 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba159ad5731cbd74148cf4/log.txt.gz 2026-03-18 12:52:45,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 12:52:45,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 12:52:45,453 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba159ad5731cbd74148cf4/lava-logs.yaml 2026-03-18 12:52:45,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 12:52:45,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 12:52:45,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba159ad5731cbd74148cf4/lava_callback.json.gz 2026-03-18 12:52:45,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:52:45,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba159ad5731cbd74148cf4 HTTP/1.1" 200 None 2026-03-18 12:52:45,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:52:45,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-18 12:52:45,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:52:45,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba159ad5731cbd74148cf4 HTTP/1.1" 200 None 2026-03-18 12:52:45,759 - lava_callback - INFO - Completed processing callback for node 69ba159ad5731cbd74148cf4 INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK 2026-03-18 12:52:49,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 12:52:49,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39166 - "GET / HTTP/1.0" 200 OK 2026-03-18 13:05:24,085 - lava_callback - INFO - Received callback for node 69ba7393537ae4d3c82379d0 INFO: 172.21.0.1:43566 - "POST /node/69ba7393537ae4d3c82379d0 HTTP/1.0" 202 Accepted 2026-03-18 13:05:24,091 - lava_callback - INFO - Starting async job submit for node 69ba7393537ae4d3c82379d0 2026-03-18 13:05:24,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:05:24,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7393537ae4d3c82379d0 HTTP/1.1" 200 None 2026-03-18 13:05:24,137 - lava_callback - DEBUG - Processing node 69ba7393537ae4d3c82379d0: baseline-arm64 2026-03-18 13:05:24,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:05:24,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:05:24,864 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7393537ae4d3c82379d0/log.txt.gz 2026-03-18 13:05:25,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:05:25,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:05:25,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7393537ae4d3c82379d0/lava-logs.yaml 2026-03-18 13:05:25,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:05:25,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:05:25,572 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ba7393537ae4d3c82379d0/lava_callback.json.gz 2026-03-18 13:05:25,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:05:25,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7393537ae4d3c82379d0 HTTP/1.1" 200 None 2026-03-18 13:05:25,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:05:25,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 13:05:25,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:05:25,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7393537ae4d3c82379d0 HTTP/1.1" 200 None 2026-03-18 13:05:25,753 - lava_callback - INFO - Completed processing callback for node 69ba7393537ae4d3c82379d0 INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42138 - "GET / HTTP/1.0" 200 OK 2026-03-18 13:05:49,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:05:49,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54484 - "GET / HTTP/1.0" 200 OK 2026-03-18 13:25:22,045 - lava_callback - INFO - Received callback for node 69ba73a3537ae4d3c8237a00 INFO: 172.21.0.1:56262 - "POST /node/69ba73a3537ae4d3c8237a00 HTTP/1.0" 202 Accepted 2026-03-18 13:25:22,051 - lava_callback - INFO - Starting async job submit for node 69ba73a3537ae4d3c8237a00 2026-03-18 13:25:22,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:25:22,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a3537ae4d3c8237a00 HTTP/1.1" 200 None 2026-03-18 13:25:22,112 - lava_callback - DEBUG - Processing node 69ba73a3537ae4d3c8237a00: baseline-nfs-arm64 2026-03-18 13:25:22,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:25:22,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:25:22,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a3537ae4d3c8237a00/log.txt.gz 2026-03-18 13:25:23,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:25:23,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:25:23,310 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a3537ae4d3c8237a00/lava-logs.yaml 2026-03-18 13:25:23,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:25:23,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:25:23,507 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba73a3537ae4d3c8237a00/lava_callback.json.gz 2026-03-18 13:25:23,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:25:23,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a3537ae4d3c8237a00 HTTP/1.1" 200 None 2026-03-18 13:25:23,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:25:23,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 13:25:23,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:25:23,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73a3537ae4d3c8237a00 HTTP/1.1" 200 None 2026-03-18 13:25:23,664 - lava_callback - INFO - Completed processing callback for node 69ba73a3537ae4d3c8237a00 2026-03-18 13:25:25,328 - lava_callback - INFO - Received callback for node 69ba9c35537ae4d3c8237fa5 INFO: 172.21.0.1:56278 - "POST /node/69ba9c35537ae4d3c8237fa5 HTTP/1.0" 202 Accepted 2026-03-18 13:25:25,335 - lava_callback - INFO - Starting async job submit for node 69ba9c35537ae4d3c8237fa5 2026-03-18 13:25:25,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:25:25,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9c35537ae4d3c8237fa5 HTTP/1.1" 200 None 2026-03-18 13:25:25,381 - lava_callback - DEBUG - Processing node 69ba9c35537ae4d3c8237fa5: baseline-nfs-arm64 2026-03-18 13:25:25,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:25:26,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:25:26,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba9c35537ae4d3c8237fa5/log.txt.gz 2026-03-18 13:25:26,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK 2026-03-18 13:25:26,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:25:26,585 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba9c35537ae4d3c8237fa5/lava-logs.yaml 2026-03-18 13:25:26,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:25:26,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:25:26,780 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ba9c35537ae4d3c8237fa5/lava_callback.json.gz 2026-03-18 13:25:26,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:25:26,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9c35537ae4d3c8237fa5 HTTP/1.1" 200 None 2026-03-18 13:25:26,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:25:26,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-18 13:25:26,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:25:26,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba9c35537ae4d3c8237fa5 HTTP/1.1" 200 None 2026-03-18 13:25:26,914 - lava_callback - INFO - Completed processing callback for node 69ba9c35537ae4d3c8237fa5 INFO: 172.21.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48852 - "GET / HTTP/1.0" 200 OK 2026-03-18 13:25:49,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:25:49,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK 2026-03-18 13:27:40,932 - lava_callback - INFO - Received callback for node 69baa31b537ae4d3c82380ed INFO: 172.21.0.1:32914 - "POST /node/69baa31b537ae4d3c82380ed HTTP/1.0" 202 Accepted 2026-03-18 13:27:40,939 - lava_callback - INFO - Starting async job submit for node 69baa31b537ae4d3c82380ed 2026-03-18 13:27:40,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:27:41,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa31b537ae4d3c82380ed HTTP/1.1" 200 None 2026-03-18 13:27:41,003 - lava_callback - DEBUG - Processing node 69baa31b537ae4d3c82380ed: baseline-arm64 2026-03-18 13:27:41,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:27:41,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:27:41,659 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69baa31b537ae4d3c82380ed/log.txt.gz 2026-03-18 13:27:41,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:27:42,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:27:42,165 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69baa31b537ae4d3c82380ed/lava-logs.yaml 2026-03-18 13:27:42,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:27:42,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:27:42,332 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69baa31b537ae4d3c82380ed/lava_callback.json.gz 2026-03-18 13:27:42,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:27:42,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa31b537ae4d3c82380ed HTTP/1.1" 200 None 2026-03-18 13:27:42,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:27:42,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 13:27:42,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:27:42,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa31b537ae4d3c82380ed HTTP/1.1" 200 None 2026-03-18 13:27:42,496 - lava_callback - INFO - Completed processing callback for node 69baa31b537ae4d3c82380ed INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK 2026-03-18 13:27:49,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:27:49,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK 2026-03-18 13:37:44,657 - lava_callback - INFO - Received callback for node 69baa7cf537ae4d3c82380f9 INFO: 172.21.0.1:44044 - "POST /node/69baa7cf537ae4d3c82380f9 HTTP/1.0" 202 Accepted 2026-03-18 13:37:44,663 - lava_callback - INFO - Starting async job submit for node 69baa7cf537ae4d3c82380f9 2026-03-18 13:37:44,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:37:44,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa7cf537ae4d3c82380f9 HTTP/1.1" 200 None 2026-03-18 13:37:44,714 - lava_callback - DEBUG - Processing node 69baa7cf537ae4d3c82380f9: baseline-nfs-arm64 2026-03-18 13:37:45,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:37:45,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:37:45,387 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69baa7cf537ae4d3c82380f9/log.txt.gz 2026-03-18 13:37:45,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:37:45,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:37:45,945 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69baa7cf537ae4d3c82380f9/lava-logs.yaml 2026-03-18 13:37:45,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:37:46,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:37:46,201 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69baa7cf537ae4d3c82380f9/lava_callback.json.gz 2026-03-18 13:37:46,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:37:46,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa7cf537ae4d3c82380f9 HTTP/1.1" 200 None 2026-03-18 13:37:46,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:37:46,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 13:37:46,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:37:46,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa7cf537ae4d3c82380f9 HTTP/1.1" 200 None 2026-03-18 13:37:46,341 - lava_callback - INFO - Completed processing callback for node 69baa7cf537ae4d3c82380f9 INFO: 172.21.0.1:44052 - "GET / HTTP/1.0" 200 OK 2026-03-18 13:37:49,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:37:49,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK 2026-03-18 13:38:20,184 - lava_callback - INFO - Received callback for node 69baa853537ae4d3c8238106 INFO: 172.21.0.1:48498 - "POST /node/69baa853537ae4d3c8238106 HTTP/1.0" 202 Accepted 2026-03-18 13:38:20,190 - lava_callback - INFO - Starting async job submit for node 69baa853537ae4d3c8238106 2026-03-18 13:38:20,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:38:20,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa853537ae4d3c8238106 HTTP/1.1" 200 None 2026-03-18 13:38:20,230 - lava_callback - DEBUG - Processing node 69baa853537ae4d3c8238106: baseline-arm64 2026-03-18 13:38:20,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:38:20,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:38:20,880 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69baa853537ae4d3c8238106/log.txt.gz 2026-03-18 13:38:21,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:38:21,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:38:21,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69baa853537ae4d3c8238106/lava-logs.yaml 2026-03-18 13:38:21,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 13:38:21,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 13:38:21,567 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69baa853537ae4d3c8238106/lava_callback.json.gz 2026-03-18 13:38:21,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:38:21,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa853537ae4d3c8238106 HTTP/1.1" 200 None 2026-03-18 13:38:21,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:38:21,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 13:38:21,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:38:21,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa853537ae4d3c8238106 HTTP/1.1" 200 None 2026-03-18 13:38:21,716 - lava_callback - INFO - Completed processing callback for node 69baa853537ae4d3c8238106 INFO: 172.21.0.1:48502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK 2026-03-18 13:38:49,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 13:38:49,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:28:44,218 - lava_callback - INFO - Received callback for node 69baaab6537ae4d3c8238120 INFO: 172.21.0.1:49376 - "POST /node/69baaab6537ae4d3c8238120 HTTP/1.0" 202 Accepted 2026-03-18 14:28:44,224 - lava_callback - INFO - Starting async job submit for node 69baaab6537ae4d3c8238120 2026-03-18 14:28:44,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:28:44,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baaab6537ae4d3c8238120 HTTP/1.1" 200 None 2026-03-18 14:28:44,283 - lava_callback - DEBUG - Processing node 69baaab6537ae4d3c8238120: baseline-nfs-arm64 2026-03-18 14:28:44,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 14:28:44,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 14:28:44,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69baaab6537ae4d3c8238120/log.txt.gz 2026-03-18 14:28:45,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 14:28:45,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 14:28:45,313 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69baaab6537ae4d3c8238120/lava-logs.yaml 2026-03-18 14:28:45,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-18 14:28:45,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-18 14:28:45,512 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69baaab6537ae4d3c8238120/lava_callback.json.gz 2026-03-18 14:28:45,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:28:45,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baaab6537ae4d3c8238120 HTTP/1.1" 200 None 2026-03-18 14:28:45,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:28:45,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-18 14:28:45,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:28:45,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baaab6537ae4d3c8238120 HTTP/1.1" 200 None 2026-03-18 14:28:45,645 - lava_callback - INFO - Completed processing callback for node 69baaab6537ae4d3c8238120 INFO: 172.21.0.1:49380 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:28:49,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:28:49,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:46:26,231 - lava_callback - INFO - Received callback for node 69b817bb113612b7716bc947 INFO: 172.21.0.1:57090 - "POST /node/69b817bb113612b7716bc947 HTTP/1.0" 202 Accepted 2026-03-18 14:46:26,237 - lava_callback - INFO - Starting async job submit for node 69b817bb113612b7716bc947 2026-03-18 14:46:26,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:46:26,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b817bb113612b7716bc947 HTTP/1.1" 200 None 2026-03-18 14:46:26,254 - lava_callback - DEBUG - Processing node 69b817bb113612b7716bc947: baseline-arm-baylibre 2026-03-18 14:46:26,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b817bb113612b7716bc947 2026-03-18 14:46:26,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:46:26,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b817bb113612b7716bc947 HTTP/1.1" 200 None 2026-03-18 14:46:26,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:46:26,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:46:26,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:46:26,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b817bb113612b7716bc947 HTTP/1.1" 200 None 2026-03-18 14:46:26,320 - lava_callback - ERROR - Error processing callback for node 69b817bb113612b7716bc947: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:47:06,076 - lava_callback - INFO - Received callback for node 69b817e5113612b7716bc953 INFO: 172.21.0.1:39390 - "POST /node/69b817e5113612b7716bc953 HTTP/1.0" 202 Accepted 2026-03-18 14:47:06,082 - lava_callback - INFO - Starting async job submit for node 69b817e5113612b7716bc953 2026-03-18 14:47:06,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:47:06,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b817e5113612b7716bc953 HTTP/1.1" 200 None 2026-03-18 14:47:06,098 - lava_callback - DEBUG - Processing node 69b817e5113612b7716bc953: baseline-arm-baylibre 2026-03-18 14:47:06,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b817e5113612b7716bc953 2026-03-18 14:47:06,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:47:06,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b817e5113612b7716bc953 HTTP/1.1" 200 None 2026-03-18 14:47:06,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:47:06,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:47:06,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:47:06,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b817e5113612b7716bc953 HTTP/1.1" 200 None 2026-03-18 14:47:06,164 - lava_callback - ERROR - Error processing callback for node 69b817e5113612b7716bc953: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33438 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:47:53,577 - lava_callback - INFO - Received callback for node 69b81812113612b7716bc964 INFO: 172.21.0.1:40766 - "POST /node/69b81812113612b7716bc964 HTTP/1.0" 202 Accepted 2026-03-18 14:47:53,582 - lava_callback - INFO - Starting async job submit for node 69b81812113612b7716bc964 2026-03-18 14:47:53,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:47:53,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81812113612b7716bc964 HTTP/1.1" 200 None 2026-03-18 14:47:53,597 - lava_callback - DEBUG - Processing node 69b81812113612b7716bc964: baseline-arm-clabbe 2026-03-18 14:47:53,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81812113612b7716bc964 2026-03-18 14:47:53,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:47:53,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81812113612b7716bc964 HTTP/1.1" 200 None 2026-03-18 14:47:53,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:47:53,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:47:53,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:47:53,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81812113612b7716bc964 HTTP/1.1" 200 None 2026-03-18 14:47:53,656 - lava_callback - ERROR - Error processing callback for node 69b81812113612b7716bc964: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43768 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:48:33,501 - lava_callback - INFO - Received callback for node 69b8183c113612b7716bc976 INFO: 172.21.0.1:37868 - "POST /node/69b8183c113612b7716bc976 HTTP/1.0" 202 Accepted 2026-03-18 14:48:33,506 - lava_callback - INFO - Starting async job submit for node 69b8183c113612b7716bc976 2026-03-18 14:48:33,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:48:33,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8183c113612b7716bc976 HTTP/1.1" 200 None 2026-03-18 14:48:33,525 - lava_callback - DEBUG - Processing node 69b8183c113612b7716bc976: baseline-arm-clabbe 2026-03-18 14:48:33,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8183c113612b7716bc976 2026-03-18 14:48:33,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:48:33,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8183c113612b7716bc976 HTTP/1.1" 200 None 2026-03-18 14:48:33,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:48:33,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:48:33,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:48:33,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8183c113612b7716bc976 HTTP/1.1" 200 None 2026-03-18 14:48:33,608 - lava_callback - ERROR - Error processing callback for node 69b8183c113612b7716bc976: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:49:33,652 - lava_callback - INFO - Received callback for node 69b81867113612b7716bc984 INFO: 172.21.0.1:37556 - "POST /node/69b81867113612b7716bc984 HTTP/1.0" 202 Accepted 2026-03-18 14:49:33,658 - lava_callback - INFO - Starting async job submit for node 69b81867113612b7716bc984 2026-03-18 14:49:33,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:49:33,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81867113612b7716bc984 HTTP/1.1" 200 None 2026-03-18 14:49:33,686 - lava_callback - DEBUG - Processing node 69b81867113612b7716bc984: baseline-arm-clabbe 2026-03-18 14:49:33,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81867113612b7716bc984 2026-03-18 14:49:33,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:49:33,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81867113612b7716bc984 HTTP/1.1" 200 None 2026-03-18 14:49:33,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:49:33,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:49:33,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:49:33,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81867113612b7716bc984 HTTP/1.1" 200 None 2026-03-18 14:49:33,769 - lava_callback - ERROR - Error processing callback for node 69b81867113612b7716bc984: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:50:06,244 - lava_callback - INFO - Received callback for node 69b8188e113612b7716bc995 INFO: 172.21.0.1:35382 - "POST /node/69b8188e113612b7716bc995 HTTP/1.0" 202 Accepted 2026-03-18 14:50:06,250 - lava_callback - INFO - Starting async job submit for node 69b8188e113612b7716bc995 2026-03-18 14:50:06,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:50:06,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8188e113612b7716bc995 HTTP/1.1" 200 None 2026-03-18 14:50:06,273 - lava_callback - DEBUG - Processing node 69b8188e113612b7716bc995: baseline-arm-baylibre 2026-03-18 14:50:06,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8188e113612b7716bc995 2026-03-18 14:50:06,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:50:06,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8188e113612b7716bc995 HTTP/1.1" 200 None 2026-03-18 14:50:06,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:50:06,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:50:06,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:50:06,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8188e113612b7716bc995 HTTP/1.1" 200 None 2026-03-18 14:50:06,328 - lava_callback - ERROR - Error processing callback for node 69b8188e113612b7716bc995: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:50:53,884 - lava_callback - INFO - Received callback for node 69b818bb113612b7716bc9a0 INFO: 172.21.0.1:52366 - "POST /node/69b818bb113612b7716bc9a0 HTTP/1.0" 202 Accepted 2026-03-18 14:50:53,890 - lava_callback - INFO - Starting async job submit for node 69b818bb113612b7716bc9a0 2026-03-18 14:50:53,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:50:53,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b818bb113612b7716bc9a0 HTTP/1.1" 200 None 2026-03-18 14:50:53,906 - lava_callback - DEBUG - Processing node 69b818bb113612b7716bc9a0: baseline-arm-clabbe 2026-03-18 14:50:53,907 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b818bb113612b7716bc9a0 2026-03-18 14:50:53,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:50:53,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b818bb113612b7716bc9a0 HTTP/1.1" 200 None 2026-03-18 14:50:53,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:50:53,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:50:53,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:50:53,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b818bb113612b7716bc9a0 HTTP/1.1" 200 None 2026-03-18 14:50:53,975 - lava_callback - ERROR - Error processing callback for node 69b818bb113612b7716bc9a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:51:33,877 - lava_callback - INFO - Received callback for node 69b818e5113612b7716bc9ab INFO: 172.21.0.1:40618 - "POST /node/69b818e5113612b7716bc9ab HTTP/1.0" 202 Accepted 2026-03-18 14:51:33,882 - lava_callback - INFO - Starting async job submit for node 69b818e5113612b7716bc9ab 2026-03-18 14:51:33,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:51:33,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b818e5113612b7716bc9ab HTTP/1.1" 200 None 2026-03-18 14:51:33,920 - lava_callback - DEBUG - Processing node 69b818e5113612b7716bc9ab: baseline-arm-clabbe 2026-03-18 14:51:33,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b818e5113612b7716bc9ab 2026-03-18 14:51:33,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:51:33,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b818e5113612b7716bc9ab HTTP/1.1" 200 None 2026-03-18 14:51:33,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:51:33,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:51:33,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:51:34,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b818e5113612b7716bc9ab HTTP/1.1" 200 None 2026-03-18 14:51:34,006 - lava_callback - ERROR - Error processing callback for node 69b818e5113612b7716bc9ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:52:14,674 - lava_callback - INFO - Received callback for node 69b81910113612b7716bc9b8 INFO: 172.21.0.1:56476 - "POST /node/69b81910113612b7716bc9b8 HTTP/1.0" 202 Accepted 2026-03-18 14:52:14,680 - lava_callback - INFO - Starting async job submit for node 69b81910113612b7716bc9b8 2026-03-18 14:52:14,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:52:14,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81910113612b7716bc9b8 HTTP/1.1" 200 None 2026-03-18 14:52:14,708 - lava_callback - DEBUG - Processing node 69b81910113612b7716bc9b8: baseline-arm-clabbe 2026-03-18 14:52:14,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81910113612b7716bc9b8 2026-03-18 14:52:14,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:52:14,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81910113612b7716bc9b8 HTTP/1.1" 200 None 2026-03-18 14:52:14,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:52:14,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:52:14,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:52:14,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81910113612b7716bc9b8 HTTP/1.1" 200 None 2026-03-18 14:52:14,768 - lava_callback - ERROR - Error processing callback for node 69b81910113612b7716bc9b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:52:53,967 - lava_callback - INFO - Received callback for node 69b8193c113612b7716bc9d6 INFO: 172.21.0.1:44148 - "POST /node/69b8193c113612b7716bc9d6 HTTP/1.0" 202 Accepted 2026-03-18 14:52:53,973 - lava_callback - INFO - Starting async job submit for node 69b8193c113612b7716bc9d6 2026-03-18 14:52:53,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:52:53,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8193c113612b7716bc9d6 HTTP/1.1" 200 None 2026-03-18 14:52:53,989 - lava_callback - DEBUG - Processing node 69b8193c113612b7716bc9d6: baseline-arm-clabbe 2026-03-18 14:52:53,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8193c113612b7716bc9d6 2026-03-18 14:52:53,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:52:54,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8193c113612b7716bc9d6 HTTP/1.1" 200 None 2026-03-18 14:52:54,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:52:54,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:52:54,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:52:54,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8193c113612b7716bc9d6 HTTP/1.1" 200 None 2026-03-18 14:52:54,052 - lava_callback - ERROR - Error processing callback for node 69b8193c113612b7716bc9d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44514 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:53:26,452 - lava_callback - INFO - Received callback for node 69b81963113612b7716bca4f INFO: 172.21.0.1:55442 - "POST /node/69b81963113612b7716bca4f HTTP/1.0" 202 Accepted 2026-03-18 14:53:26,458 - lava_callback - INFO - Starting async job submit for node 69b81963113612b7716bca4f 2026-03-18 14:53:26,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:26,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81963113612b7716bca4f HTTP/1.1" 200 None 2026-03-18 14:53:26,489 - lava_callback - DEBUG - Processing node 69b81963113612b7716bca4f: baseline-arm64-baylibre 2026-03-18 14:53:26,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81963113612b7716bca4f 2026-03-18 14:53:26,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:55446 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:53:26,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81963113612b7716bca4f HTTP/1.1" 200 None 2026-03-18 14:53:26,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:26,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:53:26,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:26,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81963113612b7716bca4f HTTP/1.1" 200 None 2026-03-18 14:53:26,555 - lava_callback - ERROR - Error processing callback for node 69b81963113612b7716bca4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 14:53:27,166 - lava_callback - INFO - Received callback for node 69b81964113612b7716bca6c INFO: 172.21.0.1:55454 - "POST /node/69b81964113612b7716bca6c HTTP/1.0" 202 Accepted 2026-03-18 14:53:27,172 - lava_callback - INFO - Starting async job submit for node 69b81964113612b7716bca6c 2026-03-18 14:53:27,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:27,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81964113612b7716bca6c HTTP/1.1" 200 None 2026-03-18 14:53:27,188 - lava_callback - DEBUG - Processing node 69b81964113612b7716bca6c: baseline-arm64-baylibre 2026-03-18 14:53:27,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81964113612b7716bca6c 2026-03-18 14:53:27,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:27,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81964113612b7716bca6c HTTP/1.1" 200 None 2026-03-18 14:53:27,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:27,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:53:27,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:27,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81964113612b7716bca6c HTTP/1.1" 200 None 2026-03-18 14:53:27,265 - lava_callback - ERROR - Error processing callback for node 69b81964113612b7716bca6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 14:53:34,644 - lava_callback - INFO - Received callback for node 69b81968113612b7716bca78 INFO: 172.21.0.1:35446 - "POST /node/69b81968113612b7716bca78 HTTP/1.0" 202 Accepted 2026-03-18 14:53:34,650 - lava_callback - INFO - Starting async job submit for node 69b81968113612b7716bca78 2026-03-18 14:53:34,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:34,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81968113612b7716bca78 HTTP/1.1" 200 None 2026-03-18 14:53:34,684 - lava_callback - DEBUG - Processing node 69b81968113612b7716bca78: baseline-arm-clabbe 2026-03-18 14:53:34,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81968113612b7716bca78 2026-03-18 14:53:34,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:34,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81968113612b7716bca78 HTTP/1.1" 200 None 2026-03-18 14:53:34,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:34,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:53:34,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:34,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81968113612b7716bca78 HTTP/1.1" 200 None 2026-03-18 14:53:34,743 - lava_callback - ERROR - Error processing callback for node 69b81968113612b7716bca78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35460 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:53:46,402 - lava_callback - INFO - Received callback for node 69b81966113612b7716bca6f INFO: 172.21.0.1:36510 - "POST /node/69b81966113612b7716bca6f HTTP/1.0" 202 Accepted 2026-03-18 14:53:46,407 - lava_callback - INFO - Starting async job submit for node 69b81966113612b7716bca6f 2026-03-18 14:53:46,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:46,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81966113612b7716bca6f HTTP/1.1" 200 None 2026-03-18 14:53:46,424 - lava_callback - DEBUG - Processing node 69b81966113612b7716bca6f: baseline-arm64-baylibre 2026-03-18 14:53:46,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81966113612b7716bca6f 2026-03-18 14:53:46,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:46,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81966113612b7716bca6f HTTP/1.1" 200 None 2026-03-18 14:53:46,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:46,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:53:46,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:46,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81966113612b7716bca6f HTTP/1.1" 200 None 2026-03-18 14:53:46,480 - lava_callback - ERROR - Error processing callback for node 69b81966113612b7716bca6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:53:47,075 - lava_callback - INFO - Received callback for node 69b81968113612b7716bca76 INFO: 172.21.0.1:36528 - "POST /node/69b81968113612b7716bca76 HTTP/1.0" 202 Accepted 2026-03-18 14:53:47,081 - lava_callback - INFO - Starting async job submit for node 69b81968113612b7716bca76 2026-03-18 14:53:47,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:47,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81968113612b7716bca76 HTTP/1.1" 200 None 2026-03-18 14:53:47,102 - lava_callback - DEBUG - Processing node 69b81968113612b7716bca76: baseline-arm64-baylibre 2026-03-18 14:53:47,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81968113612b7716bca76 2026-03-18 14:53:47,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:47,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81968113612b7716bca76 HTTP/1.1" 200 None 2026-03-18 14:53:47,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:47,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:53:47,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:47,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81968113612b7716bca76 HTTP/1.1" 200 None 2026-03-18 14:53:47,155 - lava_callback - ERROR - Error processing callback for node 69b81968113612b7716bca76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 14:53:47,757 - lava_callback - INFO - Received callback for node 69b8196a113612b7716bca7b INFO: 172.21.0.1:36542 - "POST /node/69b8196a113612b7716bca7b HTTP/1.0" 202 Accepted 2026-03-18 14:53:47,762 - lava_callback - INFO - Starting async job submit for node 69b8196a113612b7716bca7b 2026-03-18 14:53:47,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:47,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8196a113612b7716bca7b HTTP/1.1" 200 None 2026-03-18 14:53:47,778 - lava_callback - DEBUG - Processing node 69b8196a113612b7716bca7b: baseline-arm64-baylibre 2026-03-18 14:53:47,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8196a113612b7716bca7b 2026-03-18 14:53:47,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:47,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8196a113612b7716bca7b HTTP/1.1" 200 None 2026-03-18 14:53:47,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:47,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:53:47,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:47,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8196a113612b7716bca7b HTTP/1.1" 200 None 2026-03-18 14:53:47,843 - lava_callback - ERROR - Error processing callback for node 69b8196a113612b7716bca7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 14:53:48,438 - lava_callback - INFO - Received callback for node 69b8196b113612b7716bca7f INFO: 172.21.0.1:36544 - "POST /node/69b8196b113612b7716bca7f HTTP/1.0" 202 Accepted 2026-03-18 14:53:48,444 - lava_callback - INFO - Starting async job submit for node 69b8196b113612b7716bca7f 2026-03-18 14:53:48,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:48,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8196b113612b7716bca7f HTTP/1.1" 200 None 2026-03-18 14:53:48,460 - lava_callback - DEBUG - Processing node 69b8196b113612b7716bca7f: baseline-arm64-baylibre 2026-03-18 14:53:48,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8196b113612b7716bca7f 2026-03-18 14:53:48,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:48,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8196b113612b7716bca7f HTTP/1.1" 200 None 2026-03-18 14:53:48,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:48,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:53:48,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:48,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8196b113612b7716bca7f HTTP/1.1" 200 None 2026-03-18 14:53:48,511 - lava_callback - ERROR - Error processing callback for node 69b8196b113612b7716bca7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 14:53:54,630 - lava_callback - INFO - Received callback for node 69b8197b113612b7716bcaa9 INFO: 172.21.0.1:50664 - "POST /node/69b8197b113612b7716bcaa9 HTTP/1.0" 202 Accepted 2026-03-18 14:53:54,636 - lava_callback - INFO - Starting async job submit for node 69b8197b113612b7716bcaa9 2026-03-18 14:53:54,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:54,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8197b113612b7716bcaa9 HTTP/1.1" 200 None 2026-03-18 14:53:54,653 - lava_callback - DEBUG - Processing node 69b8197b113612b7716bcaa9: baseline-arm64-clabbe 2026-03-18 14:53:54,654 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8197b113612b7716bcaa9 2026-03-18 14:53:54,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:54,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8197b113612b7716bcaa9 HTTP/1.1" 200 None 2026-03-18 14:53:54,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:54,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:53:54,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:54,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8197b113612b7716bcaa9 HTTP/1.1" 200 None 2026-03-18 14:53:54,724 - lava_callback - ERROR - Error processing callback for node 69b8197b113612b7716bcaa9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 14:53:55,580 - lava_callback - INFO - Received callback for node 69b8197d113612b7716bcaac INFO: 172.21.0.1:50670 - "POST /node/69b8197d113612b7716bcaac HTTP/1.0" 202 Accepted 2026-03-18 14:53:55,586 - lava_callback - INFO - Starting async job submit for node 69b8197d113612b7716bcaac 2026-03-18 14:53:55,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:55,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8197d113612b7716bcaac HTTP/1.1" 200 None 2026-03-18 14:53:55,603 - lava_callback - DEBUG - Processing node 69b8197d113612b7716bcaac: baseline-arm64-clabbe 2026-03-18 14:53:55,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8197d113612b7716bcaac 2026-03-18 14:53:55,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:55,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8197d113612b7716bcaac HTTP/1.1" 200 None 2026-03-18 14:53:55,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:55,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:53:55,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:55,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8197d113612b7716bcaac HTTP/1.1" 200 None 2026-03-18 14:53:55,660 - lava_callback - ERROR - Error processing callback for node 69b8197d113612b7716bcaac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 14:53:56,523 - lava_callback - INFO - Received callback for node 69b8197e113612b7716bcab3 INFO: 172.21.0.1:50676 - "POST /node/69b8197e113612b7716bcab3 HTTP/1.0" 202 Accepted 2026-03-18 14:53:56,529 - lava_callback - INFO - Starting async job submit for node 69b8197e113612b7716bcab3 2026-03-18 14:53:56,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:50686 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:53:56,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8197e113612b7716bcab3 HTTP/1.1" 200 None 2026-03-18 14:53:56,546 - lava_callback - DEBUG - Processing node 69b8197e113612b7716bcab3: baseline-arm64-clabbe 2026-03-18 14:53:56,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8197e113612b7716bcab3 2026-03-18 14:53:56,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:56,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8197e113612b7716bcab3 HTTP/1.1" 200 None 2026-03-18 14:53:56,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:56,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:53:56,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:56,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8197e113612b7716bcab3 HTTP/1.1" 200 None 2026-03-18 14:53:56,600 - lava_callback - ERROR - Error processing callback for node 69b8197e113612b7716bcab3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-18 14:53:57,456 - lava_callback - INFO - Received callback for node 69b8197f113612b7716bcab6 INFO: 172.21.0.1:50696 - "POST /node/69b8197f113612b7716bcab6 HTTP/1.0" 202 Accepted 2026-03-18 14:53:57,461 - lava_callback - INFO - Starting async job submit for node 69b8197f113612b7716bcab6 2026-03-18 14:53:57,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:57,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8197f113612b7716bcab6 HTTP/1.1" 200 None 2026-03-18 14:53:57,477 - lava_callback - DEBUG - Processing node 69b8197f113612b7716bcab6: baseline-arm64-clabbe 2026-03-18 14:53:57,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8197f113612b7716bcab6 2026-03-18 14:53:57,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:57,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8197f113612b7716bcab6 HTTP/1.1" 200 None 2026-03-18 14:53:57,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:57,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:53:57,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:53:57,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8197f113612b7716bcab6 HTTP/1.1" 200 None 2026-03-18 14:53:57,535 - lava_callback - ERROR - Error processing callback for node 69b8197f113612b7716bcab6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:54:14,648 - lava_callback - INFO - Received callback for node 69b81981113612b7716bcada INFO: 172.21.0.1:48076 - "POST /node/69b81981113612b7716bcada HTTP/1.0" 202 Accepted 2026-03-18 14:54:14,654 - lava_callback - INFO - Starting async job submit for node 69b81981113612b7716bcada 2026-03-18 14:54:14,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:14,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81981113612b7716bcada HTTP/1.1" 200 None 2026-03-18 14:54:14,671 - lava_callback - DEBUG - Processing node 69b81981113612b7716bcada: baseline-arm64-clabbe 2026-03-18 14:54:14,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81981113612b7716bcada 2026-03-18 14:54:14,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:14,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81981113612b7716bcada HTTP/1.1" 200 None 2026-03-18 14:54:14,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:14,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:54:14,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:14,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81981113612b7716bcada HTTP/1.1" 200 None 2026-03-18 14:54:14,730 - lava_callback - ERROR - Error processing callback for node 69b81981113612b7716bcada: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48088 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 14:54:15,584 - lava_callback - INFO - Received callback for node 69b81981113612b7716bcabc INFO: 172.21.0.1:48104 - "POST /node/69b81981113612b7716bcabc HTTP/1.0" 202 Accepted 2026-03-18 14:54:15,589 - lava_callback - INFO - Starting async job submit for node 69b81981113612b7716bcabc 2026-03-18 14:54:15,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:15,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81981113612b7716bcabc HTTP/1.1" 200 None 2026-03-18 14:54:15,605 - lava_callback - DEBUG - Processing node 69b81981113612b7716bcabc: baseline-arm64-clabbe 2026-03-18 14:54:15,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81981113612b7716bcabc 2026-03-18 14:54:15,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:15,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81981113612b7716bcabc HTTP/1.1" 200 None 2026-03-18 14:54:15,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:15,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-18 14:54:15,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:15,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81981113612b7716bcabc HTTP/1.1" 200 None 2026-03-18 14:54:15,684 - lava_callback - ERROR - Error processing callback for node 69b81981113612b7716bcabc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59858 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:54:34,061 - lava_callback - INFO - Received callback for node 69b81994113612b7716bcaf0 INFO: 172.21.0.1:41532 - "POST /node/69b81994113612b7716bcaf0 HTTP/1.0" 202 Accepted 2026-03-18 14:54:34,066 - lava_callback - INFO - Starting async job submit for node 69b81994113612b7716bcaf0 2026-03-18 14:54:34,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:34,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81994113612b7716bcaf0 HTTP/1.1" 200 None 2026-03-18 14:54:34,092 - lava_callback - DEBUG - Processing node 69b81994113612b7716bcaf0: baseline-arm-clabbe 2026-03-18 14:54:34,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81994113612b7716bcaf0 2026-03-18 14:54:34,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:34,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81994113612b7716bcaf0 HTTP/1.1" 200 None 2026-03-18 14:54:34,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:34,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:54:34,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:54:34,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81994113612b7716bcaf0 HTTP/1.1" 200 None 2026-03-18 14:54:34,148 - lava_callback - ERROR - Error processing callback for node 69b81994113612b7716bcaf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49022 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:55:14,087 - lava_callback - INFO - Received callback for node 69b819c3113612b7716bcb1b INFO: 172.21.0.1:49036 - "POST /node/69b819c3113612b7716bcb1b HTTP/1.0" 202 Accepted 2026-03-18 14:55:14,093 - lava_callback - INFO - Starting async job submit for node 69b819c3113612b7716bcb1b 2026-03-18 14:55:14,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:55:14,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b819c3113612b7716bcb1b HTTP/1.1" 200 None 2026-03-18 14:55:14,109 - lava_callback - DEBUG - Processing node 69b819c3113612b7716bcb1b: baseline-arm-clabbe 2026-03-18 14:55:14,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b819c3113612b7716bcb1b 2026-03-18 14:55:14,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:55:14,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b819c3113612b7716bcb1b HTTP/1.1" 200 None 2026-03-18 14:55:14,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:55:14,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:55:14,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:55:14,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b819c3113612b7716bcb1b HTTP/1.1" 200 None 2026-03-18 14:55:14,167 - lava_callback - ERROR - Error processing callback for node 69b819c3113612b7716bcb1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:55:53,932 - lava_callback - INFO - Received callback for node 69b819ef113612b7716bcb52 INFO: 172.21.0.1:57890 - "POST /node/69b819ef113612b7716bcb52 HTTP/1.0" 202 Accepted 2026-03-18 14:55:53,937 - lava_callback - INFO - Starting async job submit for node 69b819ef113612b7716bcb52 2026-03-18 14:55:53,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:55:53,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b819ef113612b7716bcb52 HTTP/1.1" 200 None 2026-03-18 14:55:53,957 - lava_callback - DEBUG - Processing node 69b819ef113612b7716bcb52: baseline-arm-clabbe 2026-03-18 14:55:53,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b819ef113612b7716bcb52 2026-03-18 14:55:53,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:55:53,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b819ef113612b7716bcb52 HTTP/1.1" 200 None 2026-03-18 14:55:53,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:55:53,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:55:53,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:55:54,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b819ef113612b7716bcb52 HTTP/1.1" 200 None 2026-03-18 14:55:54,035 - lava_callback - ERROR - Error processing callback for node 69b819ef113612b7716bcb52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:56:33,994 - lava_callback - INFO - Received callback for node 69b81a1a113612b7716bcb6e INFO: 172.21.0.1:33356 - "POST /node/69b81a1a113612b7716bcb6e HTTP/1.0" 202 Accepted 2026-03-18 14:56:33,999 - lava_callback - INFO - Starting async job submit for node 69b81a1a113612b7716bcb6e 2026-03-18 14:56:34,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:56:34,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81a1a113612b7716bcb6e HTTP/1.1" 200 None 2026-03-18 14:56:34,017 - lava_callback - DEBUG - Processing node 69b81a1a113612b7716bcb6e: baseline-arm-clabbe 2026-03-18 14:56:34,017 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81a1a113612b7716bcb6e 2026-03-18 14:56:34,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:56:34,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81a1a113612b7716bcb6e HTTP/1.1" 200 None 2026-03-18 14:56:34,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:56:34,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:56:34,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:56:34,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81a1a113612b7716bcb6e HTTP/1.1" 200 None 2026-03-18 14:56:34,100 - lava_callback - ERROR - Error processing callback for node 69b81a1a113612b7716bcb6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:57:14,049 - lava_callback - INFO - Received callback for node 69b81a45113612b7716bcb78 INFO: 172.21.0.1:50812 - "POST /node/69b81a45113612b7716bcb78 HTTP/1.0" 202 Accepted 2026-03-18 14:57:14,055 - lava_callback - INFO - Starting async job submit for node 69b81a45113612b7716bcb78 2026-03-18 14:57:14,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:57:14,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81a45113612b7716bcb78 HTTP/1.1" 200 None 2026-03-18 14:57:14,071 - lava_callback - DEBUG - Processing node 69b81a45113612b7716bcb78: baseline-arm-clabbe 2026-03-18 14:57:14,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81a45113612b7716bcb78 2026-03-18 14:57:14,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:57:14,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81a45113612b7716bcb78 HTTP/1.1" 200 None 2026-03-18 14:57:14,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:57:14,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:57:14,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:57:14,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81a45113612b7716bcb78 HTTP/1.1" 200 None 2026-03-18 14:57:14,129 - lava_callback - ERROR - Error processing callback for node 69b81a45113612b7716bcb78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:57:54,019 - lava_callback - INFO - Received callback for node 69b81a70113612b7716bcb87 INFO: 172.21.0.1:49070 - "POST /node/69b81a70113612b7716bcb87 HTTP/1.0" 202 Accepted 2026-03-18 14:57:54,026 - lava_callback - INFO - Starting async job submit for node 69b81a70113612b7716bcb87 2026-03-18 14:57:54,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:57:54,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81a70113612b7716bcb87 HTTP/1.1" 200 None 2026-03-18 14:57:54,041 - lava_callback - DEBUG - Processing node 69b81a70113612b7716bcb87: baseline-arm-clabbe 2026-03-18 14:57:54,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81a70113612b7716bcb87 2026-03-18 14:57:54,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:57:54,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81a70113612b7716bcb87 HTTP/1.1" 200 None 2026-03-18 14:57:54,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:57:54,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:57:54,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:57:54,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81a70113612b7716bcb87 HTTP/1.1" 200 None 2026-03-18 14:57:54,105 - lava_callback - ERROR - Error processing callback for node 69b81a70113612b7716bcb87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34350 - "GET / HTTP/1.0" 200 OK 2026-03-18 14:58:54,191 - lava_callback - INFO - Received callback for node 69b81a9c113612b7716bcb96 INFO: 172.21.0.1:52386 - "POST /node/69b81a9c113612b7716bcb96 HTTP/1.0" 202 Accepted 2026-03-18 14:58:54,196 - lava_callback - INFO - Starting async job submit for node 69b81a9c113612b7716bcb96 2026-03-18 14:58:54,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:58:54,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81a9c113612b7716bcb96 HTTP/1.1" 200 None 2026-03-18 14:58:54,213 - lava_callback - DEBUG - Processing node 69b81a9c113612b7716bcb96: baseline-arm-clabbe 2026-03-18 14:58:54,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b81a9c113612b7716bcb96 2026-03-18 14:58:54,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:58:54,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b81a9c113612b7716bcb96 HTTP/1.1" 200 None 2026-03-18 14:58:54,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:58:54,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-18 14:58:54,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 14:58:54,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b81a9c113612b7716bcb96 HTTP/1.1" 200 None 2026-03-18 14:58:54,285 - lava_callback - ERROR - Error processing callback for node 69b81a9c113612b7716bcb96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46798 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:22:08,321 - lava_callback - INFO - Received callback for node 69b82011113612b7716bccd1 INFO: 172.21.0.1:46804 - "POST /node/69b82011113612b7716bccd1 HTTP/1.0" 202 Accepted 2026-03-18 15:22:08,326 - lava_callback - INFO - Starting async job submit for node 69b82011113612b7716bccd1 2026-03-18 15:22:08,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:22:08,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82011113612b7716bccd1 HTTP/1.1" 200 None 2026-03-18 15:22:08,345 - lava_callback - DEBUG - Processing node 69b82011113612b7716bccd1: baseline-arm64-baylibre 2026-03-18 15:22:08,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82011113612b7716bccd1 2026-03-18 15:22:08,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:22:08,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82011113612b7716bccd1 HTTP/1.1" 200 None 2026-03-18 15:22:08,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:22:08,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:22:08,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:22:08,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82011113612b7716bccd1 HTTP/1.1" 200 None 2026-03-18 15:22:08,423 - lava_callback - ERROR - Error processing callback for node 69b82011113612b7716bccd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58590 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:23:28,109 - lava_callback - INFO - Received callback for node 69b82063113612b7716bccde INFO: 172.21.0.1:58592 - "POST /node/69b82063113612b7716bccde HTTP/1.0" 202 Accepted 2026-03-18 15:23:28,114 - lava_callback - INFO - Starting async job submit for node 69b82063113612b7716bccde 2026-03-18 15:23:28,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:23:28,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82063113612b7716bccde HTTP/1.1" 200 None 2026-03-18 15:23:28,139 - lava_callback - DEBUG - Processing node 69b82063113612b7716bccde: baseline-arm64-baylibre 2026-03-18 15:23:28,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82063113612b7716bccde 2026-03-18 15:23:28,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:23:28,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82063113612b7716bccde HTTP/1.1" 200 None 2026-03-18 15:23:28,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:23:28,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:23:28,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:23:28,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82063113612b7716bccde HTTP/1.1" 200 None 2026-03-18 15:23:28,199 - lava_callback - ERROR - Error processing callback for node 69b82063113612b7716bccde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58182 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:24:48,169 - lava_callback - INFO - Received callback for node 69b820b5113612b7716bcceb INFO: 172.21.0.1:58192 - "POST /node/69b820b5113612b7716bcceb HTTP/1.0" 202 Accepted 2026-03-18 15:24:48,175 - lava_callback - INFO - Starting async job submit for node 69b820b5113612b7716bcceb 2026-03-18 15:24:48,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:24:48,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b820b5113612b7716bcceb HTTP/1.1" 200 None 2026-03-18 15:24:48,191 - lava_callback - DEBUG - Processing node 69b820b5113612b7716bcceb: baseline-arm64-baylibre 2026-03-18 15:24:48,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b820b5113612b7716bcceb 2026-03-18 15:24:48,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:24:48,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b820b5113612b7716bcceb HTTP/1.1" 200 None 2026-03-18 15:24:48,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:24:48,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:24:48,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:24:48,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b820b5113612b7716bcceb HTTP/1.1" 200 None 2026-03-18 15:24:48,261 - lava_callback - ERROR - Error processing callback for node 69b820b5113612b7716bcceb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48636 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:26:08,296 - lava_callback - INFO - Received callback for node 69b82107113612b7716bccf9 INFO: 172.21.0.1:48644 - "POST /node/69b82107113612b7716bccf9 HTTP/1.0" 202 Accepted 2026-03-18 15:26:08,302 - lava_callback - INFO - Starting async job submit for node 69b82107113612b7716bccf9 2026-03-18 15:26:08,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:26:08,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82107113612b7716bccf9 HTTP/1.1" 200 None 2026-03-18 15:26:08,318 - lava_callback - DEBUG - Processing node 69b82107113612b7716bccf9: baseline-arm64-baylibre 2026-03-18 15:26:08,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82107113612b7716bccf9 2026-03-18 15:26:08,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:26:08,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82107113612b7716bccf9 HTTP/1.1" 200 None 2026-03-18 15:26:08,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:26:08,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:26:08,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:26:08,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82107113612b7716bccf9 HTTP/1.1" 200 None 2026-03-18 15:26:08,397 - lava_callback - ERROR - Error processing callback for node 69b82107113612b7716bccf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:27:28,709 - lava_callback - INFO - Received callback for node 69b82159113612b7716bcd08 INFO: 172.21.0.1:58282 - "POST /node/69b82159113612b7716bcd08 HTTP/1.0" 202 Accepted 2026-03-18 15:27:28,714 - lava_callback - INFO - Starting async job submit for node 69b82159113612b7716bcd08 2026-03-18 15:27:28,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:27:28,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82159113612b7716bcd08 HTTP/1.1" 200 None 2026-03-18 15:27:28,730 - lava_callback - DEBUG - Processing node 69b82159113612b7716bcd08: baseline-arm64-baylibre 2026-03-18 15:27:28,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82159113612b7716bcd08 2026-03-18 15:27:28,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:27:28,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82159113612b7716bcd08 HTTP/1.1" 200 None 2026-03-18 15:27:28,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:27:28,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:27:28,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:27:28,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82159113612b7716bcd08 HTTP/1.1" 200 None 2026-03-18 15:27:28,797 - lava_callback - ERROR - Error processing callback for node 69b82159113612b7716bcd08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:28:55,549 - lava_callback - INFO - Received callback for node 69b821b2113612b7716bcd16 INFO: 172.21.0.1:41756 - "POST /node/69b821b2113612b7716bcd16 HTTP/1.0" 202 Accepted 2026-03-18 15:28:55,555 - lava_callback - INFO - Starting async job submit for node 69b821b2113612b7716bcd16 2026-03-18 15:28:55,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:28:55,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b821b2113612b7716bcd16 HTTP/1.1" 200 None 2026-03-18 15:28:55,583 - lava_callback - DEBUG - Processing node 69b821b2113612b7716bcd16: baseline-arm64-clabbe 2026-03-18 15:28:55,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b821b2113612b7716bcd16 2026-03-18 15:28:55,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:28:55,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b821b2113612b7716bcd16 HTTP/1.1" 200 None 2026-03-18 15:28:55,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:28:55,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:28:55,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:28:55,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b821b2113612b7716bcd16 HTTP/1.1" 200 None 2026-03-18 15:28:55,659 - lava_callback - ERROR - Error processing callback for node 69b821b2113612b7716bcd16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 15:30:15,480 - lava_callback - INFO - Received callback for node 69b82202113612b7716bcd25 INFO: 172.21.0.1:41894 - "POST /node/69b82202113612b7716bcd25 HTTP/1.0" 202 Accepted 2026-03-18 15:30:15,485 - lava_callback - INFO - Starting async job submit for node 69b82202113612b7716bcd25 2026-03-18 15:30:15,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:30:15,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82202113612b7716bcd25 HTTP/1.1" 200 None 2026-03-18 15:30:15,503 - lava_callback - DEBUG - Processing node 69b82202113612b7716bcd25: baseline-arm64-clabbe 2026-03-18 15:30:15,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82202113612b7716bcd25 2026-03-18 15:30:15,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:30:15,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82202113612b7716bcd25 HTTP/1.1" 200 None 2026-03-18 15:30:15,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:30:15,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:30:15,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:30:15,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82202113612b7716bcd25 HTTP/1.1" 200 None 2026-03-18 15:30:15,563 - lava_callback - ERROR - Error processing callback for node 69b82202113612b7716bcd25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:31:55,549 - lava_callback - INFO - Received callback for node 69b82255113612b7716bcd37 INFO: 172.21.0.1:58490 - "POST /node/69b82255113612b7716bcd37 HTTP/1.0" 202 Accepted 2026-03-18 15:31:55,554 - lava_callback - INFO - Starting async job submit for node 69b82255113612b7716bcd37 2026-03-18 15:31:55,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:31:55,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82255113612b7716bcd37 HTTP/1.1" 200 None 2026-03-18 15:31:55,571 - lava_callback - DEBUG - Processing node 69b82255113612b7716bcd37: baseline-arm64-clabbe 2026-03-18 15:31:55,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82255113612b7716bcd37 2026-03-18 15:31:55,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:31:55,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82255113612b7716bcd37 HTTP/1.1" 200 None 2026-03-18 15:31:55,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:31:55,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:31:55,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:31:55,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82255113612b7716bcd37 HTTP/1.1" 200 None 2026-03-18 15:31:55,647 - lava_callback - ERROR - Error processing callback for node 69b82255113612b7716bcd37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:52552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:34:35,744 - lava_callback - INFO - Received callback for node 69b822f6113612b7716bcd4f INFO: 172.21.0.1:39158 - "POST /node/69b822f6113612b7716bcd4f HTTP/1.0" 202 Accepted 2026-03-18 15:34:35,749 - lava_callback - INFO - Starting async job submit for node 69b822f6113612b7716bcd4f 2026-03-18 15:34:35,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:34:35,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b822f6113612b7716bcd4f HTTP/1.1" 200 None 2026-03-18 15:34:35,774 - lava_callback - DEBUG - Processing node 69b822f6113612b7716bcd4f: baseline-arm64-clabbe 2026-03-18 15:34:35,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b822f6113612b7716bcd4f 2026-03-18 15:34:35,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:34:35,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b822f6113612b7716bcd4f HTTP/1.1" 200 None 2026-03-18 15:34:35,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:34:35,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:34:35,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:34:35,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b822f6113612b7716bcd4f HTTP/1.1" 200 None 2026-03-18 15:34:35,847 - lava_callback - ERROR - Error processing callback for node 69b822f6113612b7716bcd4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56604 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:35:55,817 - lava_callback - INFO - Received callback for node 69b82348113612b7716bcd61 INFO: 172.21.0.1:35226 - "POST /node/69b82348113612b7716bcd61 HTTP/1.0" 202 Accepted 2026-03-18 15:35:55,822 - lava_callback - INFO - Starting async job submit for node 69b82348113612b7716bcd61 2026-03-18 15:35:55,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:35:55,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82348113612b7716bcd61 HTTP/1.1" 200 None 2026-03-18 15:35:55,845 - lava_callback - DEBUG - Processing node 69b82348113612b7716bcd61: baseline-arm64-clabbe 2026-03-18 15:35:55,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82348113612b7716bcd61 2026-03-18 15:35:55,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:35:55,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82348113612b7716bcd61 HTTP/1.1" 200 None 2026-03-18 15:35:55,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:35:55,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:35:55,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:35:55,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82348113612b7716bcd61 HTTP/1.1" 200 None 2026-03-18 15:35:55,909 - lava_callback - ERROR - Error processing callback for node 69b82348113612b7716bcd61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-18 15:37:15,841 - lava_callback - INFO - Received callback for node 69b82399113612b7716bcd6f INFO: 172.21.0.1:38452 - "POST /node/69b82399113612b7716bcd6f HTTP/1.0" 202 Accepted 2026-03-18 15:37:15,846 - lava_callback - INFO - Starting async job submit for node 69b82399113612b7716bcd6f 2026-03-18 15:37:15,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:37:15,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82399113612b7716bcd6f HTTP/1.1" 200 None 2026-03-18 15:37:15,871 - lava_callback - DEBUG - Processing node 69b82399113612b7716bcd6f: baseline-arm64-clabbe 2026-03-18 15:37:15,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82399113612b7716bcd6f 2026-03-18 15:37:15,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:37:15,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82399113612b7716bcd6f HTTP/1.1" 200 None 2026-03-18 15:37:15,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:37:15,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:37:15,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:37:15,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82399113612b7716bcd6f HTTP/1.1" 200 None 2026-03-18 15:37:15,927 - lava_callback - ERROR - Error processing callback for node 69b82399113612b7716bcd6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:38:28,901 - lava_callback - INFO - Received callback for node 69b823e3113612b7716bcd7d INFO: 172.21.0.1:56904 - "POST /node/69b823e3113612b7716bcd7d HTTP/1.0" 202 Accepted 2026-03-18 15:38:28,907 - lava_callback - INFO - Starting async job submit for node 69b823e3113612b7716bcd7d 2026-03-18 15:38:28,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:38:28,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b823e3113612b7716bcd7d HTTP/1.1" 200 None 2026-03-18 15:38:28,926 - lava_callback - DEBUG - Processing node 69b823e3113612b7716bcd7d: baseline-arm64-baylibre 2026-03-18 15:38:28,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b823e3113612b7716bcd7d 2026-03-18 15:38:28,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:38:28,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b823e3113612b7716bcd7d HTTP/1.1" 200 None 2026-03-18 15:38:28,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:38:28,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:38:28,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:38:28,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b823e3113612b7716bcd7d HTTP/1.1" 200 None 2026-03-18 15:38:28,988 - lava_callback - ERROR - Error processing callback for node 69b823e3113612b7716bcd7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:39:28,854 - lava_callback - INFO - Received callback for node 69b8242e113612b7716bcd8b INFO: 172.21.0.1:47596 - "POST /node/69b8242e113612b7716bcd8b HTTP/1.0" 202 Accepted 2026-03-18 15:39:28,859 - lava_callback - INFO - Starting async job submit for node 69b8242e113612b7716bcd8b 2026-03-18 15:39:28,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:39:28,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8242e113612b7716bcd8b HTTP/1.1" 200 None 2026-03-18 15:39:28,877 - lava_callback - DEBUG - Processing node 69b8242e113612b7716bcd8b: baseline-arm64-baylibre 2026-03-18 15:39:28,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8242e113612b7716bcd8b 2026-03-18 15:39:28,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:39:28,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8242e113612b7716bcd8b HTTP/1.1" 200 None 2026-03-18 15:39:28,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:39:28,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:39:28,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:39:28,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8242e113612b7716bcd8b HTTP/1.1" 200 None 2026-03-18 15:39:28,943 - lava_callback - ERROR - Error processing callback for node 69b8242e113612b7716bcd8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:41:08,990 - lava_callback - INFO - Received callback for node 69b8247f113612b7716bcd99 INFO: 172.21.0.1:34434 - "POST /node/69b8247f113612b7716bcd99 HTTP/1.0" 202 Accepted 2026-03-18 15:41:08,995 - lava_callback - INFO - Starting async job submit for node 69b8247f113612b7716bcd99 2026-03-18 15:41:08,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:41:09,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8247f113612b7716bcd99 HTTP/1.1" 200 None 2026-03-18 15:41:09,019 - lava_callback - DEBUG - Processing node 69b8247f113612b7716bcd99: baseline-arm64-baylibre 2026-03-18 15:41:09,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8247f113612b7716bcd99 2026-03-18 15:41:09,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:41:09,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8247f113612b7716bcd99 HTTP/1.1" 200 None 2026-03-18 15:41:09,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:41:09,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:41:09,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:41:09,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8247f113612b7716bcd99 HTTP/1.1" 200 None 2026-03-18 15:41:09,076 - lava_callback - ERROR - Error processing callback for node 69b8247f113612b7716bcd99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45194 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:43:56,101 - lava_callback - INFO - Received callback for node 69b82528113612b7716bcdbb INFO: 172.21.0.1:55476 - "POST /node/69b82528113612b7716bcdbb HTTP/1.0" 202 Accepted 2026-03-18 15:43:56,107 - lava_callback - INFO - Starting async job submit for node 69b82528113612b7716bcdbb 2026-03-18 15:43:56,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:43:56,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82528113612b7716bcdbb HTTP/1.1" 200 None 2026-03-18 15:43:56,123 - lava_callback - DEBUG - Processing node 69b82528113612b7716bcdbb: baseline-arm64-clabbe 2026-03-18 15:43:56,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82528113612b7716bcdbb 2026-03-18 15:43:56,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:43:56,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82528113612b7716bcdbb HTTP/1.1" 200 None 2026-03-18 15:43:56,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:43:56,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:43:56,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:43:56,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82528113612b7716bcdbb HTTP/1.1" 200 None 2026-03-18 15:43:56,181 - lava_callback - ERROR - Error processing callback for node 69b82528113612b7716bcdbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:46:36,205 - lava_callback - INFO - Received callback for node 69b825ca113612b7716bcdd7 INFO: 172.21.0.1:47072 - "POST /node/69b825ca113612b7716bcdd7 HTTP/1.0" 202 Accepted 2026-03-18 15:46:36,210 - lava_callback - INFO - Starting async job submit for node 69b825ca113612b7716bcdd7 2026-03-18 15:46:36,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:46:36,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b825ca113612b7716bcdd7 HTTP/1.1" 200 None 2026-03-18 15:46:36,227 - lava_callback - DEBUG - Processing node 69b825ca113612b7716bcdd7: baseline-arm64-clabbe 2026-03-18 15:46:36,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b825ca113612b7716bcdd7 2026-03-18 15:46:36,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:46:36,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b825ca113612b7716bcdd7 HTTP/1.1" 200 None 2026-03-18 15:46:36,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:46:36,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:46:36,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:46:36,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b825ca113612b7716bcdd7 HTTP/1.1" 200 None 2026-03-18 15:46:36,335 - lava_callback - ERROR - Error processing callback for node 69b825ca113612b7716bcdd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:48:36,344 - lava_callback - INFO - Received callback for node 69b82650113612b7716bcdec INFO: 172.21.0.1:53758 - "POST /node/69b82650113612b7716bcdec HTTP/1.0" 202 Accepted 2026-03-18 15:48:36,350 - lava_callback - INFO - Starting async job submit for node 69b82650113612b7716bcdec 2026-03-18 15:48:36,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:48:36,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82650113612b7716bcdec HTTP/1.1" 200 None 2026-03-18 15:48:36,396 - lava_callback - DEBUG - Processing node 69b82650113612b7716bcdec: baseline-arm64-clabbe 2026-03-18 15:48:36,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82650113612b7716bcdec 2026-03-18 15:48:36,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:48:36,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82650113612b7716bcdec HTTP/1.1" 200 None 2026-03-18 15:48:36,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:48:36,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:48:36,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:48:36,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82650113612b7716bcdec HTTP/1.1" 200 None 2026-03-18 15:48:36,465 - lava_callback - ERROR - Error processing callback for node 69b82650113612b7716bcdec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:51:36,428 - lava_callback - INFO - Received callback for node 69b826fe113612b7716bce11 INFO: 172.21.0.1:40012 - "POST /node/69b826fe113612b7716bce11 HTTP/1.0" 202 Accepted 2026-03-18 15:51:36,434 - lava_callback - INFO - Starting async job submit for node 69b826fe113612b7716bce11 2026-03-18 15:51:36,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:51:36,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b826fe113612b7716bce11 HTTP/1.1" 200 None 2026-03-18 15:51:36,450 - lava_callback - DEBUG - Processing node 69b826fe113612b7716bce11: baseline-arm64-clabbe 2026-03-18 15:51:36,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b826fe113612b7716bce11 2026-03-18 15:51:36,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:51:36,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b826fe113612b7716bce11 HTTP/1.1" 200 None 2026-03-18 15:51:36,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:51:36,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 15:51:36,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:51:36,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b826fe113612b7716bce11 HTTP/1.1" 200 None 2026-03-18 15:51:36,507 - lava_callback - ERROR - Error processing callback for node 69b826fe113612b7716bce11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:55:10,003 - lava_callback - INFO - Received callback for node 69b827d9113612b7716bce77 INFO: 172.21.0.1:58854 - "POST /node/69b827d9113612b7716bce77 HTTP/1.0" 202 Accepted 2026-03-18 15:55:10,009 - lava_callback - INFO - Starting async job submit for node 69b827d9113612b7716bce77 2026-03-18 15:55:10,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:55:10,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b827d9113612b7716bce77 HTTP/1.1" 200 None 2026-03-18 15:55:10,026 - lava_callback - DEBUG - Processing node 69b827d9113612b7716bce77: baseline-arm-baylibre 2026-03-18 15:55:10,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b827d9113612b7716bce77 2026-03-18 15:55:10,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:55:10,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b827d9113612b7716bce77 HTTP/1.1" 200 None 2026-03-18 15:55:10,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:55:10,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 15:55:10,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:55:10,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b827d9113612b7716bce77 HTTP/1.1" 200 None 2026-03-18 15:55:10,082 - lava_callback - ERROR - Error processing callback for node 69b827d9113612b7716bce77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50404 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:56:09,775 - lava_callback - INFO - Received callback for node 69b82804113612b7716bce82 INFO: 172.21.0.1:39986 - "POST /node/69b82804113612b7716bce82 HTTP/1.0" 202 Accepted 2026-03-18 15:56:09,781 - lava_callback - INFO - Starting async job submit for node 69b82804113612b7716bce82 2026-03-18 15:56:09,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:56:09,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82804113612b7716bce82 HTTP/1.1" 200 None 2026-03-18 15:56:09,808 - lava_callback - DEBUG - Processing node 69b82804113612b7716bce82: baseline-arm-baylibre 2026-03-18 15:56:09,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82804113612b7716bce82 2026-03-18 15:56:09,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:56:09,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82804113612b7716bce82 HTTP/1.1" 200 None 2026-03-18 15:56:09,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:56:09,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 15:56:09,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:56:09,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82804113612b7716bce82 HTTP/1.1" 200 None 2026-03-18 15:56:09,868 - lava_callback - ERROR - Error processing callback for node 69b82804113612b7716bce82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53236 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:56:49,845 - lava_callback - INFO - Received callback for node 69b8282f113612b7716bce8e INFO: 172.21.0.1:47666 - "POST /node/69b8282f113612b7716bce8e HTTP/1.0" 202 Accepted 2026-03-18 15:56:49,850 - lava_callback - INFO - Starting async job submit for node 69b8282f113612b7716bce8e 2026-03-18 15:56:49,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:56:49,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8282f113612b7716bce8e HTTP/1.1" 200 None 2026-03-18 15:56:49,886 - lava_callback - DEBUG - Processing node 69b8282f113612b7716bce8e: baseline-arm-baylibre 2026-03-18 15:56:49,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8282f113612b7716bce8e 2026-03-18 15:56:49,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:56:49,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8282f113612b7716bce8e HTTP/1.1" 200 None 2026-03-18 15:56:49,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:56:49,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 15:56:49,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:56:49,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8282f113612b7716bce8e HTTP/1.1" 200 None 2026-03-18 15:56:49,939 - lava_callback - ERROR - Error processing callback for node 69b8282f113612b7716bce8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32978 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:57:29,858 - lava_callback - INFO - Received callback for node 69b82859113612b7716bce9a INFO: 172.21.0.1:43674 - "POST /node/69b82859113612b7716bce9a HTTP/1.0" 202 Accepted 2026-03-18 15:57:29,864 - lava_callback - INFO - Starting async job submit for node 69b82859113612b7716bce9a 2026-03-18 15:57:29,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:57:29,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82859113612b7716bce9a HTTP/1.1" 200 None 2026-03-18 15:57:29,880 - lava_callback - DEBUG - Processing node 69b82859113612b7716bce9a: baseline-arm-baylibre 2026-03-18 15:57:29,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82859113612b7716bce9a 2026-03-18 15:57:29,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:57:29,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82859113612b7716bce9a HTTP/1.1" 200 None 2026-03-18 15:57:29,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:57:29,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 15:57:29,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:57:29,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82859113612b7716bce9a HTTP/1.1" 200 None 2026-03-18 15:57:29,941 - lava_callback - ERROR - Error processing callback for node 69b82859113612b7716bce9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:58:09,905 - lava_callback - INFO - Received callback for node 69b82883113612b7716bcea4 INFO: 172.21.0.1:51318 - "POST /node/69b82883113612b7716bcea4 HTTP/1.0" 202 Accepted 2026-03-18 15:58:09,911 - lava_callback - INFO - Starting async job submit for node 69b82883113612b7716bcea4 2026-03-18 15:58:09,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:58:09,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82883113612b7716bcea4 HTTP/1.1" 200 None 2026-03-18 15:58:09,927 - lava_callback - DEBUG - Processing node 69b82883113612b7716bcea4: baseline-arm-baylibre 2026-03-18 15:58:09,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82883113612b7716bcea4 2026-03-18 15:58:09,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:58:09,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82883113612b7716bcea4 HTTP/1.1" 200 None 2026-03-18 15:58:09,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:58:09,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 15:58:09,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:58:09,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82883113612b7716bcea4 HTTP/1.1" 200 None 2026-03-18 15:58:09,996 - lava_callback - ERROR - Error processing callback for node 69b82883113612b7716bcea4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK 2026-03-18 15:58:49,925 - lava_callback - INFO - Received callback for node 69b828ae113612b7716bceae INFO: 172.21.0.1:46972 - "POST /node/69b828ae113612b7716bceae HTTP/1.0" 202 Accepted 2026-03-18 15:58:49,930 - lava_callback - INFO - Starting async job submit for node 69b828ae113612b7716bceae 2026-03-18 15:58:49,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:58:49,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b828ae113612b7716bceae HTTP/1.1" 200 None 2026-03-18 15:58:49,946 - lava_callback - DEBUG - Processing node 69b828ae113612b7716bceae: baseline-arm-baylibre 2026-03-18 15:58:49,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b828ae113612b7716bceae 2026-03-18 15:58:49,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:58:49,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b828ae113612b7716bceae HTTP/1.1" 200 None 2026-03-18 15:58:49,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:58:49,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 15:58:49,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 15:58:50,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b828ae113612b7716bceae HTTP/1.1" 200 None 2026-03-18 15:58:50,012 - lava_callback - ERROR - Error processing callback for node 69b828ae113612b7716bceae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38712 - "GET / HTTP/1.0" 200 OK 2026-03-18 16:00:56,871 - lava_callback - INFO - Received callback for node 69b8292d113612b7716bcecc INFO: 172.21.0.1:38716 - "POST /node/69b8292d113612b7716bcecc HTTP/1.0" 202 Accepted 2026-03-18 16:00:56,876 - lava_callback - INFO - Starting async job submit for node 69b8292d113612b7716bcecc 2026-03-18 16:00:56,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:00:56,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8292d113612b7716bcecc HTTP/1.1" 200 None 2026-03-18 16:00:56,893 - lava_callback - DEBUG - Processing node 69b8292d113612b7716bcecc: baseline-arm-clabbe 2026-03-18 16:00:56,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b8292d113612b7716bcecc 2026-03-18 16:00:56,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:00:56,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b8292d113612b7716bcecc HTTP/1.1" 200 None 2026-03-18 16:00:56,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:00:56,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 16:00:56,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:00:56,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b8292d113612b7716bcecc HTTP/1.1" 200 None 2026-03-18 16:00:56,959 - lava_callback - ERROR - Error processing callback for node 69b8292d113612b7716bcecc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK 2026-03-18 16:01:36,836 - lava_callback - INFO - Received callback for node 69b82957113612b7716bcedd INFO: 172.21.0.1:45760 - "POST /node/69b82957113612b7716bcedd HTTP/1.0" 202 Accepted 2026-03-18 16:01:36,844 - lava_callback - INFO - Starting async job submit for node 69b82957113612b7716bcedd 2026-03-18 16:01:36,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:01:36,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82957113612b7716bcedd HTTP/1.1" 200 None 2026-03-18 16:01:36,866 - lava_callback - DEBUG - Processing node 69b82957113612b7716bcedd: baseline-arm-clabbe 2026-03-18 16:01:36,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82957113612b7716bcedd 2026-03-18 16:01:36,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:01:36,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82957113612b7716bcedd HTTP/1.1" 200 None 2026-03-18 16:01:36,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:01:36,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 16:01:36,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:01:36,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82957113612b7716bcedd HTTP/1.1" 200 None 2026-03-18 16:01:36,926 - lava_callback - ERROR - Error processing callback for node 69b82957113612b7716bcedd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK 2026-03-18 16:02:16,976 - lava_callback - INFO - Received callback for node 69b82985113612b7716bcee6 INFO: 172.21.0.1:34778 - "POST /node/69b82985113612b7716bcee6 HTTP/1.0" 202 Accepted 2026-03-18 16:02:16,981 - lava_callback - INFO - Starting async job submit for node 69b82985113612b7716bcee6 2026-03-18 16:02:16,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:02:16,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82985113612b7716bcee6 HTTP/1.1" 200 None 2026-03-18 16:02:16,998 - lava_callback - DEBUG - Processing node 69b82985113612b7716bcee6: baseline-arm-clabbe 2026-03-18 16:02:16,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82985113612b7716bcee6 2026-03-18 16:02:16,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:02:17,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82985113612b7716bcee6 HTTP/1.1" 200 None 2026-03-18 16:02:17,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:02:17,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 16:02:17,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:02:17,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82985113612b7716bcee6 HTTP/1.1" 200 None 2026-03-18 16:02:17,055 - lava_callback - ERROR - Error processing callback for node 69b82985113612b7716bcee6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK 2026-03-18 16:03:16,921 - lava_callback - INFO - Received callback for node 69b829af113612b7716bcef0 INFO: 172.21.0.1:54266 - "POST /node/69b829af113612b7716bcef0 HTTP/1.0" 202 Accepted 2026-03-18 16:03:16,928 - lava_callback - INFO - Starting async job submit for node 69b829af113612b7716bcef0 2026-03-18 16:03:16,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:03:16,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b829af113612b7716bcef0 HTTP/1.1" 200 None 2026-03-18 16:03:16,946 - lava_callback - DEBUG - Processing node 69b829af113612b7716bcef0: baseline-arm-clabbe 2026-03-18 16:03:16,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b829af113612b7716bcef0 2026-03-18 16:03:16,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:03:16,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b829af113612b7716bcef0 HTTP/1.1" 200 None 2026-03-18 16:03:16,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:03:16,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 16:03:16,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:03:17,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b829af113612b7716bcef0 HTTP/1.1" 200 None 2026-03-18 16:03:17,004 - lava_callback - ERROR - Error processing callback for node 69b829af113612b7716bcef0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK 2026-03-18 16:03:56,897 - lava_callback - INFO - Received callback for node 69b829db113612b7716bcf01 INFO: 172.21.0.1:54768 - "POST /node/69b829db113612b7716bcf01 HTTP/1.0" 202 Accepted 2026-03-18 16:03:56,902 - lava_callback - INFO - Starting async job submit for node 69b829db113612b7716bcf01 2026-03-18 16:03:56,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:03:56,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b829db113612b7716bcf01 HTTP/1.1" 200 None 2026-03-18 16:03:56,920 - lava_callback - DEBUG - Processing node 69b829db113612b7716bcf01: baseline-arm-clabbe 2026-03-18 16:03:56,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b829db113612b7716bcf01 2026-03-18 16:03:56,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:03:56,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b829db113612b7716bcf01 HTTP/1.1" 200 None 2026-03-18 16:03:56,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:03:56,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-18 16:03:56,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:03:56,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b829db113612b7716bcf01 HTTP/1.1" 200 None 2026-03-18 16:03:56,972 - lava_callback - ERROR - Error processing callback for node 69b829db113612b7716bcf01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40880 - "GET / HTTP/1.0" 200 OK 2026-03-18 16:04:56,957 - lava_callback - INFO - Received callback for node 69b82a13113612b7716bcf0f INFO: 172.21.0.1:40884 - "POST /node/69b82a13113612b7716bcf0f HTTP/1.0" 202 Accepted 2026-03-18 16:04:56,963 - lava_callback - INFO - Starting async job submit for node 69b82a13113612b7716bcf0f 2026-03-18 16:04:56,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:04:56,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82a13113612b7716bcf0f HTTP/1.1" 200 None 2026-03-18 16:04:56,979 - lava_callback - DEBUG - Processing node 69b82a13113612b7716bcf0f: baseline-arm64-clabbe 2026-03-18 16:04:56,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82a13113612b7716bcf0f 2026-03-18 16:04:56,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:04:56,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82a13113612b7716bcf0f HTTP/1.1" 200 None 2026-03-18 16:04:56,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:04:57,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 16:04:57,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:04:57,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82a13113612b7716bcf0f HTTP/1.1" 200 None 2026-03-18 16:04:57,038 - lava_callback - ERROR - Error processing callback for node 69b82a13113612b7716bcf0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK 2026-03-18 16:09:37,189 - lava_callback - INFO - Received callback for node 69b82b2f113612b7716bcf3f INFO: 172.21.0.1:33440 - "POST /node/69b82b2f113612b7716bcf3f HTTP/1.0" 202 Accepted 2026-03-18 16:09:37,194 - lava_callback - INFO - Starting async job submit for node 69b82b2f113612b7716bcf3f 2026-03-18 16:09:37,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:09:37,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82b2f113612b7716bcf3f HTTP/1.1" 200 None 2026-03-18 16:09:37,211 - lava_callback - DEBUG - Processing node 69b82b2f113612b7716bcf3f: baseline-arm64-clabbe 2026-03-18 16:09:37,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82b2f113612b7716bcf3f 2026-03-18 16:09:37,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:09:37,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82b2f113612b7716bcf3f HTTP/1.1" 200 None 2026-03-18 16:09:37,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:09:37,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 16:09:37,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:09:37,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82b2f113612b7716bcf3f HTTP/1.1" 200 None 2026-03-18 16:09:37,267 - lava_callback - ERROR - Error processing callback for node 69b82b2f113612b7716bcf3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK 2026-03-18 16:12:11,084 - lava_callback - INFO - Received callback for node 69b82bd6113612b7716bcf56 INFO: 172.21.0.1:43532 - "POST /node/69b82bd6113612b7716bcf56 HTTP/1.0" 202 Accepted 2026-03-18 16:12:11,089 - lava_callback - INFO - Starting async job submit for node 69b82bd6113612b7716bcf56 2026-03-18 16:12:11,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:12:11,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82bd6113612b7716bcf56 HTTP/1.1" 200 None 2026-03-18 16:12:11,106 - lava_callback - DEBUG - Processing node 69b82bd6113612b7716bcf56: baseline-arm64-baylibre 2026-03-18 16:12:11,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82bd6113612b7716bcf56 2026-03-18 16:12:11,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:12:11,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82bd6113612b7716bcf56 HTTP/1.1" 200 None 2026-03-18 16:12:11,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:12:11,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 16:12:11,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:12:11,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82bd6113612b7716bcf56 HTTP/1.1" 200 None 2026-03-18 16:12:11,161 - lava_callback - ERROR - Error processing callback for node 69b82bd6113612b7716bcf56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37250 - "GET / HTTP/1.0" 200 OK 2026-03-18 16:14:37,428 - lava_callback - INFO - Received callback for node 69b82c6a0b8ad4124cec3531 INFO: 172.21.0.1:37256 - "POST /node/69b82c6a0b8ad4124cec3531 HTTP/1.0" 202 Accepted 2026-03-18 16:14:37,434 - lava_callback - INFO - Starting async job submit for node 69b82c6a0b8ad4124cec3531 2026-03-18 16:14:37,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:14:37,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82c6a0b8ad4124cec3531 HTTP/1.1" 200 None 2026-03-18 16:14:37,463 - lava_callback - DEBUG - Processing node 69b82c6a0b8ad4124cec3531: baseline-arm64-clabbe 2026-03-18 16:14:37,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b82c6a0b8ad4124cec3531 2026-03-18 16:14:37,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:14:37,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82c6a0b8ad4124cec3531 HTTP/1.1" 200 None 2026-03-18 16:14:37,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:14:37,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-18 16:14:37,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-18 16:14:37,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b82c6a0b8ad4124cec3531 HTTP/1.1" 200 None 2026-03-18 16:14:37,518 - lava_callback - ERROR - Error processing callback for node 69b82c6a0b8ad4124cec3531: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]