INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:33954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36620 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:31:40,225 - lava_callback - INFO - Received callback for node 69ab7161efa461f55e59d23e 2026-03-07 00:31:40,233 - lava_callback - INFO - Starting async job submit for node 69ab7161efa461f55e59d23e INFO: 172.20.0.1:46324 - "POST /node/69ab7161efa461f55e59d23e HTTP/1.0" 202 Accepted 2026-03-07 00:31:40,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:31:40,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7161efa461f55e59d23e HTTP/1.1" 200 None 2026-03-07 00:31:40,280 - lava_callback - DEBUG - Processing node 69ab7161efa461f55e59d23e: baseline-arm 2026-03-07 00:31:40,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:31:40,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:31:40,674 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7161efa461f55e59d23e/log.txt.gz 2026-03-07 00:31:40,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:31:40,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:31:40,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7161efa461f55e59d23e/lava-logs.yaml 2026-03-07 00:31:40,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:31:41,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:31:41,145 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7161efa461f55e59d23e/lava_callback.json.gz 2026-03-07 00:31:41,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:31:41,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7161efa461f55e59d23e HTTP/1.1" 200 None 2026-03-07 00:31:41,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:31:41,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e3aefa461f55e59cdbd HTTP/1.1" 200 None 2026-03-07 00:31:41,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:31:41,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7161efa461f55e59d23e HTTP/1.1" 200 None 2026-03-07 00:31:41,239 - lava_callback - INFO - Completed processing callback for node 69ab7161efa461f55e59d23e INFO: 172.20.0.1:46338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34552 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:32:11,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:32:11,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56650 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:36:25,087 - lava_callback - INFO - Received callback for node 69ab72f6efa461f55e59d291 INFO: 172.20.0.1:36980 - "POST /node/69ab72f6efa461f55e59d291 HTTP/1.0" 202 Accepted 2026-03-07 00:36:25,093 - lava_callback - INFO - Starting async job submit for node 69ab72f6efa461f55e59d291 2026-03-07 00:36:25,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:36:25,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab72f6efa461f55e59d291 HTTP/1.1" 200 None 2026-03-07 00:36:25,111 - lava_callback - DEBUG - Processing node 69ab72f6efa461f55e59d291: baseline-x86 2026-03-07 00:36:25,116 - lava_callback - WARNING - Failed to upload log 2026-03-07 00:36:25,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:36:25,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:36:25,247 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72f6efa461f55e59d291/lava-logs.yaml 2026-03-07 00:36:25,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:36:25,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:36:25,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72f6efa461f55e59d291/lava_callback.json.gz 2026-03-07 00:36:25,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:36:25,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab72f6efa461f55e59d291 HTTP/1.1" 200 None 2026-03-07 00:36:25,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:36:25,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e5befa461f55e59cde7 HTTP/1.1" 200 None 2026-03-07 00:36:25,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:36:25,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab72f6efa461f55e59d291 HTTP/1.1" 200 None 2026-03-07 00:36:25,462 - lava_callback - INFO - Completed processing callback for node 69ab72f6efa461f55e59d291 INFO: 172.20.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38456 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:36:41,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:36:41,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 00:36:44,369 - lava_callback - INFO - Received callback for node 69ab72f8efa461f55e59d29a INFO: 172.20.0.1:60770 - "POST /node/69ab72f8efa461f55e59d29a HTTP/1.0" 202 Accepted 2026-03-07 00:36:44,376 - lava_callback - INFO - Starting async job submit for node 69ab72f8efa461f55e59d29a 2026-03-07 00:36:44,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:36:44,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab72f8efa461f55e59d29a HTTP/1.1" 200 None 2026-03-07 00:36:44,414 - lava_callback - DEBUG - Processing node 69ab72f8efa461f55e59d29a: baseline-x86 2026-03-07 00:36:44,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:36:44,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:36:44,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72f8efa461f55e59d29a/log.txt.gz 2026-03-07 00:36:44,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:36:45,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:36:45,036 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72f8efa461f55e59d29a/lava-logs.yaml 2026-03-07 00:36:45,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:36:45,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:36:45,196 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72f8efa461f55e59d29a/lava_callback.json.gz 2026-03-07 00:36:45,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:36:45,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab72f8efa461f55e59d29a HTTP/1.1" 200 None 2026-03-07 00:36:45,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:36:45,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e5befa461f55e59cde7 HTTP/1.1" 200 None 2026-03-07 00:36:45,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:36:45,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab72f8efa461f55e59d29a HTTP/1.1" 200 None 2026-03-07 00:36:45,288 - lava_callback - INFO - Completed processing callback for node 69ab72f8efa461f55e59d29a INFO: 172.20.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45584 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:37:11,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:37:11,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36954 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:37:21,929 - lava_callback - INFO - Received callback for node 69ab72f7efa461f55e59d297 INFO: 172.20.0.1:59330 - "POST /node/69ab72f7efa461f55e59d297 HTTP/1.0" 202 Accepted 2026-03-07 00:37:21,936 - lava_callback - INFO - Starting async job submit for node 69ab72f7efa461f55e59d297 2026-03-07 00:37:21,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:37:21,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab72f7efa461f55e59d297 HTTP/1.1" 200 None 2026-03-07 00:37:21,971 - lava_callback - DEBUG - Processing node 69ab72f7efa461f55e59d297: baseline-x86 2026-03-07 00:37:22,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:37:22,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:37:22,368 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72f7efa461f55e59d297/log.txt.gz 2026-03-07 00:37:22,524 - lava_callback - INFO - Received callback for node 69ab72f6efa461f55e59d294 2026-03-07 00:37:22,541 - lava_callback - INFO - Starting async job submit for node 69ab72f6efa461f55e59d294 INFO: 172.20.0.1:59338 - "POST /node/69ab72f6efa461f55e59d294 HTTP/1.0" 202 Accepted 2026-03-07 00:37:22,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:37:22,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:37:22,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab72f6efa461f55e59d294 HTTP/1.1" 200 None 2026-03-07 00:37:22,584 - lava_callback - DEBUG - Processing node 69ab72f6efa461f55e59d294: baseline-x86 2026-03-07 00:37:22,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:37:22,809 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72f7efa461f55e59d297/lava-logs.yaml 2026-03-07 00:37:22,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:37:22,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:37:23,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:37:23,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72f7efa461f55e59d297/lava_callback.json.gz 2026-03-07 00:37:23,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:37:23,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab72f7efa461f55e59d297 HTTP/1.1" 200 None 2026-03-07 00:37:23,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:37:23,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:37:23,085 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72f6efa461f55e59d294/log.txt.gz 2026-03-07 00:37:23,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e5befa461f55e59cde7 HTTP/1.1" 200 None 2026-03-07 00:37:23,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:37:23,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab72f7efa461f55e59d297 HTTP/1.1" 200 None 2026-03-07 00:37:23,299 - lava_callback - INFO - Completed processing callback for node 69ab72f7efa461f55e59d297 2026-03-07 00:37:23,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:37:23,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:37:23,578 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72f6efa461f55e59d294/lava-logs.yaml 2026-03-07 00:37:23,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:37:23,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:37:23,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72f6efa461f55e59d294/lava_callback.json.gz 2026-03-07 00:37:23,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:37:23,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab72f6efa461f55e59d294 HTTP/1.1" 200 None 2026-03-07 00:37:23,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:37:23,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e5befa461f55e59cde7 HTTP/1.1" 200 None 2026-03-07 00:37:23,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:37:23,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab72f6efa461f55e59d294 HTTP/1.1" 200 None 2026-03-07 00:37:23,808 - lava_callback - INFO - Completed processing callback for node 69ab72f6efa461f55e59d294 INFO: 172.20.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37454 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:37:41,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:37:41,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39896 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:38:41,038 - lava_callback - INFO - Received callback for node 69ab7375efa461f55e59d2e0 INFO: 172.20.0.1:44896 - "POST /node/69ab7375efa461f55e59d2e0 HTTP/1.0" 202 Accepted 2026-03-07 00:38:41,044 - lava_callback - INFO - Starting async job submit for node 69ab7375efa461f55e59d2e0 2026-03-07 00:38:41,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:38:41,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7375efa461f55e59d2e0 HTTP/1.1" 200 None 2026-03-07 00:38:41,077 - lava_callback - DEBUG - Processing node 69ab7375efa461f55e59d2e0: baseline-x86 2026-03-07 00:38:41,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:38:41,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:38:41,418 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab7375efa461f55e59d2e0/log.txt.gz 2026-03-07 00:38:41,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:38:41,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:38:41,738 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab7375efa461f55e59d2e0/lava-logs.yaml 2026-03-07 00:38:41,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:38:41,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:38:41,912 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab7375efa461f55e59d2e0/lava_callback.json.gz 2026-03-07 00:38:41,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:38:41,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7375efa461f55e59d2e0 HTTP/1.1" 200 None 2026-03-07 00:38:41,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:38:41,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e5befa461f55e59cde7 HTTP/1.1" 200 None 2026-03-07 00:38:41,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:38:42,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7375efa461f55e59d2e0 HTTP/1.1" 200 None 2026-03-07 00:38:42,004 - lava_callback - INFO - Completed processing callback for node 69ab7375efa461f55e59d2e0 2026-03-07 00:38:42,476 - lava_callback - INFO - Received callback for node 69ab7376efa461f55e59d2e3 INFO: 172.20.0.1:44912 - "POST /node/69ab7376efa461f55e59d2e3 HTTP/1.0" 202 Accepted 2026-03-07 00:38:42,486 - lava_callback - INFO - Starting async job submit for node 69ab7376efa461f55e59d2e3 2026-03-07 00:38:42,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:38:42,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7376efa461f55e59d2e3 HTTP/1.1" 200 None 2026-03-07 00:38:42,542 - lava_callback - DEBUG - Processing node 69ab7376efa461f55e59d2e3: baseline-x86 2026-03-07 00:38:42,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:38:42,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:38:42,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab7376efa461f55e59d2e3/log.txt.gz 2026-03-07 00:38:43,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:38:43,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:38:43,305 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab7376efa461f55e59d2e3/lava-logs.yaml 2026-03-07 00:38:43,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:38:43,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:38:43,465 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab7376efa461f55e59d2e3/lava_callback.json.gz 2026-03-07 00:38:43,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:38:43,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7376efa461f55e59d2e3 HTTP/1.1" 200 None 2026-03-07 00:38:43,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:38:43,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e5befa461f55e59cde7 HTTP/1.1" 200 None 2026-03-07 00:38:43,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:38:43,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7376efa461f55e59d2e3 HTTP/1.1" 200 None 2026-03-07 00:38:43,555 - lava_callback - INFO - Completed processing callback for node 69ab7376efa461f55e59d2e3 INFO: 172.20.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47872 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:39:11,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:39:11,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 00:39:13,632 - lava_callback - INFO - Received callback for node 69a8d0a9911a9cbe7f77ce92 INFO: 172.20.0.1:50514 - "POST /node/69a8d0a9911a9cbe7f77ce92 HTTP/1.0" 202 Accepted 2026-03-07 00:39:13,640 - lava_callback - INFO - Starting async job submit for node 69a8d0a9911a9cbe7f77ce92 2026-03-07 00:39:13,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:39:13,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d0a9911a9cbe7f77ce92 HTTP/1.1" 200 None 2026-03-07 00:39:13,659 - lava_callback - DEBUG - Processing node 69a8d0a9911a9cbe7f77ce92: baseline-arm-baylibre 2026-03-07 00:39:13,660 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d0a9911a9cbe7f77ce92 2026-03-07 00:39:13,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:39:13,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d0a9911a9cbe7f77ce92 HTTP/1.1" 200 None 2026-03-07 00:39:13,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:39:13,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 00:39:13,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:39:13,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d0a9911a9cbe7f77ce92 HTTP/1.1" 200 None 2026-03-07 00:39:13,713 - lava_callback - ERROR - Error processing callback for node 69a8d0a9911a9cbe7f77ce92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46984 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:39:53,578 - lava_callback - INFO - Received callback for node 69a8d0d5911a9cbe7f77cea7 INFO: 172.20.0.1:42790 - "POST /node/69a8d0d5911a9cbe7f77cea7 HTTP/1.0" 202 Accepted 2026-03-07 00:39:53,584 - lava_callback - INFO - Starting async job submit for node 69a8d0d5911a9cbe7f77cea7 2026-03-07 00:39:53,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:39:53,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d0d5911a9cbe7f77cea7 HTTP/1.1" 200 None 2026-03-07 00:39:53,599 - lava_callback - DEBUG - Processing node 69a8d0d5911a9cbe7f77cea7: baseline-arm-baylibre 2026-03-07 00:39:53,599 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d0d5911a9cbe7f77cea7 2026-03-07 00:39:53,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:39:53,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d0d5911a9cbe7f77cea7 HTTP/1.1" 200 None 2026-03-07 00:39:53,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:39:53,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 00:39:53,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:39:53,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d0d5911a9cbe7f77cea7 HTTP/1.1" 200 None 2026-03-07 00:39:53,669 - lava_callback - ERROR - Error processing callback for node 69a8d0d5911a9cbe7f77cea7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52782 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:40:53,719 - lava_callback - INFO - Received callback for node 69a8d101911a9cbe7f77cebe INFO: 172.20.0.1:35068 - "POST /node/69a8d101911a9cbe7f77cebe HTTP/1.0" 202 Accepted 2026-03-07 00:40:53,724 - lava_callback - INFO - Starting async job submit for node 69a8d101911a9cbe7f77cebe 2026-03-07 00:40:53,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:40:53,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d101911a9cbe7f77cebe HTTP/1.1" 200 None 2026-03-07 00:40:53,740 - lava_callback - DEBUG - Processing node 69a8d101911a9cbe7f77cebe: baseline-arm-baylibre 2026-03-07 00:40:53,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d101911a9cbe7f77cebe 2026-03-07 00:40:53,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:40:53,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d101911a9cbe7f77cebe HTTP/1.1" 200 None 2026-03-07 00:40:53,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:40:53,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 00:40:53,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:40:53,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d101911a9cbe7f77cebe HTTP/1.1" 200 None 2026-03-07 00:40:53,809 - lava_callback - ERROR - Error processing callback for node 69a8d101911a9cbe7f77cebe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41906 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:41:33,651 - lava_callback - INFO - Received callback for node 69a8d12d911a9cbe7f77ceda INFO: 172.20.0.1:43448 - "POST /node/69a8d12d911a9cbe7f77ceda HTTP/1.0" 202 Accepted 2026-03-07 00:41:33,656 - lava_callback - INFO - Starting async job submit for node 69a8d12d911a9cbe7f77ceda 2026-03-07 00:41:33,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:41:33,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d12d911a9cbe7f77ceda HTTP/1.1" 200 None 2026-03-07 00:41:33,682 - lava_callback - DEBUG - Processing node 69a8d12d911a9cbe7f77ceda: baseline-arm-baylibre 2026-03-07 00:41:33,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d12d911a9cbe7f77ceda 2026-03-07 00:41:33,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:41:33,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d12d911a9cbe7f77ceda HTTP/1.1" 200 None 2026-03-07 00:41:33,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:41:33,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 00:41:33,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:41:33,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d12d911a9cbe7f77ceda HTTP/1.1" 200 None 2026-03-07 00:41:33,765 - lava_callback - ERROR - Error processing callback for node 69a8d12d911a9cbe7f77ceda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53708 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:42:13,756 - lava_callback - INFO - Received callback for node 69a8d15a911a9cbe7f77d31c INFO: 172.20.0.1:35820 - "POST /node/69a8d15a911a9cbe7f77d31c HTTP/1.0" 202 Accepted 2026-03-07 00:42:13,762 - lava_callback - INFO - Starting async job submit for node 69a8d15a911a9cbe7f77d31c 2026-03-07 00:42:13,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:42:13,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d15a911a9cbe7f77d31c HTTP/1.1" 200 None 2026-03-07 00:42:13,779 - lava_callback - DEBUG - Processing node 69a8d15a911a9cbe7f77d31c: baseline-arm-baylibre 2026-03-07 00:42:13,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d15a911a9cbe7f77d31c 2026-03-07 00:42:13,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:42:13,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d15a911a9cbe7f77d31c HTTP/1.1" 200 None 2026-03-07 00:42:13,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:42:13,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 00:42:13,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:42:13,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d15a911a9cbe7f77d31c HTTP/1.1" 200 None 2026-03-07 00:42:13,835 - lava_callback - ERROR - Error processing callback for node 69a8d15a911a9cbe7f77d31c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55502 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:42:53,755 - lava_callback - INFO - Received callback for node 69a8d185911a9cbe7f77d32e INFO: 172.20.0.1:44938 - "POST /node/69a8d185911a9cbe7f77d32e HTTP/1.0" 202 Accepted 2026-03-07 00:42:53,761 - lava_callback - INFO - Starting async job submit for node 69a8d185911a9cbe7f77d32e 2026-03-07 00:42:53,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:42:53,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d185911a9cbe7f77d32e HTTP/1.1" 200 None 2026-03-07 00:42:53,777 - lava_callback - DEBUG - Processing node 69a8d185911a9cbe7f77d32e: baseline-arm-baylibre 2026-03-07 00:42:53,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d185911a9cbe7f77d32e 2026-03-07 00:42:53,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:42:53,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d185911a9cbe7f77d32e HTTP/1.1" 200 None 2026-03-07 00:42:53,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:42:53,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 00:42:53,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:42:53,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d185911a9cbe7f77d32e HTTP/1.1" 200 None 2026-03-07 00:42:53,837 - lava_callback - ERROR - Error processing callback for node 69a8d185911a9cbe7f77d32e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54786 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:49:14,859 - lava_callback - INFO - Received callback for node 69ab7603efa461f55e59d3e4 INFO: 172.20.0.1:47976 - "POST /node/69ab7603efa461f55e59d3e4 HTTP/1.0" 202 Accepted 2026-03-07 00:49:14,867 - lava_callback - INFO - Starting async job submit for node 69ab7603efa461f55e59d3e4 2026-03-07 00:49:14,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:14,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7603efa461f55e59d3e4 HTTP/1.1" 200 None 2026-03-07 00:49:14,921 - lava_callback - DEBUG - Processing node 69ab7603efa461f55e59d3e4: baseline-arm 2026-03-07 00:49:14,932 - lava_callback - WARNING - Failed to upload log 2026-03-07 00:49:14,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:49:15,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:49:15,059 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7603efa461f55e59d3e4/lava-logs.yaml 2026-03-07 00:49:15,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:47982 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 00:49:15,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:49:15,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7603efa461f55e59d3e4/lava_callback.json.gz 2026-03-07 00:49:15,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:15,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7603efa461f55e59d3e4 HTTP/1.1" 200 None 2026-03-07 00:49:15,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:15,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:49:15,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:15,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7603efa461f55e59d3e4 HTTP/1.1" 200 None 2026-03-07 00:49:15,253 - lava_callback - INFO - Completed processing callback for node 69ab7603efa461f55e59d3e4 INFO: 172.20.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38934 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:49:30,034 - lava_callback - INFO - Received callback for node 69ab760befa461f55e59d408 INFO: 172.20.0.1:55628 - "POST /node/69ab760befa461f55e59d408 HTTP/1.0" 202 Accepted 2026-03-07 00:49:30,040 - lava_callback - INFO - Starting async job submit for node 69ab760befa461f55e59d408 2026-03-07 00:49:30,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:30,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab760befa461f55e59d408 HTTP/1.1" 200 None 2026-03-07 00:49:30,058 - lava_callback - DEBUG - Processing node 69ab760befa461f55e59d408: baseline-arm 2026-03-07 00:49:30,063 - lava_callback - WARNING - Failed to upload log 2026-03-07 00:49:30,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:49:30,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:49:30,191 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab760befa461f55e59d408/lava-logs.yaml 2026-03-07 00:49:30,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:49:30,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:49:30,304 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab760befa461f55e59d408/lava_callback.json.gz 2026-03-07 00:49:30,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:30,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab760befa461f55e59d408 HTTP/1.1" 200 None 2026-03-07 00:49:30,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:30,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:49:30,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:30,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab760befa461f55e59d408 HTTP/1.1" 200 None 2026-03-07 00:49:30,368 - lava_callback - INFO - Completed processing callback for node 69ab760befa461f55e59d408 INFO: 172.20.0.1:55636 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:49:41,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:41,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 00:49:44,601 - lava_callback - INFO - Received callback for node 69ab7163efa461f55e59d241 INFO: 172.20.0.1:45238 - "POST /node/69ab7163efa461f55e59d241 HTTP/1.0" 202 Accepted 2026-03-07 00:49:44,608 - lava_callback - INFO - Starting async job submit for node 69ab7163efa461f55e59d241 2026-03-07 00:49:44,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:44,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7163efa461f55e59d241 HTTP/1.1" 200 None 2026-03-07 00:49:44,685 - lava_callback - DEBUG - Processing node 69ab7163efa461f55e59d241: ltp-smoke 2026-03-07 00:49:45,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:49:45,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:49:45,358 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab7163efa461f55e59d241/log.txt.gz 2026-03-07 00:49:45,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:49:45,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:49:45,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab7163efa461f55e59d241/lava-logs.yaml 2026-03-07 00:49:45,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:49:46,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:49:46,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab7163efa461f55e59d241/lava_callback.json.gz 2026-03-07 00:49:46,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:46,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7163efa461f55e59d241 HTTP/1.1" 200 None 2026-03-07 00:49:46,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:46,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e3aefa461f55e59cdbd HTTP/1.1" 200 None 2026-03-07 00:49:46,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:46,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7163efa461f55e59d241 HTTP/1.1" 200 None 2026-03-07 00:49:46,448 - lava_callback - INFO - Completed processing callback for node 69ab7163efa461f55e59d241 INFO: 172.20.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37452 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:49:56,688 - lava_callback - INFO - Received callback for node 69ab7604efa461f55e59d3e7 INFO: 172.20.0.1:37460 - "POST /node/69ab7604efa461f55e59d3e7 HTTP/1.0" 202 Accepted 2026-03-07 00:49:56,737 - lava_callback - INFO - Starting async job submit for node 69ab7604efa461f55e59d3e7 2026-03-07 00:49:56,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:56,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7604efa461f55e59d3e7 HTTP/1.1" 200 None 2026-03-07 00:49:56,772 - lava_callback - DEBUG - Processing node 69ab7604efa461f55e59d3e7: baseline-arm 2026-03-07 00:49:56,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:49:57,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:49:57,165 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7604efa461f55e59d3e7/log.txt.gz 2026-03-07 00:49:57,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:49:57,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:49:57,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7604efa461f55e59d3e7/lava-logs.yaml 2026-03-07 00:49:57,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:49:57,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:49:57,568 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7604efa461f55e59d3e7/lava_callback.json.gz 2026-03-07 00:49:57,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:57,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7604efa461f55e59d3e7 HTTP/1.1" 200 None 2026-03-07 00:49:57,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:57,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:49:57,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:49:57,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7604efa461f55e59d3e7 HTTP/1.1" 200 None 2026-03-07 00:49:57,663 - lava_callback - INFO - Completed processing callback for node 69ab7604efa461f55e59d3e7 INFO: 172.20.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44284 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:50:11,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:11,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 00:50:13,532 - lava_callback - INFO - Received callback for node 69ab7607efa461f55e59d3f2 INFO: 172.20.0.1:46394 - "POST /node/69ab7607efa461f55e59d3f2 HTTP/1.0" 202 Accepted 2026-03-07 00:50:13,590 - lava_callback - INFO - Starting async job submit for node 69ab7607efa461f55e59d3f2 2026-03-07 00:50:13,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:13,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7607efa461f55e59d3f2 HTTP/1.1" 200 None 2026-03-07 00:50:13,680 - lava_callback - DEBUG - Processing node 69ab7607efa461f55e59d3f2: baseline-arm 2026-03-07 00:50:13,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:14,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:14,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7607efa461f55e59d3f2/log.txt.gz 2026-03-07 00:50:14,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:14,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:14,248 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7607efa461f55e59d3f2/lava-logs.yaml 2026-03-07 00:50:14,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:14,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:14,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7607efa461f55e59d3f2/lava_callback.json.gz 2026-03-07 00:50:14,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:14,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7607efa461f55e59d3f2 HTTP/1.1" 200 None 2026-03-07 00:50:14,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:14,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:50:14,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:14,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7607efa461f55e59d3f2 HTTP/1.1" 200 None 2026-03-07 00:50:14,568 - lava_callback - INFO - Completed processing callback for node 69ab7607efa461f55e59d3f2 INFO: 172.20.0.1:46402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50398 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:50:34,246 - lava_callback - INFO - Received callback for node 69a8d357911a9cbe7f77d436 INFO: 172.20.0.1:59944 - "POST /node/69a8d357911a9cbe7f77d436 HTTP/1.0" 202 Accepted 2026-03-07 00:50:34,252 - lava_callback - INFO - Starting async job submit for node 69a8d357911a9cbe7f77d436 2026-03-07 00:50:34,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:34,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d357911a9cbe7f77d436 HTTP/1.1" 200 None 2026-03-07 00:50:34,271 - lava_callback - DEBUG - Processing node 69a8d357911a9cbe7f77d436: baseline-arm64-baylibre 2026-03-07 00:50:34,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d357911a9cbe7f77d436 2026-03-07 00:50:34,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:34,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d357911a9cbe7f77d436 HTTP/1.1" 200 None 2026-03-07 00:50:34,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:34,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3155314c84a8c43f97a21 HTTP/1.1" 200 None 2026-03-07 00:50:34,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:34,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d357911a9cbe7f77d436 HTTP/1.1" 200 None 2026-03-07 00:50:34,322 - lava_callback - ERROR - Error processing callback for node 69a8d357911a9cbe7f77d436: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59952 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:50:41,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:41,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33788 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:50:47,838 - lava_callback - INFO - Received callback for node 69ab7602efa461f55e59d3e1 INFO: 172.20.0.1:33800 - "POST /node/69ab7602efa461f55e59d3e1 HTTP/1.0" 202 Accepted 2026-03-07 00:50:47,864 - lava_callback - INFO - Starting async job submit for node 69ab7602efa461f55e59d3e1 2026-03-07 00:50:47,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:47,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7602efa461f55e59d3e1 HTTP/1.1" 200 None 2026-03-07 00:50:47,994 - lava_callback - DEBUG - Processing node 69ab7602efa461f55e59d3e1: baseline-arm 2026-03-07 00:50:48,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:48,596 - lava_callback - INFO - Received callback for node 69ab761aefa461f55e59d438 INFO: 172.20.0.1:33812 - "POST /node/69ab761aefa461f55e59d438 HTTP/1.0" 202 Accepted 2026-03-07 00:50:48,606 - lava_callback - INFO - Starting async job submit for node 69ab761aefa461f55e59d438 2026-03-07 00:50:48,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:48,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab761aefa461f55e59d438 HTTP/1.1" 200 None 2026-03-07 00:50:48,672 - lava_callback - DEBUG - Processing node 69ab761aefa461f55e59d438: baseline-arm-clabbe 2026-03-07 00:50:48,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:48,713 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7602efa461f55e59d3e1/log.txt.gz 2026-03-07 00:50:49,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:49,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:49,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:49,590 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761aefa461f55e59d438/log.txt.gz 2026-03-07 00:50:49,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:49,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:49,941 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7602efa461f55e59d3e1/lava-logs.yaml 2026-03-07 00:50:49,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:50,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:50,367 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761aefa461f55e59d438/lava-logs.yaml 2026-03-07 00:50:50,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:50,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:50,425 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7602efa461f55e59d3e1/lava_callback.json.gz 2026-03-07 00:50:50,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:50,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7602efa461f55e59d3e1 HTTP/1.1" 200 None 2026-03-07 00:50:50,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:50,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:50:50,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:50,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7602efa461f55e59d3e1 HTTP/1.1" 200 None 2026-03-07 00:50:50,597 - lava_callback - INFO - Completed processing callback for node 69ab7602efa461f55e59d3e1 2026-03-07 00:50:51,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:51,031 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761aefa461f55e59d438/lava_callback.json.gz 2026-03-07 00:50:51,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:51,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab761aefa461f55e59d438 HTTP/1.1" 200 None 2026-03-07 00:50:51,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:51,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:50:51,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:51,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab761aefa461f55e59d438 HTTP/1.1" 200 None 2026-03-07 00:50:51,154 - lava_callback - INFO - Completed processing callback for node 69ab761aefa461f55e59d438 2026-03-07 00:50:53,744 - lava_callback - INFO - Received callback for node 69ab761eefa461f55e59d445 INFO: 172.20.0.1:34578 - "POST /node/69ab761eefa461f55e59d445 HTTP/1.0" 202 Accepted 2026-03-07 00:50:53,755 - lava_callback - INFO - Starting async job submit for node 69ab761eefa461f55e59d445 2026-03-07 00:50:53,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:53,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab761eefa461f55e59d445 HTTP/1.1" 200 None 2026-03-07 00:50:53,827 - lava_callback - DEBUG - Processing node 69ab761eefa461f55e59d445: baseline-arm-clabbe 2026-03-07 00:50:53,894 - lava_callback - INFO - Received callback for node 69ab7629efa461f55e59d498 INFO: 172.20.0.1:34588 - "POST /node/69ab7629efa461f55e59d498 HTTP/1.0" 202 Accepted 2026-03-07 00:50:53,945 - lava_callback - INFO - Starting async job submit for node 69ab7629efa461f55e59d498 2026-03-07 00:50:54,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:54,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7629efa461f55e59d498 HTTP/1.1" 200 None 2026-03-07 00:50:54,098 - lava_callback - DEBUG - Processing node 69ab7629efa461f55e59d498: baseline-arm-pengutronix 2026-03-07 00:50:54,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:54,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:54,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:54,751 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761eefa461f55e59d445/log.txt.gz 2026-03-07 00:50:54,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:54,901 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7629efa461f55e59d498/log.txt.gz 2026-03-07 00:50:55,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:55,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:55,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:55,723 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7629efa461f55e59d498/lava-logs.yaml 2026-03-07 00:50:55,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:55,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:55,879 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761eefa461f55e59d445/lava-logs.yaml 2026-03-07 00:50:55,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:56,079 - lava_callback - INFO - Received callback for node 69ab7627efa461f55e59d492 2026-03-07 00:50:56,090 - lava_callback - INFO - Starting async job submit for node 69ab7627efa461f55e59d492 INFO: 172.20.0.1:34596 - "POST /node/69ab7627efa461f55e59d492 HTTP/1.0" 202 Accepted 2026-03-07 00:50:56,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:56,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7627efa461f55e59d492 HTTP/1.1" 200 None 2026-03-07 00:50:56,164 - lava_callback - DEBUG - Processing node 69ab7627efa461f55e59d492: baseline-arm-pengutronix 2026-03-07 00:50:56,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:56,203 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7629efa461f55e59d498/lava_callback.json.gz 2026-03-07 00:50:56,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:56,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7629efa461f55e59d498 HTTP/1.1" 200 None 2026-03-07 00:50:56,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:56,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:50:56,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:56,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:56,459 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761eefa461f55e59d445/lava_callback.json.gz INFO: 172.20.0.1:34604 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:50:56,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7629efa461f55e59d498 HTTP/1.1" 200 None 2026-03-07 00:50:56,522 - lava_callback - INFO - Completed processing callback for node 69ab7629efa461f55e59d498 2026-03-07 00:50:56,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:56,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab761eefa461f55e59d445 HTTP/1.1" 200 None 2026-03-07 00:50:56,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:56,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:56,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:50:56,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:56,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab761eefa461f55e59d445 HTTP/1.1" 200 None 2026-03-07 00:50:56,855 - lava_callback - INFO - Completed processing callback for node 69ab761eefa461f55e59d445 2026-03-07 00:50:57,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:57,298 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7627efa461f55e59d492/log.txt.gz 2026-03-07 00:50:57,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:50:58,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:58,068 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7627efa461f55e59d492/lava-logs.yaml 2026-03-07 00:50:58,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:34608 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:50:58,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:50:58,467 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7627efa461f55e59d492/lava_callback.json.gz 2026-03-07 00:50:58,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:58,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7627efa461f55e59d492 HTTP/1.1" 200 None 2026-03-07 00:50:58,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:58,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:50:58,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:50:58,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7627efa461f55e59d492 HTTP/1.1" 200 None 2026-03-07 00:50:58,613 - lava_callback - INFO - Completed processing callback for node 69ab7627efa461f55e59d492 2026-03-07 00:51:06,144 - lava_callback - INFO - Received callback for node 69ab7606efa461f55e59d3ef INFO: 172.20.0.1:45016 - "POST /node/69ab7606efa461f55e59d3ef HTTP/1.0" 202 Accepted 2026-03-07 00:51:06,155 - lava_callback - INFO - Starting async job submit for node 69ab7606efa461f55e59d3ef 2026-03-07 00:51:06,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:06,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7606efa461f55e59d3ef HTTP/1.1" 200 None 2026-03-07 00:51:06,269 - lava_callback - DEBUG - Processing node 69ab7606efa461f55e59d3ef: baseline-arm INFO: 172.20.0.1:45032 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:51:06,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:07,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:07,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7606efa461f55e59d3ef/log.txt.gz 2026-03-07 00:51:07,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:07,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:07,892 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7606efa461f55e59d3ef/lava-logs.yaml 2026-03-07 00:51:07,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:08,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:08,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7606efa461f55e59d3ef/lava_callback.json.gz 2026-03-07 00:51:08,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:08,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7606efa461f55e59d3ef HTTP/1.1" 200 None 2026-03-07 00:51:08,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:08,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:51:08,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:08,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7606efa461f55e59d3ef HTTP/1.1" 200 None 2026-03-07 00:51:08,401 - lava_callback - INFO - Completed processing callback for node 69ab7606efa461f55e59d3ef 2026-03-07 00:51:09,004 - lava_callback - INFO - Received callback for node 69ab7616efa461f55e59d427 INFO: 172.20.0.1:45048 - "POST /node/69ab7616efa461f55e59d427 HTTP/1.0" 202 Accepted 2026-03-07 00:51:09,018 - lava_callback - INFO - Starting async job submit for node 69ab7616efa461f55e59d427 2026-03-07 00:51:09,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:09,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7616efa461f55e59d427 HTTP/1.1" 200 None 2026-03-07 00:51:09,098 - lava_callback - DEBUG - Processing node 69ab7616efa461f55e59d427: baseline-arm-broonie 2026-03-07 00:51:09,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:09,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:09,941 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7616efa461f55e59d427/log.txt.gz 2026-03-07 00:51:10,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:10,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:10,625 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7616efa461f55e59d427/lava-logs.yaml 2026-03-07 00:51:10,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:10,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:10,939 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7616efa461f55e59d427/lava_callback.json.gz 2026-03-07 00:51:10,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:11,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7616efa461f55e59d427 HTTP/1.1" 200 None 2026-03-07 00:51:11,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:11,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:51:11,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:11,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7616efa461f55e59d427 HTTP/1.1" 200 None 2026-03-07 00:51:11,084 - lava_callback - INFO - Completed processing callback for node 69ab7616efa461f55e59d427 2026-03-07 00:51:11,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:11,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:38098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38106 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:51:19,511 - lava_callback - INFO - Received callback for node 69ab7614efa461f55e59d421 INFO: 172.20.0.1:38112 - "POST /node/69ab7614efa461f55e59d421 HTTP/1.0" 202 Accepted 2026-03-07 00:51:19,521 - lava_callback - INFO - Starting async job submit for node 69ab7614efa461f55e59d421 2026-03-07 00:51:19,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:19,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7614efa461f55e59d421 HTTP/1.1" 200 None 2026-03-07 00:51:19,601 - lava_callback - DEBUG - Processing node 69ab7614efa461f55e59d421: baseline-arm-broonie 2026-03-07 00:51:20,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:20,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:20,357 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7614efa461f55e59d421/log.txt.gz 2026-03-07 00:51:20,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:21,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:21,251 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7614efa461f55e59d421/lava-logs.yaml 2026-03-07 00:51:21,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:21,431 - lava_callback - INFO - Received callback for node 69ab7615efa461f55e59d424 INFO: 172.20.0.1:56940 - "POST /node/69ab7615efa461f55e59d424 HTTP/1.0" 202 Accepted 2026-03-07 00:51:21,443 - lava_callback - INFO - Starting async job submit for node 69ab7615efa461f55e59d424 2026-03-07 00:51:21,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:21,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7615efa461f55e59d424 HTTP/1.1" 200 None 2026-03-07 00:51:21,527 - lava_callback - DEBUG - Processing node 69ab7615efa461f55e59d424: baseline-arm-broonie 2026-03-07 00:51:21,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:21,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7614efa461f55e59d421/lava_callback.json.gz 2026-03-07 00:51:21,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:21,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7614efa461f55e59d421 HTTP/1.1" 200 None 2026-03-07 00:51:21,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:21,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:51:21,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:22,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:22,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7614efa461f55e59d421 HTTP/1.1" 200 None 2026-03-07 00:51:22,101 - lava_callback - INFO - Completed processing callback for node 69ab7614efa461f55e59d421 2026-03-07 00:51:22,232 - lava_callback - INFO - Received callback for node 69ab7623efa461f55e59d452 INFO: 172.20.0.1:56942 - "POST /node/69ab7623efa461f55e59d452 HTTP/1.0" 202 Accepted 2026-03-07 00:51:22,242 - lava_callback - INFO - Starting async job submit for node 69ab7623efa461f55e59d452 2026-03-07 00:51:22,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:22,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7623efa461f55e59d452 HTTP/1.1" 200 None 2026-03-07 00:51:22,310 - lava_callback - DEBUG - Processing node 69ab7623efa461f55e59d452: baseline-arm-kontron 2026-03-07 00:51:22,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:22,545 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7615efa461f55e59d424/log.txt.gz 2026-03-07 00:51:22,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:22,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:23,145 - lava_callback - INFO - Received callback for node 69ab767aefa461f55e59d53b INFO: 172.20.0.1:56958 - "POST /node/69ab767aefa461f55e59d53b HTTP/1.0" 202 Accepted 2026-03-07 00:51:23,155 - lava_callback - INFO - Starting async job submit for node 69ab767aefa461f55e59d53b 2026-03-07 00:51:23,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:23,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab767aefa461f55e59d53b HTTP/1.1" 200 None 2026-03-07 00:51:23,195 - lava_callback - DEBUG - Processing node 69ab767aefa461f55e59d53b: baseline-arm 2026-03-07 00:51:23,203 - lava_callback - WARNING - Failed to upload log 2026-03-07 00:51:23,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:23,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:23,238 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ab7623efa461f55e59d452/log.txt.gz 2026-03-07 00:51:23,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:23,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:23,646 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7615efa461f55e59d424/lava-logs.yaml 2026-03-07 00:51:23,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:23,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:23,750 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab767aefa461f55e59d53b/lava-logs.yaml 2026-03-07 00:51:23,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:24,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:24,117 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7615efa461f55e59d424/lava_callback.json.gz 2026-03-07 00:51:24,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:24,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab767aefa461f55e59d53b/lava_callback.json.gz 2026-03-07 00:51:24,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:24,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:24,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab767aefa461f55e59d53b HTTP/1.1" 200 None 2026-03-07 00:51:24,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:24,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:24,215 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ab7623efa461f55e59d452/lava-logs.yaml 2026-03-07 00:51:24,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:24,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:51:24,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:24,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7615efa461f55e59d424 HTTP/1.1" 200 None 2026-03-07 00:51:24,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:24,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab767aefa461f55e59d53b HTTP/1.1" 200 None 2026-03-07 00:51:24,317 - lava_callback - INFO - Completed processing callback for node 69ab767aefa461f55e59d53b 2026-03-07 00:51:24,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:51:24,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:24,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7615efa461f55e59d424 HTTP/1.1" 200 None 2026-03-07 00:51:24,499 - lava_callback - INFO - Completed processing callback for node 69ab7615efa461f55e59d424 2026-03-07 00:51:25,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:25,103 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ab7623efa461f55e59d452/lava_callback.json.gz 2026-03-07 00:51:25,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:25,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7623efa461f55e59d452 HTTP/1.1" 200 None 2026-03-07 00:51:25,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:25,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:51:25,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:25,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7623efa461f55e59d452 HTTP/1.1" 200 None 2026-03-07 00:51:25,254 - lava_callback - INFO - Completed processing callback for node 69ab7623efa461f55e59d452 INFO: 172.20.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48206 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:51:40,114 - lava_callback - INFO - Received callback for node 69ab7612efa461f55e59d41d INFO: 172.20.0.1:57524 - "POST /node/69ab7612efa461f55e59d41d HTTP/1.0" 202 Accepted 2026-03-07 00:51:40,138 - lava_callback - INFO - Starting async job submit for node 69ab7612efa461f55e59d41d 2026-03-07 00:51:40,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:40,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7612efa461f55e59d41d HTTP/1.1" 200 None 2026-03-07 00:51:40,232 - lava_callback - DEBUG - Processing node 69ab7612efa461f55e59d41d: baseline-arm-broonie 2026-03-07 00:51:40,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:40,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:40,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7612efa461f55e59d41d/log.txt.gz 2026-03-07 00:51:41,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:41,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:41,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-07 00:51:41,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:41,648 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7612efa461f55e59d41d/lava-logs.yaml 2026-03-07 00:51:41,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:42,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:42,012 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ab7612efa461f55e59d41d/lava_callback.json.gz 2026-03-07 00:51:42,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:42,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7612efa461f55e59d41d HTTP/1.1" 200 None 2026-03-07 00:51:42,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:42,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:51:42,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:42,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7612efa461f55e59d41d HTTP/1.1" 200 None 2026-03-07 00:51:42,170 - lava_callback - INFO - Completed processing callback for node 69ab7612efa461f55e59d41d INFO: 172.20.0.1:57540 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:51:53,458 - lava_callback - INFO - Received callback for node 69ab7625efa461f55e59d48e INFO: 172.20.0.1:41428 - "POST /node/69ab7625efa461f55e59d48e HTTP/1.0" 202 Accepted 2026-03-07 00:51:53,473 - lava_callback - INFO - Starting async job submit for node 69ab7625efa461f55e59d48e 2026-03-07 00:51:53,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:53,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7625efa461f55e59d48e HTTP/1.1" 200 None 2026-03-07 00:51:53,589 - lava_callback - DEBUG - Processing node 69ab7625efa461f55e59d48e: baseline-arm-pengutronix 2026-03-07 00:51:53,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:54,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:54,322 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7625efa461f55e59d48e/log.txt.gz 2026-03-07 00:51:54,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:54,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:54,972 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7625efa461f55e59d48e/lava-logs.yaml 2026-03-07 00:51:54,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:55,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:55,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7625efa461f55e59d48e/lava_callback.json.gz 2026-03-07 00:51:55,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:55,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7625efa461f55e59d48e HTTP/1.1" 200 None 2026-03-07 00:51:55,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:55,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:51:55,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:55,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7625efa461f55e59d48e HTTP/1.1" 200 None 2026-03-07 00:51:55,581 - lava_callback - INFO - Completed processing callback for node 69ab7625efa461f55e59d48e INFO: 172.20.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:51:59,279 - lava_callback - INFO - Received callback for node 69ab7640efa461f55e59d4bb INFO: 172.20.0.1:41452 - "POST /node/69ab7640efa461f55e59d4bb HTTP/1.0" 202 Accepted 2026-03-07 00:51:59,286 - lava_callback - INFO - Starting async job submit for node 69ab7640efa461f55e59d4bb 2026-03-07 00:51:59,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:51:59,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7640efa461f55e59d4bb HTTP/1.1" 200 None 2026-03-07 00:51:59,329 - lava_callback - DEBUG - Processing node 69ab7640efa461f55e59d4bb: ltp-dio 2026-03-07 00:51:59,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:51:59,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:51:59,921 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69ab7640efa461f55e59d4bb/log.txt.gz 2026-03-07 00:52:00,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:52:00,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:52:00,332 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69ab7640efa461f55e59d4bb/lava-logs.yaml 2026-03-07 00:52:00,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:52:00,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:52:00,505 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69ab7640efa461f55e59d4bb/lava_callback.json.gz 2026-03-07 00:52:00,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:52:00,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7640efa461f55e59d4bb HTTP/1.1" 200 None 2026-03-07 00:52:00,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:52:00,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:52:00,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:52:00,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7640efa461f55e59d4bb HTTP/1.1" 200 None 2026-03-07 00:52:00,608 - lava_callback - INFO - Completed processing callback for node 69ab7640efa461f55e59d4bb INFO: 172.20.0.1:36684 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:52:11,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:52:11,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46176 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 00:52:15,690 - lava_callback - INFO - Received callback for node 69ab761cefa461f55e59d43c INFO: 172.20.0.1:46186 - "POST /node/69ab761cefa461f55e59d43c HTTP/1.0" 202 Accepted 2026-03-07 00:52:15,697 - lava_callback - INFO - Starting async job submit for node 69ab761cefa461f55e59d43c 2026-03-07 00:52:15,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:52:15,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab761cefa461f55e59d43c HTTP/1.1" 200 None 2026-03-07 00:52:15,737 - lava_callback - DEBUG - Processing node 69ab761cefa461f55e59d43c: baseline-arm-clabbe 2026-03-07 00:52:15,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:52:16,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:52:16,086 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761cefa461f55e59d43c/log.txt.gz 2026-03-07 00:52:16,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:52:16,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:52:16,378 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761cefa461f55e59d43c/lava-logs.yaml 2026-03-07 00:52:16,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:52:16,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:52:16,515 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761cefa461f55e59d43c/lava_callback.json.gz INFO: 172.20.0.1:46196 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:52:16,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:52:16,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab761cefa461f55e59d43c HTTP/1.1" 200 None 2026-03-07 00:52:16,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:52:16,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:52:16,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:52:16,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab761cefa461f55e59d43c HTTP/1.1" 200 None 2026-03-07 00:52:16,602 - lava_callback - INFO - Completed processing callback for node 69ab761cefa461f55e59d43c INFO: 172.20.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51812 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:52:41,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:52:41,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59898 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:53:14,384 - lava_callback - INFO - Received callback for node 69a8d3f1911a9cbe7f77d4aa INFO: 172.20.0.1:35842 - "POST /node/69a8d3f1911a9cbe7f77d4aa HTTP/1.0" 202 Accepted 2026-03-07 00:53:14,389 - lava_callback - INFO - Starting async job submit for node 69a8d3f1911a9cbe7f77d4aa 2026-03-07 00:53:14,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:14,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d3f1911a9cbe7f77d4aa HTTP/1.1" 200 None 2026-03-07 00:53:14,405 - lava_callback - DEBUG - Processing node 69a8d3f1911a9cbe7f77d4aa: baseline-arm-baylibre 2026-03-07 00:53:14,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d3f1911a9cbe7f77d4aa 2026-03-07 00:53:14,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:14,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d3f1911a9cbe7f77d4aa HTTP/1.1" 200 None 2026-03-07 00:53:14,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:14,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 00:53:14,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:14,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d3f1911a9cbe7f77d4aa HTTP/1.1" 200 None 2026-03-07 00:53:14,491 - lava_callback - ERROR - Error processing callback for node 69a8d3f1911a9cbe7f77d4aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45412 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:53:54,338 - lava_callback - INFO - Received callback for node 69a8d41d911a9cbe7f77d4d8 INFO: 172.20.0.1:52116 - "POST /node/69a8d41d911a9cbe7f77d4d8 HTTP/1.0" 202 Accepted 2026-03-07 00:53:54,343 - lava_callback - INFO - Starting async job submit for node 69a8d41d911a9cbe7f77d4d8 2026-03-07 00:53:54,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:54,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d41d911a9cbe7f77d4d8 HTTP/1.1" 200 None 2026-03-07 00:53:54,365 - lava_callback - DEBUG - Processing node 69a8d41d911a9cbe7f77d4d8: baseline-arm-baylibre 2026-03-07 00:53:54,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d41d911a9cbe7f77d4d8 2026-03-07 00:53:54,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:54,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d41d911a9cbe7f77d4d8 HTTP/1.1" 200 None 2026-03-07 00:53:54,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:54,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 00:53:54,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:54,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d41d911a9cbe7f77d4d8 HTTP/1.1" 200 None 2026-03-07 00:53:54,429 - lava_callback - ERROR - Error processing callback for node 69a8d41d911a9cbe7f77d4d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 00:53:54,692 - lava_callback - INFO - Received callback for node 69ab761fefa461f55e59d448 INFO: 172.20.0.1:52120 - "POST /node/69ab761fefa461f55e59d448 HTTP/1.0" 202 Accepted 2026-03-07 00:53:54,702 - lava_callback - INFO - Starting async job submit for node 69ab761fefa461f55e59d448 2026-03-07 00:53:54,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:54,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab761fefa461f55e59d448 HTTP/1.1" 200 None 2026-03-07 00:53:54,777 - lava_callback - DEBUG - Processing node 69ab761fefa461f55e59d448: baseline-arm-clabbe 2026-03-07 00:53:55,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:53:55,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:53:55,220 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761fefa461f55e59d448/log.txt.gz 2026-03-07 00:53:55,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:53:55,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:53:55,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761fefa461f55e59d448/lava-logs.yaml 2026-03-07 00:53:55,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:53:55,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:53:55,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab761fefa461f55e59d448/lava_callback.json.gz 2026-03-07 00:53:55,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:55,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab761fefa461f55e59d448 HTTP/1.1" 200 None 2026-03-07 00:53:55,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:55,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:53:55,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:53:56,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab761fefa461f55e59d448 HTTP/1.1" 200 None 2026-03-07 00:53:56,032 - lava_callback - INFO - Completed processing callback for node 69ab761fefa461f55e59d448 INFO: 172.20.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36892 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:54:11,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:11,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59408 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:54:29,014 - lava_callback - INFO - Received callback for node 69ab7639efa461f55e59d4ac INFO: 172.20.0.1:59412 - "POST /node/69ab7639efa461f55e59d4ac HTTP/1.0" 202 Accepted 2026-03-07 00:54:29,021 - lava_callback - INFO - Starting async job submit for node 69ab7639efa461f55e59d4ac 2026-03-07 00:54:29,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:29,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7639efa461f55e59d4ac HTTP/1.1" 200 None 2026-03-07 00:54:29,063 - lava_callback - DEBUG - Processing node 69ab7639efa461f55e59d4ac: ltp-cap_bounds 2026-03-07 00:54:29,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:29,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:29,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ab7639efa461f55e59d4ac/log.txt.gz 2026-03-07 00:54:30,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:30,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:30,608 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ab7639efa461f55e59d4ac/lava-logs.yaml 2026-03-07 00:54:30,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:30,904 - lava_callback - INFO - Received callback for node 69ab763befa461f55e59d4b1 INFO: 172.20.0.1:57352 - "POST /node/69ab763befa461f55e59d4b1 HTTP/1.0" 202 Accepted 2026-03-07 00:54:30,915 - lava_callback - INFO - Starting async job submit for node 69ab763befa461f55e59d4b1 2026-03-07 00:54:30,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:31,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab763befa461f55e59d4b1 HTTP/1.1" 200 None 2026-03-07 00:54:31,006 - lava_callback - DEBUG - Processing node 69ab763befa461f55e59d4b1: ltp-containers 2026-03-07 00:54:31,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:31,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ab7639efa461f55e59d4ac/lava_callback.json.gz 2026-03-07 00:54:31,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:31,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7639efa461f55e59d4ac HTTP/1.1" 200 None 2026-03-07 00:54:31,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:31,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:54:31,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:31,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:31,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7639efa461f55e59d4ac HTTP/1.1" 200 None 2026-03-07 00:54:31,663 - lava_callback - INFO - Completed processing callback for node 69ab7639efa461f55e59d4ac 2026-03-07 00:54:32,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:32,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69ab763befa461f55e59d4b1/log.txt.gz 2026-03-07 00:54:32,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:32,512 - lava_callback - INFO - Received callback for node 69ab763cefa461f55e59d4b4 INFO: 172.20.0.1:57358 - "POST /node/69ab763cefa461f55e59d4b4 HTTP/1.0" 202 Accepted 2026-03-07 00:54:32,522 - lava_callback - INFO - Starting async job submit for node 69ab763cefa461f55e59d4b4 2026-03-07 00:54:32,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:32,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab763cefa461f55e59d4b4 HTTP/1.1" 200 None 2026-03-07 00:54:32,635 - lava_callback - DEBUG - Processing node 69ab763cefa461f55e59d4b4: ltp-controllers 2026-03-07 00:54:33,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:33,099 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69ab763befa461f55e59d4b1/lava-logs.yaml 2026-03-07 00:54:33,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:33,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:33,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:33,765 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69ab763cefa461f55e59d4b4/log.txt.gz 2026-03-07 00:54:33,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:33,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69ab763befa461f55e59d4b1/lava_callback.json.gz 2026-03-07 00:54:33,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:34,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab763befa461f55e59d4b1 HTTP/1.1" 200 None 2026-03-07 00:54:34,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:34,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:54:34,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:34,170 - lava_callback - INFO - Received callback for node 69ab764defa461f55e59d4fa INFO: 172.20.0.1:57364 - "POST /node/69ab764defa461f55e59d4fa HTTP/1.0" 202 Accepted 2026-03-07 00:54:34,203 - lava_callback - INFO - Starting async job submit for node 69ab764defa461f55e59d4fa 2026-03-07 00:54:34,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab763befa461f55e59d4b1 HTTP/1.1" 200 None 2026-03-07 00:54:34,297 - lava_callback - INFO - Completed processing callback for node 69ab763befa461f55e59d4b1 2026-03-07 00:54:34,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:34,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:34,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab764defa461f55e59d4fa HTTP/1.1" 200 None 2026-03-07 00:54:34,529 - lava_callback - DEBUG - Processing node 69ab764defa461f55e59d4fa: ltp-syscalls 2026-03-07 00:54:34,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:35,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69ab763cefa461f55e59d4b4/lava-logs.yaml 2026-03-07 00:54:35,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:35,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:35,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69ab763cefa461f55e59d4b4/lava_callback.json.gz 2026-03-07 00:54:35,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:35,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:35,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab763cefa461f55e59d4b4 HTTP/1.1" 200 None 2026-03-07 00:54:35,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:35,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:54:35,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:35,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab763cefa461f55e59d4b4 HTTP/1.1" 200 None 2026-03-07 00:54:35,897 - lava_callback - INFO - Completed processing callback for node 69ab763cefa461f55e59d4b4 2026-03-07 00:54:36,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:36,093 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ab764defa461f55e59d4fa/log.txt.gz INFO: 172.20.0.1:57368 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:54:36,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:37,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:37,308 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ab764defa461f55e59d4fa/lava-logs.yaml 2026-03-07 00:54:37,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:37,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:37,526 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ab764defa461f55e59d4fa/lava_callback.json.gz 2026-03-07 00:54:37,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:37,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab764defa461f55e59d4fa HTTP/1.1" 200 None 2026-03-07 00:54:37,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:37,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:54:37,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:37,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab764defa461f55e59d4fa HTTP/1.1" 200 None 2026-03-07 00:54:37,654 - lava_callback - INFO - Completed processing callback for node 69ab764defa461f55e59d4fa 2026-03-07 00:54:41,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:41,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:42436 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:54:49,604 - lava_callback - INFO - Received callback for node 69ab763fefa461f55e59d4b7 INFO: 172.20.0.1:42444 - "POST /node/69ab763fefa461f55e59d4b7 HTTP/1.0" 202 Accepted 2026-03-07 00:54:49,611 - lava_callback - INFO - Starting async job submit for node 69ab763fefa461f55e59d4b7 2026-03-07 00:54:49,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:49,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab763fefa461f55e59d4b7 HTTP/1.1" 200 None 2026-03-07 00:54:49,657 - lava_callback - DEBUG - Processing node 69ab763fefa461f55e59d4b7: ltp-cve 2026-03-07 00:54:50,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:50,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:50,404 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69ab763fefa461f55e59d4b7/log.txt.gz 2026-03-07 00:54:50,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:51,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:51,043 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69ab763fefa461f55e59d4b7/lava-logs.yaml 2026-03-07 00:54:51,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:54:51,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:54:51,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69ab763fefa461f55e59d4b7/lava_callback.json.gz 2026-03-07 00:54:51,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:51,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab763fefa461f55e59d4b7 HTTP/1.1" 200 None 2026-03-07 00:54:51,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:51,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:54:51,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:51,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab763fefa461f55e59d4b7 HTTP/1.1" 200 None 2026-03-07 00:54:51,301 - lava_callback - INFO - Completed processing callback for node 69ab763fefa461f55e59d4b7 2026-03-07 00:54:54,501 - lava_callback - INFO - Received callback for node 69a8d44a911a9cbe7f77d50f INFO: 172.20.0.1:51522 - "POST /node/69a8d44a911a9cbe7f77d50f HTTP/1.0" 202 Accepted 2026-03-07 00:54:54,511 - lava_callback - INFO - Starting async job submit for node 69a8d44a911a9cbe7f77d50f 2026-03-07 00:54:54,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:54,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d44a911a9cbe7f77d50f HTTP/1.1" 200 None 2026-03-07 00:54:54,542 - lava_callback - DEBUG - Processing node 69a8d44a911a9cbe7f77d50f: baseline-arm-baylibre 2026-03-07 00:54:54,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d44a911a9cbe7f77d50f 2026-03-07 00:54:54,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:54,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d44a911a9cbe7f77d50f HTTP/1.1" 200 None 2026-03-07 00:54:54,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:54,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 00:54:54,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:54:54,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d44a911a9cbe7f77d50f HTTP/1.1" 200 None 2026-03-07 00:54:54,643 - lava_callback - ERROR - Error processing callback for node 69a8d44a911a9cbe7f77d50f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40750 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:55:11,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:11,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48202 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:55:34,419 - lava_callback - INFO - Received callback for node 69a8d475911a9cbe7f77d535 INFO: 172.20.0.1:38180 - "POST /node/69a8d475911a9cbe7f77d535 HTTP/1.0" 202 Accepted 2026-03-07 00:55:34,425 - lava_callback - INFO - Starting async job submit for node 69a8d475911a9cbe7f77d535 2026-03-07 00:55:34,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:34,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d475911a9cbe7f77d535 HTTP/1.1" 200 None 2026-03-07 00:55:34,441 - lava_callback - DEBUG - Processing node 69a8d475911a9cbe7f77d535: baseline-arm-baylibre 2026-03-07 00:55:34,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d475911a9cbe7f77d535 2026-03-07 00:55:34,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:34,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d475911a9cbe7f77d535 HTTP/1.1" 200 None 2026-03-07 00:55:34,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:34,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 00:55:34,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:34,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d475911a9cbe7f77d535 HTTP/1.1" 200 None 2026-03-07 00:55:34,499 - lava_callback - ERROR - Error processing callback for node 69a8d475911a9cbe7f77d535: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38188 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:55:37,807 - lava_callback - INFO - Received callback for node 69ab7620efa461f55e59d44b INFO: 172.20.0.1:38204 - "POST /node/69ab7620efa461f55e59d44b HTTP/1.0" 202 Accepted 2026-03-07 00:55:37,813 - lava_callback - INFO - Starting async job submit for node 69ab7620efa461f55e59d44b 2026-03-07 00:55:37,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:37,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7620efa461f55e59d44b HTTP/1.1" 200 None 2026-03-07 00:55:37,865 - lava_callback - DEBUG - Processing node 69ab7620efa461f55e59d44b: baseline-arm-clabbe 2026-03-07 00:55:38,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:55:38,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:55:38,286 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab7620efa461f55e59d44b/log.txt.gz 2026-03-07 00:55:38,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:55:38,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:55:38,669 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab7620efa461f55e59d44b/lava-logs.yaml 2026-03-07 00:55:38,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:55:38,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:55:38,816 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab7620efa461f55e59d44b/lava_callback.json.gz 2026-03-07 00:55:38,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:38,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7620efa461f55e59d44b HTTP/1.1" 200 None 2026-03-07 00:55:38,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:38,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:55:38,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:38,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7620efa461f55e59d44b HTTP/1.1" 200 None 2026-03-07 00:55:38,896 - lava_callback - INFO - Completed processing callback for node 69ab7620efa461f55e59d44b 2026-03-07 00:55:41,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:41,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59060 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:55:50,355 - lava_callback - INFO - Received callback for node 69ab7787efa461f55e59d65e INFO: 172.20.0.1:39234 - "POST /node/69ab7787efa461f55e59d65e HTTP/1.0" 202 Accepted 2026-03-07 00:55:50,361 - lava_callback - INFO - Starting async job submit for node 69ab7787efa461f55e59d65e 2026-03-07 00:55:50,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:50,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7787efa461f55e59d65e HTTP/1.1" 200 None 2026-03-07 00:55:50,388 - lava_callback - DEBUG - Processing node 69ab7787efa461f55e59d65e: baseline-arm 2026-03-07 00:55:50,393 - lava_callback - WARNING - Failed to upload log 2026-03-07 00:55:50,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:55:50,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:55:50,504 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7787efa461f55e59d65e/lava-logs.yaml 2026-03-07 00:55:50,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:55:50,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:55:50,639 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7787efa461f55e59d65e/lava_callback.json.gz 2026-03-07 00:55:50,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:50,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7787efa461f55e59d65e HTTP/1.1" 200 None 2026-03-07 00:55:50,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:50,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:55:50,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:50,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7787efa461f55e59d65e HTTP/1.1" 200 None 2026-03-07 00:55:50,708 - lava_callback - INFO - Completed processing callback for node 69ab7787efa461f55e59d65e INFO: 172.20.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39248 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:55:59,358 - lava_callback - INFO - Received callback for node 69ab7641efa461f55e59d4c2 INFO: 172.20.0.1:39260 - "POST /node/69ab7641efa461f55e59d4c2 HTTP/1.0" 202 Accepted 2026-03-07 00:55:59,365 - lava_callback - INFO - Starting async job submit for node 69ab7641efa461f55e59d4c2 2026-03-07 00:55:59,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:55:59,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7641efa461f55e59d4c2 HTTP/1.1" 200 None 2026-03-07 00:55:59,424 - lava_callback - DEBUG - Processing node 69ab7641efa461f55e59d4c2: ltp-fs_bind 2026-03-07 00:55:59,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:56:00,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:56:00,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ab7641efa461f55e59d4c2/log.txt.gz 2026-03-07 00:56:00,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:56:00,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:56:00,548 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ab7641efa461f55e59d4c2/lava-logs.yaml 2026-03-07 00:56:00,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:56:00,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:56:00,754 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ab7641efa461f55e59d4c2/lava_callback.json.gz 2026-03-07 00:56:00,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:56:00,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7641efa461f55e59d4c2 HTTP/1.1" 200 None 2026-03-07 00:56:00,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:56:00,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:56:00,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:56:00,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7641efa461f55e59d4c2 HTTP/1.1" 200 None 2026-03-07 00:56:00,919 - lava_callback - INFO - Completed processing callback for node 69ab7641efa461f55e59d4c2 INFO: 172.20.0.1:37938 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:56:11,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:56:11,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35810 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:57:14,568 - lava_callback - INFO - Received callback for node 69a8d4e5911a9cbe7f77d575 INFO: 172.20.0.1:50476 - "POST /node/69a8d4e5911a9cbe7f77d575 HTTP/1.0" 202 Accepted 2026-03-07 00:57:14,574 - lava_callback - INFO - Starting async job submit for node 69a8d4e5911a9cbe7f77d575 2026-03-07 00:57:14,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:57:14,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d4e5911a9cbe7f77d575 HTTP/1.1" 200 None 2026-03-07 00:57:14,597 - lava_callback - DEBUG - Processing node 69a8d4e5911a9cbe7f77d575: baseline-arm-baylibre 2026-03-07 00:57:14,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d4e5911a9cbe7f77d575 2026-03-07 00:57:14,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:57:14,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d4e5911a9cbe7f77d575 HTTP/1.1" 200 None 2026-03-07 00:57:14,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:57:14,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 00:57:14,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:57:14,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d4e5911a9cbe7f77d575 HTTP/1.1" 200 None 2026-03-07 00:57:14,655 - lava_callback - ERROR - Error processing callback for node 69a8d4e5911a9cbe7f77d575: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44550 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:58:07,102 - lava_callback - INFO - Received callback for node 69ab77d8efa461f55e59d697 INFO: 172.20.0.1:44562 - "POST /node/69ab77d8efa461f55e59d697 HTTP/1.0" 202 Accepted 2026-03-07 00:58:07,108 - lava_callback - INFO - Starting async job submit for node 69ab77d8efa461f55e59d697 2026-03-07 00:58:07,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:07,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab77d8efa461f55e59d697 HTTP/1.1" 200 None 2026-03-07 00:58:07,142 - lava_callback - DEBUG - Processing node 69ab77d8efa461f55e59d697: baseline-arm-pengutronix 2026-03-07 00:58:07,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:58:07,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:58:07,457 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab77d8efa461f55e59d697/log.txt.gz 2026-03-07 00:58:07,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:58:07,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:58:07,769 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab77d8efa461f55e59d697/lava-logs.yaml 2026-03-07 00:58:07,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:58:07,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:58:07,928 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab77d8efa461f55e59d697/lava_callback.json.gz 2026-03-07 00:58:07,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:07,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab77d8efa461f55e59d697 HTTP/1.1" 200 None 2026-03-07 00:58:07,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:07,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:58:07,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:08,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab77d8efa461f55e59d697 HTTP/1.1" 200 None 2026-03-07 00:58:08,008 - lava_callback - INFO - Completed processing callback for node 69ab77d8efa461f55e59d697 2026-03-07 00:58:11,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:11,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 00:58:14,622 - lava_callback - INFO - Received callback for node 69a8d514911a9cbe7f77d595 INFO: 172.20.0.1:42122 - "POST /node/69a8d514911a9cbe7f77d595 HTTP/1.0" 202 Accepted 2026-03-07 00:58:14,631 - lava_callback - INFO - Starting async job submit for node 69a8d514911a9cbe7f77d595 2026-03-07 00:58:14,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:14,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d514911a9cbe7f77d595 HTTP/1.1" 200 None 2026-03-07 00:58:14,648 - lava_callback - DEBUG - Processing node 69a8d514911a9cbe7f77d595: baseline-arm-baylibre 2026-03-07 00:58:14,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d514911a9cbe7f77d595 2026-03-07 00:58:14,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:14,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d514911a9cbe7f77d595 HTTP/1.1" 200 None 2026-03-07 00:58:14,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:14,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 00:58:14,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:14,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d514911a9cbe7f77d595 HTTP/1.1" 200 None 2026-03-07 00:58:14,704 - lava_callback - ERROR - Error processing callback for node 69a8d514911a9cbe7f77d595: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33736 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:58:29,133 - lava_callback - INFO - Received callback for node 69ab7644efa461f55e59d4e4 INFO: 172.20.0.1:33750 - "POST /node/69ab7644efa461f55e59d4e4 HTTP/1.0" 202 Accepted 2026-03-07 00:58:29,139 - lava_callback - INFO - Starting async job submit for node 69ab7644efa461f55e59d4e4 2026-03-07 00:58:29,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:29,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7644efa461f55e59d4e4 HTTP/1.1" 200 None 2026-03-07 00:58:29,179 - lava_callback - DEBUG - Processing node 69ab7644efa461f55e59d4e4: ltp-fsx 2026-03-07 00:58:29,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:58:29,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:58:29,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69ab7644efa461f55e59d4e4/log.txt.gz 2026-03-07 00:58:29,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:58:30,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:58:30,061 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69ab7644efa461f55e59d4e4/lava-logs.yaml 2026-03-07 00:58:30,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:58:30,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:58:30,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69ab7644efa461f55e59d4e4/lava_callback.json.gz 2026-03-07 00:58:30,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:30,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7644efa461f55e59d4e4 HTTP/1.1" 200 None 2026-03-07 00:58:30,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:30,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:58:30,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:30,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7644efa461f55e59d4e4 HTTP/1.1" 200 None 2026-03-07 00:58:30,358 - lava_callback - INFO - Completed processing callback for node 69ab7644efa461f55e59d4e4 INFO: 172.20.0.1:54638 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:58:41,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:41,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52512 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:58:54,603 - lava_callback - INFO - Received callback for node 69a8d53e911a9cbe7f77d5af INFO: 172.20.0.1:46626 - "POST /node/69a8d53e911a9cbe7f77d5af HTTP/1.0" 202 Accepted 2026-03-07 00:58:54,608 - lava_callback - INFO - Starting async job submit for node 69a8d53e911a9cbe7f77d5af 2026-03-07 00:58:54,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:54,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d53e911a9cbe7f77d5af HTTP/1.1" 200 None 2026-03-07 00:58:54,626 - lava_callback - DEBUG - Processing node 69a8d53e911a9cbe7f77d5af: baseline-arm-baylibre 2026-03-07 00:58:54,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d53e911a9cbe7f77d5af 2026-03-07 00:58:54,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:54,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d53e911a9cbe7f77d5af HTTP/1.1" 200 None 2026-03-07 00:58:54,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:54,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-07 00:58:54,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:58:54,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d53e911a9cbe7f77d5af HTTP/1.1" 200 None 2026-03-07 00:58:54,684 - lava_callback - ERROR - Error processing callback for node 69a8d53e911a9cbe7f77d5af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53226 - "GET / HTTP/1.0" 200 OK 2026-03-07 00:59:09,159 - lava_callback - INFO - Received callback for node 69ab7648efa461f55e59d4f1 INFO: 172.20.0.1:53242 - "POST /node/69ab7648efa461f55e59d4f1 HTTP/1.0" 202 Accepted 2026-03-07 00:59:09,172 - lava_callback - INFO - Starting async job submit for node 69ab7648efa461f55e59d4f1 2026-03-07 00:59:09,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:59:09,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7648efa461f55e59d4f1 HTTP/1.1" 200 None 2026-03-07 00:59:09,282 - lava_callback - DEBUG - Processing node 69ab7648efa461f55e59d4f1: ltp-pty 2026-03-07 00:59:09,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:59:09,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:59:09,903 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69ab7648efa461f55e59d4f1/log.txt.gz 2026-03-07 00:59:10,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:59:10,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:59:10,355 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69ab7648efa461f55e59d4f1/lava-logs.yaml 2026-03-07 00:59:10,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 00:59:10,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 00:59:10,553 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69ab7648efa461f55e59d4f1/lava_callback.json.gz 2026-03-07 00:59:10,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:59:10,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7648efa461f55e59d4f1 HTTP/1.1" 200 None 2026-03-07 00:59:10,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:59:10,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 00:59:10,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:59:10,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7648efa461f55e59d4f1 HTTP/1.1" 200 None 2026-03-07 00:59:10,661 - lava_callback - INFO - Completed processing callback for node 69ab7648efa461f55e59d4f1 2026-03-07 00:59:11,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 00:59:11,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57566 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:00:19,018 - lava_callback - INFO - Received callback for node 69ab764aefa461f55e59d4f4 INFO: 172.20.0.1:57572 - "POST /node/69ab764aefa461f55e59d4f4 HTTP/1.0" 202 Accepted 2026-03-07 01:00:19,024 - lava_callback - INFO - Starting async job submit for node 69ab764aefa461f55e59d4f4 2026-03-07 01:00:19,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:00:19,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab764aefa461f55e59d4f4 HTTP/1.1" 200 None 2026-03-07 01:00:19,065 - lava_callback - DEBUG - Processing node 69ab764aefa461f55e59d4f4: ltp-sched 2026-03-07 01:00:19,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:00:19,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:00:19,569 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69ab764aefa461f55e59d4f4/log.txt.gz 2026-03-07 01:00:19,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:00:20,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:00:20,100 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69ab764aefa461f55e59d4f4/lava-logs.yaml 2026-03-07 01:00:20,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:00:20,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:00:20,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69ab764aefa461f55e59d4f4/lava_callback.json.gz 2026-03-07 01:00:20,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:00:20,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab764aefa461f55e59d4f4 HTTP/1.1" 200 None 2026-03-07 01:00:20,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:00:20,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:00:20,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:00:20,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab764aefa461f55e59d4f4 HTTP/1.1" 200 None 2026-03-07 01:00:20,366 - lava_callback - INFO - Completed processing callback for node 69ab764aefa461f55e59d4f4 INFO: 172.20.0.1:56878 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:00:34,692 - lava_callback - INFO - Received callback for node 69a8d5b0911a9cbe7f77d617 INFO: 172.20.0.1:35348 - "POST /node/69a8d5b0911a9cbe7f77d617 HTTP/1.0" 202 Accepted 2026-03-07 01:00:34,697 - lava_callback - INFO - Starting async job submit for node 69a8d5b0911a9cbe7f77d617 2026-03-07 01:00:34,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:00:34,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b0911a9cbe7f77d617 HTTP/1.1" 200 None 2026-03-07 01:00:34,713 - lava_callback - DEBUG - Processing node 69a8d5b0911a9cbe7f77d617: baseline-arm-baylibre 2026-03-07 01:00:34,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d5b0911a9cbe7f77d617 2026-03-07 01:00:34,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:00:34,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5b0911a9cbe7f77d617 HTTP/1.1" 200 None 2026-03-07 01:00:34,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:00:34,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-07 01:00:34,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:00:34,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5b0911a9cbe7f77d617 HTTP/1.1" 200 None 2026-03-07 01:00:34,784 - lava_callback - ERROR - Error processing callback for node 69a8d5b0911a9cbe7f77d617: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35360 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:00:41,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:00:41,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54670 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:01:34,752 - lava_callback - INFO - Received callback for node 69a8d5de911a9cbe7f77d69f INFO: 172.20.0.1:34770 - "POST /node/69a8d5de911a9cbe7f77d69f HTTP/1.0" 202 Accepted 2026-03-07 01:01:34,762 - lava_callback - INFO - Starting async job submit for node 69a8d5de911a9cbe7f77d69f 2026-03-07 01:01:34,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:34,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5de911a9cbe7f77d69f HTTP/1.1" 200 None 2026-03-07 01:01:34,799 - lava_callback - DEBUG - Processing node 69a8d5de911a9cbe7f77d69f: baseline-arm64-baylibre 2026-03-07 01:01:34,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d5de911a9cbe7f77d69f 2026-03-07 01:01:34,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:34,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5de911a9cbe7f77d69f HTTP/1.1" 200 None 2026-03-07 01:01:34,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:34,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-07 01:01:34,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:34,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5de911a9cbe7f77d69f HTTP/1.1" 200 None 2026-03-07 01:01:34,902 - lava_callback - ERROR - Error processing callback for node 69a8d5de911a9cbe7f77d69f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 01:01:35,444 - lava_callback - INFO - Received callback for node 69a8d5e0911a9cbe7f77d6a3 INFO: 172.20.0.1:34778 - "POST /node/69a8d5e0911a9cbe7f77d6a3 HTTP/1.0" 202 Accepted 2026-03-07 01:01:35,456 - lava_callback - INFO - Starting async job submit for node 69a8d5e0911a9cbe7f77d6a3 2026-03-07 01:01:35,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:35,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5e0911a9cbe7f77d6a3 HTTP/1.1" 200 None 2026-03-07 01:01:35,491 - lava_callback - DEBUG - Processing node 69a8d5e0911a9cbe7f77d6a3: baseline-arm-baylibre 2026-03-07 01:01:35,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d5e0911a9cbe7f77d6a3 2026-03-07 01:01:35,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:35,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5e0911a9cbe7f77d6a3 HTTP/1.1" 200 None 2026-03-07 01:01:35,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:35,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-07 01:01:35,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:35,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5e0911a9cbe7f77d6a3 HTTP/1.1" 200 None 2026-03-07 01:01:35,580 - lava_callback - ERROR - Error processing callback for node 69a8d5e0911a9cbe7f77d6a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40242 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:01:49,235 - lava_callback - INFO - Received callback for node 69ab7645efa461f55e59d4e7 INFO: 172.20.0.1:40248 - "POST /node/69ab7645efa461f55e59d4e7 HTTP/1.0" 202 Accepted 2026-03-07 01:01:49,242 - lava_callback - INFO - Starting async job submit for node 69ab7645efa461f55e59d4e7 2026-03-07 01:01:49,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:49,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7645efa461f55e59d4e7 HTTP/1.1" 200 None 2026-03-07 01:01:49,295 - lava_callback - DEBUG - Processing node 69ab7645efa461f55e59d4e7: ltp-input 2026-03-07 01:01:49,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:01:50,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:01:50,040 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69ab7645efa461f55e59d4e7/log.txt.gz 2026-03-07 01:01:50,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:01:50,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:01:50,792 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69ab7645efa461f55e59d4e7/lava-logs.yaml 2026-03-07 01:01:50,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:01:50,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:01:50,976 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69ab7645efa461f55e59d4e7/lava_callback.json.gz 2026-03-07 01:01:51,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:51,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7645efa461f55e59d4e7 HTTP/1.1" 200 None 2026-03-07 01:01:51,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:51,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:01:51,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:51,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7645efa461f55e59d4e7 HTTP/1.1" 200 None 2026-03-07 01:01:51,099 - lava_callback - INFO - Completed processing callback for node 69ab7645efa461f55e59d4e7 2026-03-07 01:01:53,773 - lava_callback - INFO - Received callback for node 69a8d5f9911a9cbe7f77d701 INFO: 172.20.0.1:59534 - "POST /node/69a8d5f9911a9cbe7f77d701 HTTP/1.0" 202 Accepted 2026-03-07 01:01:53,782 - lava_callback - INFO - Starting async job submit for node 69a8d5f9911a9cbe7f77d701 2026-03-07 01:01:53,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:53,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f9911a9cbe7f77d701 HTTP/1.1" 200 None 2026-03-07 01:01:53,813 - lava_callback - DEBUG - Processing node 69a8d5f9911a9cbe7f77d701: baseline-arm64-clabbe 2026-03-07 01:01:53,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d5f9911a9cbe7f77d701 2026-03-07 01:01:53,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:53,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d5f9911a9cbe7f77d701 HTTP/1.1" 200 None 2026-03-07 01:01:53,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:53,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-07 01:01:53,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:01:53,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d5f9911a9cbe7f77d701 HTTP/1.1" 200 None 2026-03-07 01:01:53,916 - lava_callback - ERROR - Error processing callback for node 69a8d5f9911a9cbe7f77d701: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55022 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:02:11,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:02:11,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37948 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:02:29,263 - lava_callback - INFO - Received callback for node 69ab764befa461f55e59d4f7 INFO: 172.20.0.1:37956 - "POST /node/69ab764befa461f55e59d4f7 HTTP/1.0" 202 Accepted 2026-03-07 01:02:29,274 - lava_callback - INFO - Starting async job submit for node 69ab764befa461f55e59d4f7 2026-03-07 01:02:29,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:02:29,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab764befa461f55e59d4f7 HTTP/1.1" 200 None 2026-03-07 01:02:29,404 - lava_callback - DEBUG - Processing node 69ab764befa461f55e59d4f7: ltp-smoke 2026-03-07 01:02:29,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:02:30,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:02:30,285 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab764befa461f55e59d4f7/log.txt.gz 2026-03-07 01:02:30,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:02:31,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:02:31,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab764befa461f55e59d4f7/lava-logs.yaml 2026-03-07 01:02:31,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:02:31,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:02:31,247 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab764befa461f55e59d4f7/lava_callback.json.gz 2026-03-07 01:02:31,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:02:31,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab764befa461f55e59d4f7 HTTP/1.1" 200 None 2026-03-07 01:02:31,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:02:31,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:02:31,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:02:31,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab764befa461f55e59d4f7 HTTP/1.1" 200 None 2026-03-07 01:02:31,336 - lava_callback - INFO - Completed processing callback for node 69ab764befa461f55e59d4f7 INFO: 172.20.0.1:60266 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:02:41,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:02:41,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46302 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:03:14,972 - lava_callback - INFO - Received callback for node 69a8d64e911a9cbe7f77d7df INFO: 172.20.0.1:49512 - "POST /node/69a8d64e911a9cbe7f77d7df HTTP/1.0" 202 Accepted 2026-03-07 01:03:14,977 - lava_callback - INFO - Starting async job submit for node 69a8d64e911a9cbe7f77d7df 2026-03-07 01:03:14,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:14,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64e911a9cbe7f77d7df HTTP/1.1" 200 None 2026-03-07 01:03:14,993 - lava_callback - DEBUG - Processing node 69a8d64e911a9cbe7f77d7df: baseline-arm-baylibre 2026-03-07 01:03:14,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d64e911a9cbe7f77d7df 2026-03-07 01:03:14,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:15,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d64e911a9cbe7f77d7df HTTP/1.1" 200 None 2026-03-07 01:03:15,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:15,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-07 01:03:15,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:15,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d64e911a9cbe7f77d7df HTTP/1.1" 200 None 2026-03-07 01:03:15,060 - lava_callback - ERROR - Error processing callback for node 69a8d64e911a9cbe7f77d7df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36294 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:03:33,699 - lava_callback - INFO - Received callback for node 69a8d662911a9cbe7f77d882 INFO: 172.20.0.1:51404 - "POST /node/69a8d662911a9cbe7f77d882 HTTP/1.0" 202 Accepted 2026-03-07 01:03:33,704 - lava_callback - INFO - Starting async job submit for node 69a8d662911a9cbe7f77d882 2026-03-07 01:03:33,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:33,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d662911a9cbe7f77d882 HTTP/1.1" 200 None 2026-03-07 01:03:33,720 - lava_callback - DEBUG - Processing node 69a8d662911a9cbe7f77d882: baseline-arm-clabbe 2026-03-07 01:03:33,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d662911a9cbe7f77d882 2026-03-07 01:03:33,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:33,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d662911a9cbe7f77d882 HTTP/1.1" 200 None 2026-03-07 01:03:33,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:33,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-07 01:03:33,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:33,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d662911a9cbe7f77d882 HTTP/1.1" 200 None 2026-03-07 01:03:33,796 - lava_callback - ERROR - Error processing callback for node 69a8d662911a9cbe7f77d882: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39684 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:03:49,323 - lava_callback - INFO - Received callback for node 69ab764eefa461f55e59d4fd INFO: 172.20.0.1:39694 - "POST /node/69ab764eefa461f55e59d4fd HTTP/1.0" 202 Accepted 2026-03-07 01:03:49,330 - lava_callback - INFO - Starting async job submit for node 69ab764eefa461f55e59d4fd 2026-03-07 01:03:49,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:49,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab764eefa461f55e59d4fd HTTP/1.1" 200 None 2026-03-07 01:03:49,394 - lava_callback - DEBUG - Processing node 69ab764eefa461f55e59d4fd: ltp-syscalls-ipc 2026-03-07 01:03:49,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:03:50,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:03:50,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ab764eefa461f55e59d4fd/log.txt.gz 2026-03-07 01:03:50,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:03:50,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:03:50,698 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ab764eefa461f55e59d4fd/lava-logs.yaml 2026-03-07 01:03:50,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:03:50,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:03:50,970 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ab764eefa461f55e59d4fd/lava_callback.json.gz 2026-03-07 01:03:51,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:51,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab764eefa461f55e59d4fd HTTP/1.1" 200 None 2026-03-07 01:03:51,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:51,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:03:51,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:51,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab764eefa461f55e59d4fd HTTP/1.1" 200 None 2026-03-07 01:03:51,131 - lava_callback - INFO - Completed processing callback for node 69ab764eefa461f55e59d4fd 2026-03-07 01:03:53,608 - lava_callback - INFO - Received callback for node 69a8d668911a9cbe7f77d89c INFO: 172.20.0.1:58548 - "POST /node/69a8d668911a9cbe7f77d89c HTTP/1.0" 202 Accepted 2026-03-07 01:03:53,614 - lava_callback - INFO - Starting async job submit for node 69a8d668911a9cbe7f77d89c 2026-03-07 01:03:53,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:53,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d668911a9cbe7f77d89c HTTP/1.1" 200 None 2026-03-07 01:03:53,637 - lava_callback - DEBUG - Processing node 69a8d668911a9cbe7f77d89c: baseline-arm-clabbe 2026-03-07 01:03:53,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8d668911a9cbe7f77d89c 2026-03-07 01:03:53,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:53,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8d668911a9cbe7f77d89c HTTP/1.1" 200 None 2026-03-07 01:03:53,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:53,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-07 01:03:53,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:03:53,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8d668911a9cbe7f77d89c HTTP/1.1" 200 None 2026-03-07 01:03:53,722 - lava_callback - ERROR - Error processing callback for node 69a8d668911a9cbe7f77d89c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52096 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:04:11,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:04:11,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48350 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:06:08,276 - lava_callback - INFO - Received callback for node 69ab7604efa461f55e59d3ea INFO: 172.20.0.1:48362 - "POST /node/69ab7604efa461f55e59d3ea HTTP/1.0" 202 Accepted 2026-03-07 01:06:08,287 - lava_callback - INFO - Starting async job submit for node 69ab7604efa461f55e59d3ea 2026-03-07 01:06:08,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:08,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7604efa461f55e59d3ea HTTP/1.1" 200 None 2026-03-07 01:06:08,490 - lava_callback - DEBUG - Processing node 69ab7604efa461f55e59d3ea: baseline-arm 2026-03-07 01:06:09,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:06:09,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:06:09,434 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7604efa461f55e59d3ea/log.txt.gz 2026-03-07 01:06:09,475 - lava_callback - INFO - Received callback for node 69ab7650efa461f55e59d500 INFO: 172.20.0.1:48372 - "POST /node/69ab7650efa461f55e59d500 HTTP/1.0" 202 Accepted 2026-03-07 01:06:09,513 - lava_callback - INFO - Starting async job submit for node 69ab7650efa461f55e59d500 2026-03-07 01:06:09,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:09,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7650efa461f55e59d500 HTTP/1.1" 200 None 2026-03-07 01:06:09,676 - lava_callback - DEBUG - Processing node 69ab7650efa461f55e59d500: ltp-timers 2026-03-07 01:06:10,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:06:10,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:06:10,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:06:10,934 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69ab7650efa461f55e59d500/log.txt.gz 2026-03-07 01:06:11,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:06:11,116 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7604efa461f55e59d3ea/lava-logs.yaml 2026-03-07 01:06:11,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:06:11,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:06:11,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:06:11,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7604efa461f55e59d3ea/lava_callback.json.gz 2026-03-07 01:06:11,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:06:11,961 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69ab7650efa461f55e59d500/lava-logs.yaml 2026-03-07 01:06:11,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 DEBUG: Setup failed for 69ab7604efa461f55e59d3ea. Transitting job node result: incomplete -> fail 2026-03-07 01:06:12,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:12,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7604efa461f55e59d3ea HTTP/1.1" 200 None 2026-03-07 01:06:12,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:12,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:06:12,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:12,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7604efa461f55e59d3ea HTTP/1.1" 200 None 2026-03-07 01:06:12,395 - lava_callback - INFO - Completed processing callback for node 69ab7604efa461f55e59d3ea 2026-03-07 01:06:12,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:06:12,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69ab7650efa461f55e59d500/lava_callback.json.gz 2026-03-07 01:06:12,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:12,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7650efa461f55e59d500 HTTP/1.1" 200 None 2026-03-07 01:06:12,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:12,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:06:12,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:12,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7650efa461f55e59d500 HTTP/1.1" 200 None 2026-03-07 01:06:12,557 - lava_callback - INFO - Completed processing callback for node 69ab7650efa461f55e59d500 INFO: 172.20.0.1:51238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34444 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:06:41,219 - lava_callback - INFO - Received callback for node 69ab7651efa461f55e59d503 INFO: 172.20.0.1:50984 - "POST /node/69ab7651efa461f55e59d503 HTTP/1.0" 202 Accepted 2026-03-07 01:06:41,232 - lava_callback - INFO - Starting async job submit for node 69ab7651efa461f55e59d503 2026-03-07 01:06:41,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:41,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7651efa461f55e59d503 HTTP/1.1" 200 None 2026-03-07 01:06:41,312 - lava_callback - DEBUG - Processing node 69ab7651efa461f55e59d503: ltp-watchqueue 2026-03-07 01:06:41,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:06:41,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:41,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 01:06:42,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:06:42,326 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ab7651efa461f55e59d503/log.txt.gz 2026-03-07 01:06:42,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:06:42,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:06:42,785 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ab7651efa461f55e59d503/lava-logs.yaml 2026-03-07 01:06:42,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:06:42,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:06:42,957 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ab7651efa461f55e59d503/lava_callback.json.gz 2026-03-07 01:06:42,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:43,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7651efa461f55e59d503 HTTP/1.1" 200 None 2026-03-07 01:06:43,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:43,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:06:43,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:06:43,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7651efa461f55e59d503 HTTP/1.1" 200 None 2026-03-07 01:06:43,061 - lava_callback - INFO - Completed processing callback for node 69ab7651efa461f55e59d503 INFO: 172.20.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36978 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:07:11,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:07:11,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35178 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:08:50,724 - lava_callback - INFO - Received callback for node 69ab7618efa461f55e59d430 INFO: 172.20.0.1:47950 - "POST /node/69ab7618efa461f55e59d430 HTTP/1.0" 202 Accepted 2026-03-07 01:08:50,729 - lava_callback - INFO - Starting async job submit for node 69ab7618efa461f55e59d430 2026-03-07 01:08:50,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:08:50,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7618efa461f55e59d430 HTTP/1.1" 200 None 2026-03-07 01:08:50,775 - lava_callback - DEBUG - Processing node 69ab7618efa461f55e59d430: baseline-arm-clabbe 2026-03-07 01:08:50,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:08:51,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:08:51,140 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab7618efa461f55e59d430/log.txt.gz 2026-03-07 01:08:51,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:08:51,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:08:51,461 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab7618efa461f55e59d430/lava-logs.yaml 2026-03-07 01:08:51,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:08:51,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:08:51,597 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab7618efa461f55e59d430/lava_callback.json.gz DEBUG: Setup failed for 69ab7618efa461f55e59d430. Transitting job node result: incomplete -> fail 2026-03-07 01:08:51,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:08:51,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7618efa461f55e59d430 HTTP/1.1" 200 None 2026-03-07 01:08:51,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:08:51,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:08:51,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:08:51,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7618efa461f55e59d430 HTTP/1.1" 200 None 2026-03-07 01:08:51,794 - lava_callback - INFO - Completed processing callback for node 69ab7618efa461f55e59d430 INFO: 172.20.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39398 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:09:11,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:09:11,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51318 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:09:19,515 - lava_callback - INFO - Received callback for node 69ab7628efa461f55e59d495 INFO: 172.20.0.1:51328 - "POST /node/69ab7628efa461f55e59d495 HTTP/1.0" 202 Accepted 2026-03-07 01:09:19,561 - lava_callback - INFO - Starting async job submit for node 69ab7628efa461f55e59d495 2026-03-07 01:09:19,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:09:19,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7628efa461f55e59d495 HTTP/1.1" 200 None 2026-03-07 01:09:19,601 - lava_callback - DEBUG - Processing node 69ab7628efa461f55e59d495: baseline-arm-pengutronix 2026-03-07 01:09:19,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:09:19,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:09:19,880 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7628efa461f55e59d495/log.txt.gz 2026-03-07 01:09:19,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:09:20,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:09:20,132 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7628efa461f55e59d495/lava-logs.yaml 2026-03-07 01:09:20,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:09:20,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:09:20,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7628efa461f55e59d495/lava_callback.json.gz DEBUG: Setup failed for 69ab7628efa461f55e59d495. Transitting job node result: incomplete -> fail 2026-03-07 01:09:20,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:09:20,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7628efa461f55e59d495 HTTP/1.1" 200 None 2026-03-07 01:09:20,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:09:20,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:09:20,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:09:20,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7628efa461f55e59d495 HTTP/1.1" 200 None 2026-03-07 01:09:20,443 - lava_callback - INFO - Completed processing callback for node 69ab7628efa461f55e59d495 INFO: 172.20.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37110 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:09:41,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:09:42,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56326 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:11:19,861 - lava_callback - INFO - Received callback for node 69ab7711efa461f55e59d5e5 INFO: 172.20.0.1:55786 - "POST /node/69ab7711efa461f55e59d5e5 HTTP/1.0" 202 Accepted 2026-03-07 01:11:19,868 - lava_callback - INFO - Starting async job submit for node 69ab7711efa461f55e59d5e5 2026-03-07 01:11:19,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:11:19,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7711efa461f55e59d5e5 HTTP/1.1" 200 None 2026-03-07 01:11:19,940 - lava_callback - DEBUG - Processing node 69ab7711efa461f55e59d5e5: ltp-smoke 2026-03-07 01:11:20,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:11:20,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:11:20,565 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab7711efa461f55e59d5e5/log.txt.gz 2026-03-07 01:11:20,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:11:21,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:11:21,089 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab7711efa461f55e59d5e5/lava-logs.yaml 2026-03-07 01:11:21,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:11:21,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:11:21,273 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab7711efa461f55e59d5e5/lava_callback.json.gz 2026-03-07 01:11:21,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:11:21,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7711efa461f55e59d5e5 HTTP/1.1" 200 None 2026-03-07 01:11:21,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:11:21,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e3aefa461f55e59cdbd HTTP/1.1" 200 None 2026-03-07 01:11:21,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:11:21,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7711efa461f55e59d5e5 HTTP/1.1" 200 None 2026-03-07 01:11:21,607 - lava_callback - INFO - Completed processing callback for node 69ab7711efa461f55e59d5e5 INFO: 172.20.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54954 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:11:42,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:11:42,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52960 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:16:29,867 - lava_callback - INFO - Received callback for node 69ab7647efa461f55e59d4ee INFO: 172.20.0.1:50144 - "POST /node/69ab7647efa461f55e59d4ee HTTP/1.0" 202 Accepted 2026-03-07 01:16:29,917 - lava_callback - INFO - Starting async job submit for node 69ab7647efa461f55e59d4ee 2026-03-07 01:16:29,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:16:30,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7647efa461f55e59d4ee HTTP/1.1" 200 None 2026-03-07 01:16:30,001 - lava_callback - DEBUG - Processing node 69ab7647efa461f55e59d4ee: ltp-ipc 2026-03-07 01:16:30,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:16:30,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:16:30,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69ab7647efa461f55e59d4ee/log.txt.gz 2026-03-07 01:16:30,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:16:30,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:16:30,642 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69ab7647efa461f55e59d4ee/lava-logs.yaml 2026-03-07 01:16:30,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:16:30,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:16:30,814 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69ab7647efa461f55e59d4ee/lava_callback.json.gz 2026-03-07 01:16:30,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:16:30,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7647efa461f55e59d4ee HTTP/1.1" 200 None 2026-03-07 01:16:30,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:16:30,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:16:30,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:16:30,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7647efa461f55e59d4ee HTTP/1.1" 200 None 2026-03-07 01:16:31,048 - lava_callback - INFO - Completed processing callback for node 69ab7647efa461f55e59d4ee INFO: 172.20.0.1:50154 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:16:42,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:16:42,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59102 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:19:10,007 - lava_callback - INFO - Received callback for node 69ab7cf9efa461f55e59d9c8 INFO: 172.20.0.1:60834 - "POST /node/69ab7cf9efa461f55e59d9c8 HTTP/1.0" 202 Accepted 2026-03-07 01:19:10,017 - lava_callback - INFO - Starting async job submit for node 69ab7cf9efa461f55e59d9c8 2026-03-07 01:19:10,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:10,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf9efa461f55e59d9c8 HTTP/1.1" 200 None 2026-03-07 01:19:10,042 - lava_callback - DEBUG - Processing node 69ab7cf9efa461f55e59d9c8: baseline-nfs-arm64 2026-03-07 01:19:10,044 - lava_callback - WARNING - Failed to upload log 2026-03-07 01:19:10,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:19:10,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:19:10,224 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf9efa461f55e59d9c8/lava-logs.yaml 2026-03-07 01:19:10,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:19:10,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:19:10,389 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf9efa461f55e59d9c8/lava_callback.json.gz 2026-03-07 01:19:10,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:10,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf9efa461f55e59d9c8 HTTP/1.1" 200 None 2026-03-07 01:19:10,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:10,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:19:10,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:10,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cf9efa461f55e59d9c8 HTTP/1.1" 200 None 2026-03-07 01:19:10,477 - lava_callback - INFO - Completed processing callback for node 69ab7cf9efa461f55e59d9c8 2026-03-07 01:19:12,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:12,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60858 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:19:19,613 - lava_callback - INFO - Received callback for node 69ab7ce9efa461f55e59d984 INFO: 172.20.0.1:60860 - "POST /node/69ab7ce9efa461f55e59d984 HTTP/1.0" 202 Accepted 2026-03-07 01:19:19,619 - lava_callback - INFO - Starting async job submit for node 69ab7ce9efa461f55e59d984 2026-03-07 01:19:19,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:19,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce9efa461f55e59d984 HTTP/1.1" 200 None 2026-03-07 01:19:19,651 - lava_callback - DEBUG - Processing node 69ab7ce9efa461f55e59d984: baseline-arm64 2026-03-07 01:19:19,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:19:19,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:19:19,997 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce9efa461f55e59d984/log.txt.gz 2026-03-07 01:19:20,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:19:20,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:19:20,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce9efa461f55e59d984/lava-logs.yaml 2026-03-07 01:19:20,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:19:20,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:19:20,431 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce9efa461f55e59d984/lava_callback.json.gz 2026-03-07 01:19:20,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:20,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce9efa461f55e59d984 HTTP/1.1" 200 None 2026-03-07 01:19:20,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:20,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:19:20,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:20,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7ce9efa461f55e59d984 HTTP/1.1" 200 None 2026-03-07 01:19:20,541 - lava_callback - INFO - Completed processing callback for node 69ab7ce9efa461f55e59d984 INFO: 172.20.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55428 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:19:42,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:42,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 01:19:45,048 - lava_callback - INFO - Received callback for node 69ab7cdeefa461f55e59d962 INFO: 172.20.0.1:35316 - "POST /node/69ab7cdeefa461f55e59d962 HTTP/1.0" 202 Accepted 2026-03-07 01:19:45,059 - lava_callback - INFO - Starting async job submit for node 69ab7cdeefa461f55e59d962 2026-03-07 01:19:45,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:45,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cdeefa461f55e59d962 HTTP/1.1" 200 None 2026-03-07 01:19:45,115 - lava_callback - DEBUG - Processing node 69ab7cdeefa461f55e59d962: baseline-arm64 2026-03-07 01:19:45,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:19:45,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:19:45,409 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cdeefa461f55e59d962/log.txt.gz 2026-03-07 01:19:45,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:19:45,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:19:45,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cdeefa461f55e59d962/lava-logs.yaml 2026-03-07 01:19:45,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:19:45,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:19:45,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cdeefa461f55e59d962/lava_callback.json.gz 2026-03-07 01:19:45,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:45,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cdeefa461f55e59d962 HTTP/1.1" 200 None 2026-03-07 01:19:45,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:45,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:19:45,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:19:45,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cdeefa461f55e59d962 HTTP/1.1" 200 None 2026-03-07 01:19:45,913 - lava_callback - INFO - Completed processing callback for node 69ab7cdeefa461f55e59d962 INFO: 172.20.0.1:35330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58174 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:20:07,962 - lava_callback - INFO - Received callback for node 69ab7cdfefa461f55e59d968 INFO: 172.20.0.1:58190 - "POST /node/69ab7cdfefa461f55e59d968 HTTP/1.0" 202 Accepted 2026-03-07 01:20:07,974 - lava_callback - INFO - Starting async job submit for node 69ab7cdfefa461f55e59d968 2026-03-07 01:20:08,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:08,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cdfefa461f55e59d968 HTTP/1.1" 200 None 2026-03-07 01:20:08,048 - lava_callback - DEBUG - Processing node 69ab7cdfefa461f55e59d968: baseline-arm64 2026-03-07 01:20:08,352 - lava_callback - INFO - Received callback for node 69ab7cdeefa461f55e59d965 INFO: 172.20.0.1:58202 - "POST /node/69ab7cdeefa461f55e59d965 HTTP/1.0" 202 Accepted 2026-03-07 01:20:08,375 - lava_callback - INFO - Starting async job submit for node 69ab7cdeefa461f55e59d965 2026-03-07 01:20:08,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:08,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cdeefa461f55e59d965 HTTP/1.1" 200 None 2026-03-07 01:20:08,570 - lava_callback - DEBUG - Processing node 69ab7cdeefa461f55e59d965: baseline-arm64 2026-03-07 01:20:08,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:09,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:09,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:09,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cdfefa461f55e59d968/log.txt.gz 2026-03-07 01:20:09,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:09,358 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cdeefa461f55e59d965/log.txt.gz 2026-03-07 01:20:09,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:09,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:10,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:10,158 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cdfefa461f55e59d968/lava-logs.yaml 2026-03-07 01:20:10,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:10,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:10,173 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cdeefa461f55e59d965/lava-logs.yaml 2026-03-07 01:20:10,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:10,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:10,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cdfefa461f55e59d968/lava_callback.json.gz 2026-03-07 01:20:10,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:10,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cdeefa461f55e59d965/lava_callback.json.gz 2026-03-07 01:20:10,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:10,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:10,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cdfefa461f55e59d968 HTTP/1.1" 200 None 2026-03-07 01:20:10,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:10,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cdeefa461f55e59d965 HTTP/1.1" 200 None 2026-03-07 01:20:10,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:10,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:20:10,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:10,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:20:10,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:10,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cdfefa461f55e59d968 HTTP/1.1" 200 None 2026-03-07 01:20:10,759 - lava_callback - INFO - Completed processing callback for node 69ab7cdfefa461f55e59d968 2026-03-07 01:20:10,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cdeefa461f55e59d965 HTTP/1.1" 200 None 2026-03-07 01:20:10,767 - lava_callback - INFO - Completed processing callback for node 69ab7cdeefa461f55e59d965 2026-03-07 01:20:12,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:12,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52268 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 01:20:16,062 - lava_callback - INFO - Received callback for node 69a8da4a911a9cbe7f77dd08 INFO: 172.20.0.1:52280 - "POST /node/69a8da4a911a9cbe7f77dd08 HTTP/1.0" 202 Accepted 2026-03-07 01:20:16,070 - lava_callback - INFO - Starting async job submit for node 69a8da4a911a9cbe7f77dd08 2026-03-07 01:20:16,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:16,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8da4a911a9cbe7f77dd08 HTTP/1.1" 200 None 2026-03-07 01:20:16,096 - lava_callback - DEBUG - Processing node 69a8da4a911a9cbe7f77dd08: baseline-arm-baylibre 2026-03-07 01:20:16,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8da4a911a9cbe7f77dd08 2026-03-07 01:20:16,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:16,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8da4a911a9cbe7f77dd08 HTTP/1.1" 200 None 2026-03-07 01:20:16,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:16,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-07 01:20:16,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:16,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8da4a911a9cbe7f77dd08 HTTP/1.1" 200 None 2026-03-07 01:20:16,159 - lava_callback - ERROR - Error processing callback for node 69a8da4a911a9cbe7f77dd08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51900 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:20:31,416 - lava_callback - INFO - Received callback for node 69ab7d28efa461f55e59da56 INFO: 172.20.0.1:44798 - "POST /node/69ab7d28efa461f55e59da56 HTTP/1.0" 202 Accepted 2026-03-07 01:20:31,426 - lava_callback - INFO - Starting async job submit for node 69ab7d28efa461f55e59da56 2026-03-07 01:20:31,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:31,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d28efa461f55e59da56 HTTP/1.1" 200 None 2026-03-07 01:20:31,504 - lava_callback - DEBUG - Processing node 69ab7d28efa461f55e59da56: baseline-arm64-foundriesio 2026-03-07 01:20:31,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:32,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:32,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab7d28efa461f55e59da56/log.txt.gz 2026-03-07 01:20:32,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:33,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:33,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab7d28efa461f55e59da56/lava-logs.yaml 2026-03-07 01:20:33,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:33,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:33,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab7d28efa461f55e59da56/lava_callback.json.gz 2026-03-07 01:20:33,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:33,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d28efa461f55e59da56 HTTP/1.1" 200 None 2026-03-07 01:20:33,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:33,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:20:33,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:33,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d28efa461f55e59da56 HTTP/1.1" 200 None 2026-03-07 01:20:33,469 - lava_callback - INFO - Completed processing callback for node 69ab7d28efa461f55e59da56 INFO: 172.20.0.1:44804 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:20:38,444 - lava_callback - INFO - Received callback for node 69ab7d24efa461f55e59da4d INFO: 172.20.0.1:44808 - "POST /node/69ab7d24efa461f55e59da4d HTTP/1.0" 202 Accepted 2026-03-07 01:20:38,450 - lava_callback - INFO - Starting async job submit for node 69ab7d24efa461f55e59da4d 2026-03-07 01:20:38,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:38,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d24efa461f55e59da4d HTTP/1.1" 200 None 2026-03-07 01:20:38,489 - lava_callback - DEBUG - Processing node 69ab7d24efa461f55e59da4d: baseline-arm64-pengutronix 2026-03-07 01:20:38,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:39,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:39,024 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab7d24efa461f55e59da4d/log.txt.gz 2026-03-07 01:20:39,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:39,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:39,753 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab7d24efa461f55e59da4d/lava-logs.yaml 2026-03-07 01:20:39,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:39,990 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:39,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab7d24efa461f55e59da4d/lava_callback.json.gz 2026-03-07 01:20:40,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:40,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d24efa461f55e59da4d HTTP/1.1" 200 None 2026-03-07 01:20:40,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:40,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:20:40,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:40,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d24efa461f55e59da4d HTTP/1.1" 200 None 2026-03-07 01:20:40,143 - lava_callback - INFO - Completed processing callback for node 69ab7d24efa461f55e59da4d 2026-03-07 01:20:42,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:42,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 01:20:45,717 - lava_callback - INFO - Received callback for node 69ab7d26efa461f55e59da50 INFO: 172.20.0.1:42978 - "POST /node/69ab7d26efa461f55e59da50 HTTP/1.0" 202 Accepted 2026-03-07 01:20:45,729 - lava_callback - INFO - Starting async job submit for node 69ab7d26efa461f55e59da50 2026-03-07 01:20:45,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:45,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d26efa461f55e59da50 HTTP/1.1" 200 None 2026-03-07 01:20:45,798 - lava_callback - DEBUG - Processing node 69ab7d26efa461f55e59da50: baseline-arm64-pengutronix 2026-03-07 01:20:46,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:42992 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:20:46,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:46,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab7d26efa461f55e59da50/log.txt.gz 2026-03-07 01:20:46,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:47,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:47,275 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab7d26efa461f55e59da50/lava-logs.yaml 2026-03-07 01:20:47,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:47,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:47,496 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab7d26efa461f55e59da50/lava_callback.json.gz 2026-03-07 01:20:47,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:47,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d26efa461f55e59da50 HTTP/1.1" 200 None 2026-03-07 01:20:47,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:47,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:20:47,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:47,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d26efa461f55e59da50 HTTP/1.1" 200 None 2026-03-07 01:20:47,633 - lava_callback - INFO - Completed processing callback for node 69ab7d26efa461f55e59da50 2026-03-07 01:20:49,936 - lava_callback - INFO - Received callback for node 69ab7d5fefa461f55e59da9d INFO: 172.20.0.1:45936 - "POST /node/69ab7d5fefa461f55e59da9d HTTP/1.0" 202 Accepted 2026-03-07 01:20:49,945 - lava_callback - INFO - Starting async job submit for node 69ab7d5fefa461f55e59da9d 2026-03-07 01:20:49,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:49,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d5fefa461f55e59da9d HTTP/1.1" 200 None 2026-03-07 01:20:49,975 - lava_callback - DEBUG - Processing node 69ab7d5fefa461f55e59da9d: baseline-nfs-arm64 2026-03-07 01:20:49,977 - lava_callback - WARNING - Failed to upload log 2026-03-07 01:20:49,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:50,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:50,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7d5fefa461f55e59da9d/lava-logs.yaml 2026-03-07 01:20:50,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:50,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:50,371 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7d5fefa461f55e59da9d/lava_callback.json.gz 2026-03-07 01:20:50,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:50,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d5fefa461f55e59da9d HTTP/1.1" 200 None 2026-03-07 01:20:50,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:50,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:20:50,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:50,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d5fefa461f55e59da9d HTTP/1.1" 200 None 2026-03-07 01:20:50,453 - lava_callback - INFO - Completed processing callback for node 69ab7d5fefa461f55e59da9d INFO: 172.20.0.1:45938 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:20:56,679 - lava_callback - INFO - Received callback for node 69ab7d27efa461f55e59da53 INFO: 172.20.0.1:45948 - "POST /node/69ab7d27efa461f55e59da53 HTTP/1.0" 202 Accepted 2026-03-07 01:20:56,686 - lava_callback - INFO - Starting async job submit for node 69ab7d27efa461f55e59da53 2026-03-07 01:20:56,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:56,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d27efa461f55e59da53 HTTP/1.1" 200 None 2026-03-07 01:20:56,722 - lava_callback - DEBUG - Processing node 69ab7d27efa461f55e59da53: baseline-arm64-pengutronix 2026-03-07 01:20:57,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:57,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:57,352 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab7d27efa461f55e59da53/log.txt.gz 2026-03-07 01:20:57,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:57,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:57,913 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab7d27efa461f55e59da53/lava-logs.yaml 2026-03-07 01:20:57,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:20:58,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:20:58,110 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ab7d27efa461f55e59da53/lava_callback.json.gz 2026-03-07 01:20:58,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:58,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d27efa461f55e59da53 HTTP/1.1" 200 None 2026-03-07 01:20:58,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:58,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:20:58,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:20:58,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d27efa461f55e59da53 HTTP/1.1" 200 None 2026-03-07 01:20:58,194 - lava_callback - INFO - Completed processing callback for node 69ab7d27efa461f55e59da53 INFO: 172.20.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53508 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:21:12,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:12,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55914 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:21:20,884 - lava_callback - INFO - Received callback for node 69ab7d1defa461f55e59da3b INFO: 172.20.0.1:51588 - "POST /node/69ab7d1defa461f55e59da3b HTTP/1.0" 202 Accepted 2026-03-07 01:21:20,894 - lava_callback - INFO - Starting async job submit for node 69ab7d1defa461f55e59da3b 2026-03-07 01:21:20,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:20,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d1defa461f55e59da3b HTTP/1.1" 200 None 2026-03-07 01:21:20,977 - lava_callback - DEBUG - Processing node 69ab7d1defa461f55e59da3b: baseline-arm64-clabbe 2026-03-07 01:21:21,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:21,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:21,865 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d1defa461f55e59da3b/log.txt.gz 2026-03-07 01:21:22,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:22,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:22,574 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d1defa461f55e59da3b/lava-logs.yaml 2026-03-07 01:21:22,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:22,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:22,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d1defa461f55e59da3b/lava_callback.json.gz 2026-03-07 01:21:22,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:22,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d1defa461f55e59da3b HTTP/1.1" 200 None 2026-03-07 01:21:22,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:22,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:21:22,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:22,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d1defa461f55e59da3b HTTP/1.1" 200 None 2026-03-07 01:21:22,875 - lava_callback - INFO - Completed processing callback for node 69ab7d1defa461f55e59da3b INFO: 172.20.0.1:51602 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:21:26,540 - lava_callback - INFO - Received callback for node 69ab7d20efa461f55e59da44 INFO: 172.20.0.1:51612 - "POST /node/69ab7d20efa461f55e59da44 HTTP/1.0" 202 Accepted 2026-03-07 01:21:26,546 - lava_callback - INFO - Starting async job submit for node 69ab7d20efa461f55e59da44 2026-03-07 01:21:26,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:26,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d20efa461f55e59da44 HTTP/1.1" 200 None 2026-03-07 01:21:26,613 - lava_callback - DEBUG - Processing node 69ab7d20efa461f55e59da44: baseline-arm64-clabbe 2026-03-07 01:21:26,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:27,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:27,210 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d20efa461f55e59da44/log.txt.gz 2026-03-07 01:21:27,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:27,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:27,896 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d20efa461f55e59da44/lava-logs.yaml 2026-03-07 01:21:27,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:28,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:28,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d20efa461f55e59da44/lava_callback.json.gz 2026-03-07 01:21:28,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:28,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d20efa461f55e59da44 HTTP/1.1" 200 None 2026-03-07 01:21:28,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:28,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:21:28,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:28,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d20efa461f55e59da44 HTTP/1.1" 200 None 2026-03-07 01:21:28,186 - lava_callback - INFO - Completed processing callback for node 69ab7d20efa461f55e59da44 2026-03-07 01:21:32,587 - lava_callback - INFO - Received callback for node 69ab7d1eefa461f55e59da3e INFO: 172.20.0.1:34714 - "POST /node/69ab7d1eefa461f55e59da3e HTTP/1.0" 202 Accepted 2026-03-07 01:21:32,597 - lava_callback - INFO - Starting async job submit for node 69ab7d1eefa461f55e59da3e 2026-03-07 01:21:32,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:32,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d1eefa461f55e59da3e HTTP/1.1" 200 None 2026-03-07 01:21:32,685 - lava_callback - DEBUG - Processing node 69ab7d1eefa461f55e59da3e: baseline-arm64-clabbe 2026-03-07 01:21:32,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:33,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:33,493 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d1eefa461f55e59da3e/log.txt.gz 2026-03-07 01:21:33,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:34,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:34,214 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d1eefa461f55e59da3e/lava-logs.yaml 2026-03-07 01:21:34,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:34,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:34,436 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d1eefa461f55e59da3e/lava_callback.json.gz 2026-03-07 01:21:34,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:34,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d1eefa461f55e59da3e HTTP/1.1" 200 None 2026-03-07 01:21:34,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:34,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:21:34,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:34,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d1eefa461f55e59da3e HTTP/1.1" 200 None 2026-03-07 01:21:34,574 - lava_callback - INFO - Completed processing callback for node 69ab7d1eefa461f55e59da3e INFO: 172.20.0.1:34716 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:21:42,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:42,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38522 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:21:50,474 - lava_callback - INFO - Received callback for node 69ab7d17efa461f55e59da2b INFO: 172.20.0.1:56204 - "POST /node/69ab7d17efa461f55e59da2b HTTP/1.0" 202 Accepted 2026-03-07 01:21:50,481 - lava_callback - INFO - Starting async job submit for node 69ab7d17efa461f55e59da2b 2026-03-07 01:21:50,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:50,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d17efa461f55e59da2b HTTP/1.1" 200 None 2026-03-07 01:21:50,547 - lava_callback - DEBUG - Processing node 69ab7d17efa461f55e59da2b: baseline-arm64-broonie 2026-03-07 01:21:51,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:51,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:51,165 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d17efa461f55e59da2b/log.txt.gz 2026-03-07 01:21:51,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:51,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:51,752 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d17efa461f55e59da2b/lava-logs.yaml 2026-03-07 01:21:51,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:21:52,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:21:52,231 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d17efa461f55e59da2b/lava_callback.json.gz 2026-03-07 01:21:52,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:52,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d17efa461f55e59da2b HTTP/1.1" 200 None 2026-03-07 01:21:52,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:52,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:21:52,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:21:52,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d17efa461f55e59da2b HTTP/1.1" 200 None 2026-03-07 01:21:52,402 - lava_callback - INFO - Completed processing callback for node 69ab7d17efa461f55e59da2b INFO: 172.20.0.1:56206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56222 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:22:01,355 - lava_callback - INFO - Received callback for node 69ab7ceeefa461f55e59d991 INFO: 172.20.0.1:39210 - "POST /node/69ab7ceeefa461f55e59d991 HTTP/1.0" 202 Accepted 2026-03-07 01:22:01,365 - lava_callback - INFO - Starting async job submit for node 69ab7ceeefa461f55e59d991 2026-03-07 01:22:01,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:01,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ceeefa461f55e59d991 HTTP/1.1" 200 None 2026-03-07 01:22:01,403 - lava_callback - DEBUG - Processing node 69ab7ceeefa461f55e59d991: baseline-arm64 2026-03-07 01:22:01,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:02,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:02,039 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ceeefa461f55e59d991/log.txt.gz 2026-03-07 01:22:02,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:02,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:02,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ceeefa461f55e59d991/lava-logs.yaml 2026-03-07 01:22:02,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:03,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:03,149 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ceeefa461f55e59d991/lava_callback.json.gz 2026-03-07 01:22:03,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:03,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ceeefa461f55e59d991 HTTP/1.1" 200 None 2026-03-07 01:22:03,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:03,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:22:03,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:03,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7ceeefa461f55e59d991 HTTP/1.1" 200 None 2026-03-07 01:22:03,265 - lava_callback - INFO - Completed processing callback for node 69ab7ceeefa461f55e59d991 INFO: 172.20.0.1:39226 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:22:12,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:12,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56488 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:22:19,384 - lava_callback - INFO - Received callback for node 69ab7ce5efa461f55e59d977 INFO: 172.20.0.1:56492 - "POST /node/69ab7ce5efa461f55e59d977 HTTP/1.0" 202 Accepted 2026-03-07 01:22:19,391 - lava_callback - INFO - Starting async job submit for node 69ab7ce5efa461f55e59d977 2026-03-07 01:22:19,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:19,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce5efa461f55e59d977 HTTP/1.1" 200 None 2026-03-07 01:22:19,449 - lava_callback - DEBUG - Processing node 69ab7ce5efa461f55e59d977: baseline-arm64 2026-03-07 01:22:19,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:19,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:19,826 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce5efa461f55e59d977/log.txt.gz 2026-03-07 01:22:19,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:20,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:20,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce5efa461f55e59d977/lava-logs.yaml 2026-03-07 01:22:20,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:20,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:20,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce5efa461f55e59d977/lava_callback.json.gz 2026-03-07 01:22:20,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:20,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce5efa461f55e59d977 HTTP/1.1" 200 None 2026-03-07 01:22:20,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:20,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:22:20,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:20,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7ce5efa461f55e59d977 HTTP/1.1" 200 None 2026-03-07 01:22:20,380 - lava_callback - INFO - Completed processing callback for node 69ab7ce5efa461f55e59d977 INFO: 172.20.0.1:43988 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:22:31,136 - lava_callback - INFO - Received callback for node 69ab7ce7efa461f55e59d97e INFO: 172.20.0.1:60338 - "POST /node/69ab7ce7efa461f55e59d97e HTTP/1.0" 202 Accepted 2026-03-07 01:22:31,143 - lava_callback - INFO - Starting async job submit for node 69ab7ce7efa461f55e59d97e 2026-03-07 01:22:31,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:31,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce7efa461f55e59d97e HTTP/1.1" 200 None 2026-03-07 01:22:31,179 - lava_callback - DEBUG - Processing node 69ab7ce7efa461f55e59d97e: baseline-arm64 2026-03-07 01:22:31,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:31,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:31,779 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce7efa461f55e59d97e/log.txt.gz 2026-03-07 01:22:31,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:32,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:32,186 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce7efa461f55e59d97e/lava-logs.yaml 2026-03-07 01:22:32,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:32,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:32,345 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce7efa461f55e59d97e/lava_callback.json.gz 2026-03-07 01:22:32,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:32,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce7efa461f55e59d97e HTTP/1.1" 200 None 2026-03-07 01:22:32,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:32,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:22:32,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:32,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7ce7efa461f55e59d97e HTTP/1.1" 200 None 2026-03-07 01:22:32,439 - lava_callback - INFO - Completed processing callback for node 69ab7ce7efa461f55e59d97e 2026-03-07 01:22:33,021 - lava_callback - INFO - Received callback for node 69ab7ce0efa461f55e59d96b INFO: 172.20.0.1:60344 - "POST /node/69ab7ce0efa461f55e59d96b HTTP/1.0" 202 Accepted 2026-03-07 01:22:33,028 - lava_callback - INFO - Starting async job submit for node 69ab7ce0efa461f55e59d96b 2026-03-07 01:22:33,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:33,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce0efa461f55e59d96b HTTP/1.1" 200 None 2026-03-07 01:22:33,066 - lava_callback - DEBUG - Processing node 69ab7ce0efa461f55e59d96b: baseline-arm64 2026-03-07 01:22:33,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:33,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:33,423 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce0efa461f55e59d96b/log.txt.gz 2026-03-07 01:22:33,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:33,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:33,762 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce0efa461f55e59d96b/lava-logs.yaml 2026-03-07 01:22:33,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:33,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:33,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce0efa461f55e59d96b/lava_callback.json.gz 2026-03-07 01:22:33,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:33,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce0efa461f55e59d96b HTTP/1.1" 200 None 2026-03-07 01:22:33,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:33,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:22:33,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:34,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7ce0efa461f55e59d96b HTTP/1.1" 200 None 2026-03-07 01:22:34,012 - lava_callback - INFO - Completed processing callback for node 69ab7ce0efa461f55e59d96b 2026-03-07 01:22:35,527 - lava_callback - INFO - Received callback for node 69ab7d1fefa461f55e59da41 INFO: 172.20.0.1:60358 - "POST /node/69ab7d1fefa461f55e59da41 HTTP/1.0" 202 Accepted 2026-03-07 01:22:35,533 - lava_callback - INFO - Starting async job submit for node 69ab7d1fefa461f55e59da41 2026-03-07 01:22:35,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:35,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d1fefa461f55e59da41 HTTP/1.1" 200 None 2026-03-07 01:22:35,584 - lava_callback - DEBUG - Processing node 69ab7d1fefa461f55e59da41: baseline-arm64-clabbe 2026-03-07 01:22:35,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:36,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:36,091 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d1fefa461f55e59da41/log.txt.gz 2026-03-07 01:22:36,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:60368 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:22:36,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:36,529 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d1fefa461f55e59da41/lava-logs.yaml 2026-03-07 01:22:36,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:36,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:36,667 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d1fefa461f55e59da41/lava_callback.json.gz 2026-03-07 01:22:36,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:36,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d1fefa461f55e59da41 HTTP/1.1" 200 None 2026-03-07 01:22:36,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:36,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:22:36,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:36,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d1fefa461f55e59da41 HTTP/1.1" 200 None 2026-03-07 01:22:36,756 - lava_callback - INFO - Completed processing callback for node 69ab7d1fefa461f55e59da41 2026-03-07 01:22:39,216 - lava_callback - INFO - Received callback for node 69ab7ce6efa461f55e59d97a INFO: 172.20.0.1:60382 - "POST /node/69ab7ce6efa461f55e59d97a HTTP/1.0" 202 Accepted 2026-03-07 01:22:39,222 - lava_callback - INFO - Starting async job submit for node 69ab7ce6efa461f55e59d97a 2026-03-07 01:22:39,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:39,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce6efa461f55e59d97a HTTP/1.1" 200 None 2026-03-07 01:22:39,260 - lava_callback - DEBUG - Processing node 69ab7ce6efa461f55e59d97a: baseline-arm64 2026-03-07 01:22:39,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:39,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:39,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce6efa461f55e59d97a/log.txt.gz 2026-03-07 01:22:40,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:40,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:40,448 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce6efa461f55e59d97a/lava-logs.yaml 2026-03-07 01:22:40,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:40,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:40,682 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce6efa461f55e59d97a/lava_callback.json.gz 2026-03-07 01:22:40,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:40,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce6efa461f55e59d97a HTTP/1.1" 200 None 2026-03-07 01:22:40,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:40,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:22:40,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:40,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7ce6efa461f55e59d97a HTTP/1.1" 200 None 2026-03-07 01:22:40,825 - lava_callback - INFO - Completed processing callback for node 69ab7ce6efa461f55e59d97a 2026-03-07 01:22:42,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:42,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:60916 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:22:47,053 - lava_callback - INFO - Received callback for node 69ab7cebefa461f55e59d987 INFO: 172.20.0.1:60928 - "POST /node/69ab7cebefa461f55e59d987 HTTP/1.0" 202 Accepted 2026-03-07 01:22:47,059 - lava_callback - INFO - Starting async job submit for node 69ab7cebefa461f55e59d987 2026-03-07 01:22:47,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:47,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cebefa461f55e59d987 HTTP/1.1" 200 None 2026-03-07 01:22:47,097 - lava_callback - DEBUG - Processing node 69ab7cebefa461f55e59d987: baseline-arm64 2026-03-07 01:22:47,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:47,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:47,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cebefa461f55e59d987/log.txt.gz 2026-03-07 01:22:47,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:47,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:47,792 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cebefa461f55e59d987/lava-logs.yaml 2026-03-07 01:22:47,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:47,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:47,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cebefa461f55e59d987/lava_callback.json.gz 2026-03-07 01:22:47,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:47,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cebefa461f55e59d987 HTTP/1.1" 200 None 2026-03-07 01:22:47,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:47,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:22:47,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:48,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cebefa461f55e59d987 HTTP/1.1" 200 None 2026-03-07 01:22:48,017 - lava_callback - INFO - Completed processing callback for node 69ab7cebefa461f55e59d987 2026-03-07 01:22:48,519 - lava_callback - INFO - Received callback for node 69ab7cf0efa461f55e59d994 INFO: 172.20.0.1:60940 - "POST /node/69ab7cf0efa461f55e59d994 HTTP/1.0" 202 Accepted 2026-03-07 01:22:48,526 - lava_callback - INFO - Starting async job submit for node 69ab7cf0efa461f55e59d994 2026-03-07 01:22:48,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:48,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf0efa461f55e59d994 HTTP/1.1" 200 None 2026-03-07 01:22:48,563 - lava_callback - DEBUG - Processing node 69ab7cf0efa461f55e59d994: baseline-arm64 2026-03-07 01:22:48,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:49,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:49,032 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cf0efa461f55e59d994/log.txt.gz 2026-03-07 01:22:49,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:49,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:49,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cf0efa461f55e59d994/lava-logs.yaml 2026-03-07 01:22:49,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:49,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:49,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cf0efa461f55e59d994/lava_callback.json.gz 2026-03-07 01:22:49,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:49,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf0efa461f55e59d994 HTTP/1.1" 200 None 2026-03-07 01:22:49,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:49,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:22:49,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:49,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cf0efa461f55e59d994 HTTP/1.1" 200 None 2026-03-07 01:22:49,744 - lava_callback - INFO - Completed processing callback for node 69ab7cf0efa461f55e59d994 2026-03-07 01:22:50,609 - lava_callback - INFO - Received callback for node 69ab7cedefa461f55e59d98d INFO: 172.20.0.1:36758 - "POST /node/69ab7cedefa461f55e59d98d HTTP/1.0" 202 Accepted 2026-03-07 01:22:50,615 - lava_callback - INFO - Starting async job submit for node 69ab7cedefa461f55e59d98d 2026-03-07 01:22:50,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:50,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cedefa461f55e59d98d HTTP/1.1" 200 None 2026-03-07 01:22:50,670 - lava_callback - DEBUG - Processing node 69ab7cedefa461f55e59d98d: baseline-arm64 2026-03-07 01:22:50,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:51,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:51,090 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cedefa461f55e59d98d/log.txt.gz 2026-03-07 01:22:51,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:51,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:51,445 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cedefa461f55e59d98d/lava-logs.yaml 2026-03-07 01:22:51,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:51,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:51,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cedefa461f55e59d98d/lava_callback.json.gz 2026-03-07 01:22:51,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:51,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cedefa461f55e59d98d HTTP/1.1" 200 None 2026-03-07 01:22:51,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:51,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:22:51,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:51,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cedefa461f55e59d98d HTTP/1.1" 200 None 2026-03-07 01:22:51,668 - lava_callback - INFO - Completed processing callback for node 69ab7cedefa461f55e59d98d 2026-03-07 01:22:54,198 - lava_callback - INFO - Received callback for node 69ab7cfeefa461f55e59d9d5 INFO: 172.20.0.1:36762 - "POST /node/69ab7cfeefa461f55e59d9d5 HTTP/1.0" 202 Accepted 2026-03-07 01:22:54,206 - lava_callback - INFO - Starting async job submit for node 69ab7cfeefa461f55e59d9d5 2026-03-07 01:22:54,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:54,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cfeefa461f55e59d9d5 HTTP/1.1" 200 None 2026-03-07 01:22:54,243 - lava_callback - DEBUG - Processing node 69ab7cfeefa461f55e59d9d5: baseline-nfs-arm64 2026-03-07 01:22:54,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:54,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:54,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfeefa461f55e59d9d5/log.txt.gz 2026-03-07 01:22:54,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:55,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:55,196 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfeefa461f55e59d9d5/lava-logs.yaml 2026-03-07 01:22:55,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:55,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:55,535 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfeefa461f55e59d9d5/lava_callback.json.gz 2026-03-07 01:22:55,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:55,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cfeefa461f55e59d9d5 HTTP/1.1" 200 None 2026-03-07 01:22:55,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:55,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:22:55,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:55,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cfeefa461f55e59d9d5 HTTP/1.1" 200 None 2026-03-07 01:22:55,710 - lava_callback - INFO - Completed processing callback for node 69ab7cfeefa461f55e59d9d5 INFO: 172.20.0.1:36768 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:22:58,602 - lava_callback - INFO - Received callback for node 69ab7d00efa461f55e59d9d8 INFO: 172.20.0.1:36774 - "POST /node/69ab7d00efa461f55e59d9d8 HTTP/1.0" 202 Accepted 2026-03-07 01:22:58,609 - lava_callback - INFO - Starting async job submit for node 69ab7d00efa461f55e59d9d8 2026-03-07 01:22:58,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:22:58,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d00efa461f55e59d9d8 HTTP/1.1" 200 None 2026-03-07 01:22:58,654 - lava_callback - DEBUG - Processing node 69ab7d00efa461f55e59d9d8: baseline-nfs-arm64 INFO: 172.20.0.1:36780 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:22:59,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:59,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:59,213 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7d00efa461f55e59d9d8/log.txt.gz 2026-03-07 01:22:59,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:22:59,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:22:59,831 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7d00efa461f55e59d9d8/lava-logs.yaml 2026-03-07 01:22:59,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:00,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:00,014 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7d00efa461f55e59d9d8/lava_callback.json.gz 2026-03-07 01:23:00,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:00,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d00efa461f55e59d9d8 HTTP/1.1" 200 None 2026-03-07 01:23:00,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:00,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:23:00,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:00,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d00efa461f55e59d9d8 HTTP/1.1" 200 None 2026-03-07 01:23:00,115 - lava_callback - INFO - Completed processing callback for node 69ab7d00efa461f55e59d9d8 2026-03-07 01:23:00,541 - lava_callback - INFO - Received callback for node 69ab7cf7efa461f55e59d9c2 INFO: 172.20.0.1:57562 - "POST /node/69ab7cf7efa461f55e59d9c2 HTTP/1.0" 202 Accepted 2026-03-07 01:23:00,548 - lava_callback - INFO - Starting async job submit for node 69ab7cf7efa461f55e59d9c2 2026-03-07 01:23:00,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:00,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf7efa461f55e59d9c2 HTTP/1.1" 200 None 2026-03-07 01:23:00,588 - lava_callback - DEBUG - Processing node 69ab7cf7efa461f55e59d9c2: baseline-nfs-arm64 2026-03-07 01:23:01,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:01,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:01,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf7efa461f55e59d9c2/log.txt.gz 2026-03-07 01:23:01,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:01,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:01,725 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf7efa461f55e59d9c2/lava-logs.yaml 2026-03-07 01:23:01,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:01,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:01,912 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf7efa461f55e59d9c2/lava_callback.json.gz 2026-03-07 01:23:01,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:01,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf7efa461f55e59d9c2 HTTP/1.1" 200 None 2026-03-07 01:23:01,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:01,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:23:01,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:02,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cf7efa461f55e59d9c2 HTTP/1.1" 200 None 2026-03-07 01:23:02,003 - lava_callback - INFO - Completed processing callback for node 69ab7cf7efa461f55e59d9c2 2026-03-07 01:23:02,193 - lava_callback - INFO - Received callback for node 69ab7cf8efa461f55e59d9c5 INFO: 172.20.0.1:57570 - "POST /node/69ab7cf8efa461f55e59d9c5 HTTP/1.0" 202 Accepted 2026-03-07 01:23:02,200 - lava_callback - INFO - Starting async job submit for node 69ab7cf8efa461f55e59d9c5 2026-03-07 01:23:02,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:02,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf8efa461f55e59d9c5 HTTP/1.1" 200 None 2026-03-07 01:23:02,246 - lava_callback - DEBUG - Processing node 69ab7cf8efa461f55e59d9c5: baseline-nfs-arm64 2026-03-07 01:23:02,267 - lava_callback - INFO - Received callback for node 69ab7cf2efa461f55e59d99d INFO: 172.20.0.1:57572 - "POST /node/69ab7cf2efa461f55e59d99d HTTP/1.0" 202 Accepted 2026-03-07 01:23:02,291 - lava_callback - INFO - Starting async job submit for node 69ab7cf2efa461f55e59d99d 2026-03-07 01:23:02,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:02,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf2efa461f55e59d99d HTTP/1.1" 200 None 2026-03-07 01:23:02,444 - lava_callback - DEBUG - Processing node 69ab7cf2efa461f55e59d99d: baseline-nfs-arm64 2026-03-07 01:23:03,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:03,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:03,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:03,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf2efa461f55e59d99d/log.txt.gz 2026-03-07 01:23:03,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:03,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf8efa461f55e59d9c5/log.txt.gz 2026-03-07 01:23:03,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:03,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:04,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:04,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf2efa461f55e59d99d/lava-logs.yaml 2026-03-07 01:23:04,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:04,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:04,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf2efa461f55e59d99d/lava_callback.json.gz 2026-03-07 01:23:04,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:04,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:04,189 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf8efa461f55e59d9c5/lava-logs.yaml 2026-03-07 01:23:04,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:04,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf2efa461f55e59d99d HTTP/1.1" 200 None 2026-03-07 01:23:04,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:04,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:23:04,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:04,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cf2efa461f55e59d99d HTTP/1.1" 200 None 2026-03-07 01:23:04,266 - lava_callback - INFO - Completed processing callback for node 69ab7cf2efa461f55e59d99d 2026-03-07 01:23:04,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:04,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf8efa461f55e59d9c5/lava_callback.json.gz 2026-03-07 01:23:04,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:04,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf8efa461f55e59d9c5 HTTP/1.1" 200 None 2026-03-07 01:23:04,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:04,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:23:04,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:04,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cf8efa461f55e59d9c5 HTTP/1.1" 200 None 2026-03-07 01:23:04,560 - lava_callback - INFO - Completed processing callback for node 69ab7cf8efa461f55e59d9c5 INFO: 172.20.0.1:57576 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:23:07,416 - lava_callback - INFO - Received callback for node 69ab7d22efa461f55e59da4a INFO: 172.20.0.1:57590 - "POST /node/69ab7d22efa461f55e59da4a HTTP/1.0" 202 Accepted 2026-03-07 01:23:07,423 - lava_callback - INFO - Starting async job submit for node 69ab7d22efa461f55e59da4a 2026-03-07 01:23:07,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:07,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d22efa461f55e59da4a HTTP/1.1" 200 None 2026-03-07 01:23:07,461 - lava_callback - DEBUG - Processing node 69ab7d22efa461f55e59da4a: baseline-arm64-clabbe 2026-03-07 01:23:07,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:07,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:07,817 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d22efa461f55e59da4a/log.txt.gz 2026-03-07 01:23:07,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:08,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:08,124 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d22efa461f55e59da4a/lava-logs.yaml 2026-03-07 01:23:08,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:08,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:08,293 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ab7d22efa461f55e59da4a/lava_callback.json.gz 2026-03-07 01:23:08,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:08,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d22efa461f55e59da4a HTTP/1.1" 200 None 2026-03-07 01:23:08,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:08,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:23:08,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:08,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d22efa461f55e59da4a HTTP/1.1" 200 None 2026-03-07 01:23:08,382 - lava_callback - INFO - Completed processing callback for node 69ab7d22efa461f55e59da4a 2026-03-07 01:23:12,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:12,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:40322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40326 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:23:21,863 - lava_callback - INFO - Received callback for node 69ab7cfdefa461f55e59d9d2 INFO: 172.20.0.1:36136 - "POST /node/69ab7cfdefa461f55e59d9d2 HTTP/1.0" 202 Accepted 2026-03-07 01:23:21,870 - lava_callback - INFO - Starting async job submit for node 69ab7cfdefa461f55e59d9d2 2026-03-07 01:23:21,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:21,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cfdefa461f55e59d9d2 HTTP/1.1" 200 None 2026-03-07 01:23:21,908 - lava_callback - DEBUG - Processing node 69ab7cfdefa461f55e59d9d2: baseline-nfs-arm64 2026-03-07 01:23:22,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:22,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:22,387 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfdefa461f55e59d9d2/log.txt.gz 2026-03-07 01:23:22,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:22,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:22,789 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfdefa461f55e59d9d2/lava-logs.yaml 2026-03-07 01:23:22,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:22,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:22,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfdefa461f55e59d9d2/lava_callback.json.gz 2026-03-07 01:23:22,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:23,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cfdefa461f55e59d9d2 HTTP/1.1" 200 None 2026-03-07 01:23:23,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:23,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:23:23,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:23,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cfdefa461f55e59d9d2 HTTP/1.1" 200 None 2026-03-07 01:23:23,073 - lava_callback - INFO - Completed processing callback for node 69ab7cfdefa461f55e59d9d2 2026-03-07 01:23:24,674 - lava_callback - INFO - Received callback for node 69ab7cfbefa461f55e59d9cb INFO: 172.20.0.1:36152 - "POST /node/69ab7cfbefa461f55e59d9cb HTTP/1.0" 202 Accepted 2026-03-07 01:23:24,681 - lava_callback - INFO - Starting async job submit for node 69ab7cfbefa461f55e59d9cb 2026-03-07 01:23:24,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:24,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cfbefa461f55e59d9cb HTTP/1.1" 200 None 2026-03-07 01:23:24,732 - lava_callback - DEBUG - Processing node 69ab7cfbefa461f55e59d9cb: baseline-nfs-arm64 2026-03-07 01:23:25,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:25,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:25,219 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfbefa461f55e59d9cb/log.txt.gz 2026-03-07 01:23:25,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:25,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:25,622 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfbefa461f55e59d9cb/lava-logs.yaml 2026-03-07 01:23:25,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:25,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:25,762 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfbefa461f55e59d9cb/lava_callback.json.gz 2026-03-07 01:23:25,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:25,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cfbefa461f55e59d9cb HTTP/1.1" 200 None 2026-03-07 01:23:25,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:25,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:23:25,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:25,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cfbefa461f55e59d9cb HTTP/1.1" 200 None 2026-03-07 01:23:25,854 - lava_callback - INFO - Completed processing callback for node 69ab7cfbefa461f55e59d9cb INFO: 172.20.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36258 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:23:36,720 - lava_callback - INFO - Received callback for node 69ab7ce9efa461f55e59d981 INFO: 172.20.0.1:36270 - "POST /node/69ab7ce9efa461f55e59d981 HTTP/1.0" 202 Accepted 2026-03-07 01:23:36,730 - lava_callback - INFO - Starting async job submit for node 69ab7ce9efa461f55e59d981 2026-03-07 01:23:36,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:36,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce9efa461f55e59d981 HTTP/1.1" 200 None 2026-03-07 01:23:36,768 - lava_callback - DEBUG - Processing node 69ab7ce9efa461f55e59d981: baseline-arm64 2026-03-07 01:23:37,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:37,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:37,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce9efa461f55e59d981/log.txt.gz 2026-03-07 01:23:37,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:37,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:37,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce9efa461f55e59d981/lava-logs.yaml 2026-03-07 01:23:37,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:38,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:38,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce9efa461f55e59d981/lava_callback.json.gz 2026-03-07 01:23:38,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:38,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce9efa461f55e59d981 HTTP/1.1" 200 None 2026-03-07 01:23:38,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:38,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:23:38,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:38,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7ce9efa461f55e59d981 HTTP/1.1" 200 None 2026-03-07 01:23:38,333 - lava_callback - INFO - Completed processing callback for node 69ab7ce9efa461f55e59d981 2026-03-07 01:23:40,894 - lava_callback - INFO - Received callback for node 69ab7dfcefa461f55e59db67 INFO: 172.20.0.1:60774 - "POST /node/69ab7dfcefa461f55e59db67 HTTP/1.0" 202 Accepted 2026-03-07 01:23:40,900 - lava_callback - INFO - Starting async job submit for node 69ab7dfcefa461f55e59db67 2026-03-07 01:23:40,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:40,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7dfcefa461f55e59db67 HTTP/1.1" 200 None 2026-03-07 01:23:40,917 - lava_callback - DEBUG - Processing node 69ab7dfcefa461f55e59db67: baseline-nfs-arm64 2026-03-07 01:23:40,918 - lava_callback - WARNING - Failed to upload log 2026-03-07 01:23:40,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:41,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:41,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7dfcefa461f55e59db67/lava-logs.yaml 2026-03-07 01:23:41,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:41,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:41,158 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7dfcefa461f55e59db67/lava_callback.json.gz 2026-03-07 01:23:41,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:41,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7dfcefa461f55e59db67 HTTP/1.1" 200 None 2026-03-07 01:23:41,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:41,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:23:41,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:41,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7dfcefa461f55e59db67 HTTP/1.1" 200 None 2026-03-07 01:23:41,258 - lava_callback - INFO - Completed processing callback for node 69ab7dfcefa461f55e59db67 2026-03-07 01:23:42,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:42,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:60782 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:23:48,112 - lava_callback - INFO - Received callback for node 69ab7cf4efa461f55e59d9bc INFO: 172.20.0.1:60792 - "POST /node/69ab7cf4efa461f55e59d9bc HTTP/1.0" 202 Accepted 2026-03-07 01:23:48,119 - lava_callback - INFO - Starting async job submit for node 69ab7cf4efa461f55e59d9bc 2026-03-07 01:23:48,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:48,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf4efa461f55e59d9bc HTTP/1.1" 200 None 2026-03-07 01:23:48,156 - lava_callback - DEBUG - Processing node 69ab7cf4efa461f55e59d9bc: baseline-nfs-arm64 2026-03-07 01:23:48,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:48,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:48,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf4efa461f55e59d9bc/log.txt.gz 2026-03-07 01:23:48,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:49,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:49,062 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf4efa461f55e59d9bc/lava-logs.yaml 2026-03-07 01:23:49,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:23:49,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:23:49,222 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf4efa461f55e59d9bc/lava_callback.json.gz 2026-03-07 01:23:49,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:49,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf4efa461f55e59d9bc HTTP/1.1" 200 None 2026-03-07 01:23:49,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:23:49,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:49,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cf4efa461f55e59d9bc HTTP/1.1" 200 None 2026-03-07 01:23:49,304 - lava_callback - INFO - Completed processing callback for node 69ab7cf4efa461f55e59d9bc 2026-03-07 01:23:56,011 - lava_callback - INFO - Received callback for node 69a8db1f911a9cbe7f77dda7 INFO: 172.20.0.1:45896 - "POST /node/69a8db1f911a9cbe7f77dda7 HTTP/1.0" 202 Accepted 2026-03-07 01:23:56,021 - lava_callback - INFO - Starting async job submit for node 69a8db1f911a9cbe7f77dda7 2026-03-07 01:23:56,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:56,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8db1f911a9cbe7f77dda7 HTTP/1.1" 200 None 2026-03-07 01:23:56,037 - lava_callback - DEBUG - Processing node 69a8db1f911a9cbe7f77dda7: baseline-arm-baylibre 2026-03-07 01:23:56,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8db1f911a9cbe7f77dda7 2026-03-07 01:23:56,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:56,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8db1f911a9cbe7f77dda7 HTTP/1.1" 200 None 2026-03-07 01:23:56,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:56,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a0e2579f52b1b460a4664f HTTP/1.1" 200 None 2026-03-07 01:23:56,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:23:56,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8db1f911a9cbe7f77dda7 HTTP/1.1" 200 None 2026-03-07 01:23:56,095 - lava_callback - ERROR - Error processing callback for node 69a8db1f911a9cbe7f77dda7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52142 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:24:12,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:24:12,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42882 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:24:20,512 - lava_callback - INFO - Received callback for node 69ab7d1befa461f55e59da35 INFO: 172.20.0.1:45562 - "POST /node/69ab7d1befa461f55e59da35 HTTP/1.0" 202 Accepted 2026-03-07 01:24:20,518 - lava_callback - INFO - Starting async job submit for node 69ab7d1befa461f55e59da35 2026-03-07 01:24:20,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:24:20,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d1befa461f55e59da35 HTTP/1.1" 200 None 2026-03-07 01:24:20,558 - lava_callback - DEBUG - Processing node 69ab7d1befa461f55e59da35: baseline-arm64-broonie 2026-03-07 01:24:20,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:24:20,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:24:20,964 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d1befa461f55e59da35/log.txt.gz 2026-03-07 01:24:21,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:24:21,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:24:21,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d1befa461f55e59da35/lava-logs.yaml 2026-03-07 01:24:21,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:24:21,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:24:21,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d1befa461f55e59da35/lava_callback.json.gz 2026-03-07 01:24:21,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:24:21,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d1befa461f55e59da35 HTTP/1.1" 200 None 2026-03-07 01:24:21,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:24:21,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:24:21,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:24:21,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d1befa461f55e59da35 HTTP/1.1" 200 None 2026-03-07 01:24:21,580 - lava_callback - INFO - Completed processing callback for node 69ab7d1befa461f55e59da35 INFO: 172.20.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38284 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:24:42,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:24:42,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58814 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:24:52,028 - lava_callback - INFO - Received callback for node 69ab7ce4efa461f55e59d974 INFO: 172.20.0.1:41430 - "POST /node/69ab7ce4efa461f55e59d974 HTTP/1.0" 202 Accepted 2026-03-07 01:24:52,034 - lava_callback - INFO - Starting async job submit for node 69ab7ce4efa461f55e59d974 2026-03-07 01:24:52,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:24:52,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce4efa461f55e59d974 HTTP/1.1" 200 None 2026-03-07 01:24:52,077 - lava_callback - DEBUG - Processing node 69ab7ce4efa461f55e59d974: baseline-arm64 2026-03-07 01:24:52,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:24:52,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:24:52,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce4efa461f55e59d974/log.txt.gz 2026-03-07 01:24:52,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:24:53,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:24:53,015 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce4efa461f55e59d974/lava-logs.yaml 2026-03-07 01:24:53,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:24:53,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:24:53,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce4efa461f55e59d974/lava_callback.json.gz 2026-03-07 01:24:53,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:24:53,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce4efa461f55e59d974 HTTP/1.1" 200 None 2026-03-07 01:24:53,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:24:53,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:24:53,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:24:53,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7ce4efa461f55e59d974 HTTP/1.1" 200 None 2026-03-07 01:24:53,235 - lava_callback - INFO - Completed processing callback for node 69ab7ce4efa461f55e59d974 INFO: 172.20.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41858 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:25:12,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:25:12,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52670 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:25:22,188 - lava_callback - INFO - Received callback for node 69ab7d29efa461f55e59da5a INFO: 172.20.0.1:34360 - "POST /node/69ab7d29efa461f55e59da5a HTTP/1.0" 202 Accepted 2026-03-07 01:25:22,197 - lava_callback - INFO - Starting async job submit for node 69ab7d29efa461f55e59da5a 2026-03-07 01:25:22,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:25:22,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d29efa461f55e59da5a HTTP/1.1" 200 None 2026-03-07 01:25:22,280 - lava_callback - DEBUG - Processing node 69ab7d29efa461f55e59da5a: baseline-arm64-foundriesio 2026-03-07 01:25:23,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:25:23,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:25:23,855 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab7d29efa461f55e59da5a/log.txt.gz 2026-03-07 01:25:24,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:25:24,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:25:24,817 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab7d29efa461f55e59da5a/lava-logs.yaml 2026-03-07 01:25:24,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:25:25,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:25:25,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab7d29efa461f55e59da5a/lava_callback.json.gz DEBUG: Setup failed for 69ab7d29efa461f55e59da5a. Transitting job node result: incomplete -> fail 2026-03-07 01:25:25,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:25:25,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d29efa461f55e59da5a HTTP/1.1" 200 None 2026-03-07 01:25:25,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:25:25,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:25:25,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:25:25,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d29efa461f55e59da5a HTTP/1.1" 200 None 2026-03-07 01:25:25,335 - lava_callback - INFO - Completed processing callback for node 69ab7d29efa461f55e59da5a INFO: 172.20.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55704 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:25:42,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:25:42,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60800 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:25:53,875 - lava_callback - INFO - Received callback for node 69ab7cf3efa461f55e59d9b9 INFO: 172.20.0.1:38970 - "POST /node/69ab7cf3efa461f55e59d9b9 HTTP/1.0" 202 Accepted 2026-03-07 01:25:53,881 - lava_callback - INFO - Starting async job submit for node 69ab7cf3efa461f55e59d9b9 2026-03-07 01:25:53,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:25:53,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf3efa461f55e59d9b9 HTTP/1.1" 200 None 2026-03-07 01:25:53,915 - lava_callback - DEBUG - Processing node 69ab7cf3efa461f55e59d9b9: baseline-nfs-arm64 2026-03-07 01:25:54,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:25:54,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:25:54,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf3efa461f55e59d9b9/log.txt.gz 2026-03-07 01:25:54,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:25:54,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:25:54,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf3efa461f55e59d9b9/lava-logs.yaml 2026-03-07 01:25:54,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:25:55,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:25:55,178 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf3efa461f55e59d9b9/lava_callback.json.gz 2026-03-07 01:25:55,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:25:55,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf3efa461f55e59d9b9 HTTP/1.1" 200 None 2026-03-07 01:25:55,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:25:55,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:25:55,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:25:55,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cf3efa461f55e59d9b9 HTTP/1.1" 200 None 2026-03-07 01:25:55,263 - lava_callback - INFO - Completed processing callback for node 69ab7cf3efa461f55e59d9b9 INFO: 172.20.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52528 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:26:12,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:26:12,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37290 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:26:47,454 - lava_callback - INFO - Received callback for node 69ab7e8fefa461f55e59dbf0 INFO: 172.20.0.1:37302 - "POST /node/69ab7e8fefa461f55e59dbf0 HTTP/1.0" 202 Accepted 2026-03-07 01:26:47,461 - lava_callback - INFO - Starting async job submit for node 69ab7e8fefa461f55e59dbf0 2026-03-07 01:26:47,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:26:47,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7e8fefa461f55e59dbf0 HTTP/1.1" 200 None 2026-03-07 01:26:47,498 - lava_callback - DEBUG - Processing node 69ab7e8fefa461f55e59dbf0: baseline-arm64 2026-03-07 01:26:47,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:26:48,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:26:48,058 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7e8fefa461f55e59dbf0/log.txt.gz 2026-03-07 01:26:48,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:26:48,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:26:48,542 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7e8fefa461f55e59dbf0/lava-logs.yaml 2026-03-07 01:26:48,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:26:48,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:26:48,740 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7e8fefa461f55e59dbf0/lava_callback.json.gz 2026-03-07 01:26:48,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:26:48,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7e8fefa461f55e59dbf0 HTTP/1.1" 200 None 2026-03-07 01:26:48,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:26:48,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:26:48,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:26:48,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7e8fefa461f55e59dbf0 HTTP/1.1" 200 None 2026-03-07 01:26:48,818 - lava_callback - INFO - Completed processing callback for node 69ab7e8fefa461f55e59dbf0 INFO: 172.20.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50082 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:27:12,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:27:12,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59070 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:27:21,671 - lava_callback - INFO - Received callback for node 69ab7ee3efa461f55e59dc22 INFO: 172.20.0.1:48248 - "POST /node/69ab7ee3efa461f55e59dc22 HTTP/1.0" 202 Accepted 2026-03-07 01:27:21,677 - lava_callback - INFO - Starting async job submit for node 69ab7ee3efa461f55e59dc22 2026-03-07 01:27:21,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:27:21,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ee3efa461f55e59dc22 HTTP/1.1" 200 None 2026-03-07 01:27:21,697 - lava_callback - DEBUG - Processing node 69ab7ee3efa461f55e59dc22: baseline-nfs-arm64 2026-03-07 01:27:21,699 - lava_callback - WARNING - Failed to upload log 2026-03-07 01:27:21,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:27:21,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:27:21,838 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7ee3efa461f55e59dc22/lava-logs.yaml 2026-03-07 01:27:21,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:27:22,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:27:22,009 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7ee3efa461f55e59dc22/lava_callback.json.gz 2026-03-07 01:27:22,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:27:22,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ee3efa461f55e59dc22 HTTP/1.1" 200 None 2026-03-07 01:27:22,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:27:22,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:27:22,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:27:22,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7ee3efa461f55e59dc22 HTTP/1.1" 200 None 2026-03-07 01:27:22,076 - lava_callback - INFO - Completed processing callback for node 69ab7ee3efa461f55e59dc22 INFO: 172.20.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42670 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:27:42,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:27:42,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47384 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:28:20,235 - lava_callback - INFO - Received callback for node 69ab7d14efa461f55e59da20 INFO: 172.20.0.1:58254 - "POST /node/69ab7d14efa461f55e59da20 HTTP/1.0" 202 Accepted 2026-03-07 01:28:20,240 - lava_callback - INFO - Starting async job submit for node 69ab7d14efa461f55e59da20 2026-03-07 01:28:20,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:20,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d14efa461f55e59da20 HTTP/1.1" 200 None 2026-03-07 01:28:20,279 - lava_callback - DEBUG - Processing node 69ab7d14efa461f55e59da20: baseline-arm64-broonie 2026-03-07 01:28:20,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:28:20,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:28:20,686 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d14efa461f55e59da20/log.txt.gz 2026-03-07 01:28:20,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:28:21,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:28:21,023 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d14efa461f55e59da20/lava-logs.yaml 2026-03-07 01:28:21,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:28:21,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:28:21,189 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d14efa461f55e59da20/lava_callback.json.gz 2026-03-07 01:28:21,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:21,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d14efa461f55e59da20 HTTP/1.1" 200 None 2026-03-07 01:28:21,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:21,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:28:21,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:21,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d14efa461f55e59da20 HTTP/1.1" 200 None 2026-03-07 01:28:21,280 - lava_callback - INFO - Completed processing callback for node 69ab7d14efa461f55e59da20 INFO: 172.20.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43266 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:28:42,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:42,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51018 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:28:48,861 - lava_callback - INFO - Received callback for node 69ab7cecefa461f55e59d98a INFO: 172.20.0.1:51028 - "POST /node/69ab7cecefa461f55e59d98a HTTP/1.0" 202 Accepted 2026-03-07 01:28:48,867 - lava_callback - INFO - Starting async job submit for node 69ab7cecefa461f55e59d98a 2026-03-07 01:28:48,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:48,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cecefa461f55e59d98a HTTP/1.1" 200 None 2026-03-07 01:28:48,902 - lava_callback - DEBUG - Processing node 69ab7cecefa461f55e59d98a: baseline-arm64 2026-03-07 01:28:49,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:28:49,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:28:49,598 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cecefa461f55e59d98a/log.txt.gz 2026-03-07 01:28:49,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:28:50,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:28:50,022 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cecefa461f55e59d98a/lava-logs.yaml 2026-03-07 01:28:50,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:28:50,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:28:50,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cecefa461f55e59d98a/lava_callback.json.gz 2026-03-07 01:28:50,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:50,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cecefa461f55e59d98a HTTP/1.1" 200 None 2026-03-07 01:28:50,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:50,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:28:50,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:50,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cecefa461f55e59d98a HTTP/1.1" 200 None 2026-03-07 01:28:50,268 - lava_callback - INFO - Completed processing callback for node 69ab7cecefa461f55e59d98a 2026-03-07 01:28:56,301 - lava_callback - INFO - Received callback for node 69a8dc4d911a9cbe7f77de63 INFO: 172.20.0.1:49174 - "POST /node/69a8dc4d911a9cbe7f77de63 HTTP/1.0" 202 Accepted 2026-03-07 01:28:56,306 - lava_callback - INFO - Starting async job submit for node 69a8dc4d911a9cbe7f77de63 2026-03-07 01:28:56,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:56,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dc4d911a9cbe7f77de63 HTTP/1.1" 200 None 2026-03-07 01:28:56,322 - lava_callback - DEBUG - Processing node 69a8dc4d911a9cbe7f77de63: baseline-arm64-baylibre 2026-03-07 01:28:56,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8dc4d911a9cbe7f77de63 2026-03-07 01:28:56,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:56,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dc4d911a9cbe7f77de63 HTTP/1.1" 200 None 2026-03-07 01:28:56,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:56,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 01:28:56,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:56,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8dc4d911a9cbe7f77de63 HTTP/1.1" 200 None 2026-03-07 01:28:56,387 - lava_callback - ERROR - Error processing callback for node 69a8dc4d911a9cbe7f77de63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49186 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:28:57,791 - lava_callback - INFO - Received callback for node 69ab7cf1efa461f55e59d99a INFO: 172.20.0.1:49198 - "POST /node/69ab7cf1efa461f55e59d99a HTTP/1.0" 202 Accepted 2026-03-07 01:28:57,798 - lava_callback - INFO - Starting async job submit for node 69ab7cf1efa461f55e59d99a 2026-03-07 01:28:57,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:57,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf1efa461f55e59d99a HTTP/1.1" 200 None 2026-03-07 01:28:57,849 - lava_callback - DEBUG - Processing node 69ab7cf1efa461f55e59d99a: baseline-arm64 2026-03-07 01:28:58,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:28:58,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:28:58,340 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cf1efa461f55e59d99a/log.txt.gz 2026-03-07 01:28:58,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:28:58,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:28:58,819 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cf1efa461f55e59d99a/lava-logs.yaml 2026-03-07 01:28:58,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:49204 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:28:58,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:28:58,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7cf1efa461f55e59d99a/lava_callback.json.gz DEBUG: Setup failed for 69ab7cf1efa461f55e59d99a. Transitting job node result: incomplete -> fail 2026-03-07 01:28:59,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:59,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf1efa461f55e59d99a HTTP/1.1" 200 None 2026-03-07 01:28:59,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:59,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:28:59,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:28:59,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cf1efa461f55e59d99a HTTP/1.1" 200 None 2026-03-07 01:28:59,211 - lava_callback - INFO - Completed processing callback for node 69ab7cf1efa461f55e59d99a INFO: 172.20.0.1:50024 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:29:12,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:12,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47044 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:29:33,852 - lava_callback - INFO - Received callback for node 69aa16c49c5f93e4f05ee95e INFO: 172.20.0.1:51952 - "POST /node/69aa16c49c5f93e4f05ee95e HTTP/1.0" 202 Accepted 2026-03-07 01:29:33,858 - lava_callback - INFO - Starting async job submit for node 69aa16c49c5f93e4f05ee95e 2026-03-07 01:29:33,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:33,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa16c49c5f93e4f05ee95e HTTP/1.1" 200 None 2026-03-07 01:29:33,916 - lava_callback - DEBUG - Processing node 69aa16c49c5f93e4f05ee95e: baseline-x86 2026-03-07 01:29:34,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:29:34,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:29:34,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa16c49c5f93e4f05ee95e/log.txt.gz 2026-03-07 01:29:34,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:29:34,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:29:34,651 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa16c49c5f93e4f05ee95e/lava-logs.yaml 2026-03-07 01:29:34,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:29:34,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:29:34,882 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa16c49c5f93e4f05ee95e/lava_callback.json.gz DEBUG: Setup failed for 69aa16c49c5f93e4f05ee95e. Transitting job node result: incomplete -> fail 2026-03-07 01:29:34,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:34,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa16c49c5f93e4f05ee95e HTTP/1.1" 200 None 2026-03-07 01:29:34,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:34,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8d000e9e7049205c4c9 HTTP/1.1" 200 None 2026-03-07 01:29:34,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:35,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa16c49c5f93e4f05ee95e HTTP/1.1" 200 None 2026-03-07 01:29:35,070 - lava_callback - INFO - Completed processing callback for node 69aa16c49c5f93e4f05ee95e INFO: 172.20.0.1:51956 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:29:42,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:42,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36664 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:29:48,415 - lava_callback - INFO - Received callback for node 69ab7cfcefa461f55e59d9ce INFO: 172.20.0.1:36666 - "POST /node/69ab7cfcefa461f55e59d9ce HTTP/1.0" 202 Accepted 2026-03-07 01:29:48,425 - lava_callback - INFO - Starting async job submit for node 69ab7cfcefa461f55e59d9ce 2026-03-07 01:29:48,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:48,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cfcefa461f55e59d9ce HTTP/1.1" 200 None 2026-03-07 01:29:48,482 - lava_callback - DEBUG - Processing node 69ab7cfcefa461f55e59d9ce: baseline-nfs-arm64 2026-03-07 01:29:49,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:29:49,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:29:49,404 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfcefa461f55e59d9ce/log.txt.gz 2026-03-07 01:29:49,448 - lava_callback - INFO - Received callback for node 69ab7f40efa461f55e59dc51 INFO: 172.20.0.1:36676 - "POST /node/69ab7f40efa461f55e59dc51 HTTP/1.0" 202 Accepted 2026-03-07 01:29:49,481 - lava_callback - INFO - Starting async job submit for node 69ab7f40efa461f55e59dc51 2026-03-07 01:29:49,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:49,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7f40efa461f55e59dc51 HTTP/1.1" 200 None 2026-03-07 01:29:49,665 - lava_callback - DEBUG - Processing node 69ab7f40efa461f55e59dc51: baseline-arm64-foundriesio 2026-03-07 01:29:50,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:29:50,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:29:50,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:29:50,529 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab7f40efa461f55e59dc51/log.txt.gz 2026-03-07 01:29:50,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:29:50,611 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfcefa461f55e59d9ce/lava-logs.yaml 2026-03-07 01:29:50,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:29:50,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:29:50,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:29:50,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cfcefa461f55e59d9ce/lava_callback.json.gz 2026-03-07 01:29:50,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:50,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cfcefa461f55e59d9ce HTTP/1.1" 200 None 2026-03-07 01:29:50,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:50,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:29:50,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:50,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:29:50,994 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab7f40efa461f55e59dc51/lava-logs.yaml 2026-03-07 01:29:51,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cfcefa461f55e59d9ce HTTP/1.1" 200 None 2026-03-07 01:29:51,012 - lava_callback - INFO - Completed processing callback for node 69ab7cfcefa461f55e59d9ce 2026-03-07 01:29:51,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:29:51,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:29:51,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ab7f40efa461f55e59dc51/lava_callback.json.gz 2026-03-07 01:29:51,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:51,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7f40efa461f55e59dc51 HTTP/1.1" 200 None 2026-03-07 01:29:51,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:51,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:29:51,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:29:51,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7f40efa461f55e59dc51 HTTP/1.1" 200 None 2026-03-07 01:29:51,339 - lava_callback - INFO - Completed processing callback for node 69ab7f40efa461f55e59dc51 INFO: 172.20.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41304 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:30:12,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:30:12,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33596 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:30:46,867 - lava_callback - INFO - Received callback for node 69ab7b91efa461f55e59d8cd INFO: 172.20.0.1:33598 - "POST /node/69ab7b91efa461f55e59d8cd HTTP/1.0" 202 Accepted 2026-03-07 01:30:46,874 - lava_callback - INFO - Starting async job submit for node 69ab7b91efa461f55e59d8cd 2026-03-07 01:30:46,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:30:46,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7b91efa461f55e59d8cd HTTP/1.1" 200 None 2026-03-07 01:30:46,949 - lava_callback - DEBUG - Processing node 69ab7b91efa461f55e59d8cd: baseline-arm 2026-03-07 01:30:47,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:30:47,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:30:47,737 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7b91efa461f55e59d8cd/log.txt.gz 2026-03-07 01:30:48,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:30:48,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:30:48,403 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7b91efa461f55e59d8cd/lava-logs.yaml 2026-03-07 01:30:48,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:30:48,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:30:48,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab7b91efa461f55e59d8cd/lava_callback.json.gz DEBUG: Setup failed for 69ab7b91efa461f55e59d8cd. Transitting job node result: incomplete -> fail 2026-03-07 01:30:48,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:30:48,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7b91efa461f55e59d8cd HTTP/1.1" 200 None 2026-03-07 01:30:48,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:30:48,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:30:48,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:30:48,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7b91efa461f55e59d8cd HTTP/1.1" 200 None 2026-03-07 01:30:48,889 - lava_callback - INFO - Completed processing callback for node 69ab7b91efa461f55e59d8cd 2026-03-07 01:30:54,376 - lava_callback - INFO - Received callback for node 69ab7ce1efa461f55e59d96e INFO: 172.20.0.1:35160 - "POST /node/69ab7ce1efa461f55e59d96e HTTP/1.0" 202 Accepted 2026-03-07 01:30:54,383 - lava_callback - INFO - Starting async job submit for node 69ab7ce1efa461f55e59d96e 2026-03-07 01:30:54,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:30:54,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce1efa461f55e59d96e HTTP/1.1" 200 None 2026-03-07 01:30:54,428 - lava_callback - DEBUG - Processing node 69ab7ce1efa461f55e59d96e: baseline-arm64 2026-03-07 01:30:54,575 - lava_callback - WARNING - Failed to upload log 2026-03-07 01:30:54,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:30:54,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:30:54,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce1efa461f55e59d96e/lava-logs.yaml 2026-03-07 01:30:54,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:30:55,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:30:55,005 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce1efa461f55e59d96e/lava_callback.json.gz 2026-03-07 01:30:55,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:30:55,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce1efa461f55e59d96e HTTP/1.1" 200 None 2026-03-07 01:30:55,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:30:55,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:30:55,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:30:55,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7ce1efa461f55e59d96e HTTP/1.1" 200 None 2026-03-07 01:30:55,160 - lava_callback - INFO - Completed processing callback for node 69ab7ce1efa461f55e59d96e INFO: 172.20.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32822 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:31:12,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:31:12,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49116 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:31:36,540 - lava_callback - INFO - Received callback for node 69a8dcf4911a9cbe7f77ded5 INFO: 172.20.0.1:49126 - "POST /node/69a8dcf4911a9cbe7f77ded5 HTTP/1.0" 202 Accepted 2026-03-07 01:31:36,546 - lava_callback - INFO - Starting async job submit for node 69a8dcf4911a9cbe7f77ded5 2026-03-07 01:31:36,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:31:36,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dcf4911a9cbe7f77ded5 HTTP/1.1" 200 None 2026-03-07 01:31:36,584 - lava_callback - DEBUG - Processing node 69a8dcf4911a9cbe7f77ded5: baseline-arm64-baylibre 2026-03-07 01:31:36,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8dcf4911a9cbe7f77ded5 2026-03-07 01:31:36,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:31:36,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dcf4911a9cbe7f77ded5 HTTP/1.1" 200 None 2026-03-07 01:31:36,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:31:36,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 01:31:36,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:31:36,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8dcf4911a9cbe7f77ded5 HTTP/1.1" 200 None 2026-03-07 01:31:36,646 - lava_callback - ERROR - Error processing callback for node 69a8dcf4911a9cbe7f77ded5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 01:31:44,931 - lava_callback - INFO - Received callback for node 69aa16859c5f93e4f05ee953 INFO: 172.20.0.1:50552 - "POST /node/69aa16859c5f93e4f05ee953 HTTP/1.0" 202 Accepted 2026-03-07 01:31:44,937 - lava_callback - INFO - Starting async job submit for node 69aa16859c5f93e4f05ee953 2026-03-07 01:31:44,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:31:44,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa16859c5f93e4f05ee953 HTTP/1.1" 200 None 2026-03-07 01:31:44,984 - lava_callback - DEBUG - Processing node 69aa16859c5f93e4f05ee953: baseline-x86 2026-03-07 01:31:45,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:31:45,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:31:45,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa16859c5f93e4f05ee953/log.txt.gz 2026-03-07 01:31:45,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:31:45,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:31:45,725 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa16859c5f93e4f05ee953/lava-logs.yaml 2026-03-07 01:31:45,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:31:45,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:31:45,888 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa16859c5f93e4f05ee953/lava_callback.json.gz DEBUG: Setup failed for 69aa16859c5f93e4f05ee953. Transitting job node result: incomplete -> fail 2026-03-07 01:31:45,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:31:45,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa16859c5f93e4f05ee953 HTTP/1.1" 200 None 2026-03-07 01:31:45,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:31:45,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85b19440c1da21c23722a HTTP/1.1" 200 None 2026-03-07 01:31:45,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:31:46,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa16859c5f93e4f05ee953 HTTP/1.1" 200 None 2026-03-07 01:31:46,086 - lava_callback - INFO - Completed processing callback for node 69aa16859c5f93e4f05ee953 INFO: 172.20.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45244 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:32:12,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:32:12,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52918 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:32:24,056 - lava_callback - INFO - Received callback for node 69ab7ce2efa461f55e59d971 INFO: 172.20.0.1:45872 - "POST /node/69ab7ce2efa461f55e59d971 HTTP/1.0" 202 Accepted 2026-03-07 01:32:24,063 - lava_callback - INFO - Starting async job submit for node 69ab7ce2efa461f55e59d971 2026-03-07 01:32:24,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:32:24,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce2efa461f55e59d971 HTTP/1.1" 200 None 2026-03-07 01:32:24,117 - lava_callback - DEBUG - Processing node 69ab7ce2efa461f55e59d971: baseline-arm64 2026-03-07 01:32:24,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:32:24,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:32:24,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce2efa461f55e59d971/log.txt.gz 2026-03-07 01:32:24,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:32:24,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:32:24,802 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce2efa461f55e59d971/lava-logs.yaml 2026-03-07 01:32:24,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:32:24,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:32:24,932 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7ce2efa461f55e59d971/lava_callback.json.gz 2026-03-07 01:32:24,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:32:24,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7ce2efa461f55e59d971 HTTP/1.1" 200 None 2026-03-07 01:32:24,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:32:24,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:32:24,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:32:25,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7ce2efa461f55e59d971 HTTP/1.1" 200 None 2026-03-07 01:32:25,099 - lava_callback - INFO - Completed processing callback for node 69ab7ce2efa461f55e59d971 INFO: 172.20.0.1:45884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36546 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:32:42,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:32:42,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60320 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:33:12,472 - lava_callback - INFO - Received callback for node 69ab7bbdefa461f55e59d8e8 INFO: 172.20.0.1:39766 - "POST /node/69ab7bbdefa461f55e59d8e8 HTTP/1.0" 202 Accepted 2026-03-07 01:33:12,478 - lava_callback - INFO - Starting async job submit for node 69ab7bbdefa461f55e59d8e8 2026-03-07 01:33:12,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:33:12,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7bbdefa461f55e59d8e8 HTTP/1.1" 200 None 2026-03-07 01:33:12,523 - lava_callback - DEBUG - Processing node 69ab7bbdefa461f55e59d8e8: baseline-arm-clabbe 2026-03-07 01:33:12,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:33:12,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:33:12,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab7bbdefa461f55e59d8e8/log.txt.gz 2026-03-07 01:33:13,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:33:13,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:33:13,244 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab7bbdefa461f55e59d8e8/lava-logs.yaml 2026-03-07 01:33:13,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:33:13,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:33:13,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab7bbdefa461f55e59d8e8/lava_callback.json.gz DEBUG: Setup failed for 69ab7bbdefa461f55e59d8e8. Transitting job node result: incomplete -> fail 2026-03-07 01:33:13,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:33:13,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7bbdefa461f55e59d8e8 HTTP/1.1" 200 None 2026-03-07 01:33:13,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:33:13,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:33:13,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:33:13,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7bbdefa461f55e59d8e8 HTTP/1.1" 200 None 2026-03-07 01:33:13,617 - lava_callback - INFO - Completed processing callback for node 69ab7bbdefa461f55e59d8e8 INFO: 172.20.0.1:39768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60196 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:33:42,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:33:42,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42316 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:34:36,736 - lava_callback - INFO - Received callback for node 69a8dd9d911a9cbe7f77df43 INFO: 172.20.0.1:42318 - "POST /node/69a8dd9d911a9cbe7f77df43 HTTP/1.0" 202 Accepted 2026-03-07 01:34:36,742 - lava_callback - INFO - Starting async job submit for node 69a8dd9d911a9cbe7f77df43 2026-03-07 01:34:36,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:34:36,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dd9d911a9cbe7f77df43 HTTP/1.1" 200 None 2026-03-07 01:34:36,758 - lava_callback - DEBUG - Processing node 69a8dd9d911a9cbe7f77df43: baseline-arm64-baylibre 2026-03-07 01:34:36,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8dd9d911a9cbe7f77df43 2026-03-07 01:34:36,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:34:36,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dd9d911a9cbe7f77df43 HTTP/1.1" 200 None 2026-03-07 01:34:36,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:34:36,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 01:34:36,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:34:36,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8dd9d911a9cbe7f77df43 HTTP/1.1" 200 None 2026-03-07 01:34:36,818 - lava_callback - ERROR - Error processing callback for node 69a8dd9d911a9cbe7f77df43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36140 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:34:50,570 - lava_callback - INFO - Received callback for node 69ab8072efa461f55e59dcf7 INFO: 172.20.0.1:51800 - "POST /node/69ab8072efa461f55e59dcf7 HTTP/1.0" 202 Accepted 2026-03-07 01:34:50,577 - lava_callback - INFO - Starting async job submit for node 69ab8072efa461f55e59dcf7 2026-03-07 01:34:50,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:34:50,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8072efa461f55e59dcf7 HTTP/1.1" 200 None 2026-03-07 01:34:50,634 - lava_callback - DEBUG - Processing node 69ab8072efa461f55e59dcf7: baseline-arm64 2026-03-07 01:34:50,764 - lava_callback - WARNING - Failed to upload log 2026-03-07 01:34:50,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:34:51,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:34:51,025 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab8072efa461f55e59dcf7/lava-logs.yaml 2026-03-07 01:34:51,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:34:51,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:34:51,178 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab8072efa461f55e59dcf7/lava_callback.json.gz 2026-03-07 01:34:51,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:34:51,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8072efa461f55e59dcf7 HTTP/1.1" 200 None 2026-03-07 01:34:51,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:34:51,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:34:51,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:34:51,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8072efa461f55e59dcf7 HTTP/1.1" 200 None 2026-03-07 01:34:51,346 - lava_callback - INFO - Completed processing callback for node 69ab8072efa461f55e59dcf7 INFO: 172.20.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41196 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:35:12,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:35:12,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56652 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:35:56,732 - lava_callback - INFO - Received callback for node 69a8ddf3911a9cbe7f77df89 INFO: 172.20.0.1:56654 - "POST /node/69a8ddf3911a9cbe7f77df89 HTTP/1.0" 202 Accepted 2026-03-07 01:35:56,738 - lava_callback - INFO - Starting async job submit for node 69a8ddf3911a9cbe7f77df89 2026-03-07 01:35:56,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:35:56,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ddf3911a9cbe7f77df89 HTTP/1.1" 200 None 2026-03-07 01:35:56,766 - lava_callback - DEBUG - Processing node 69a8ddf3911a9cbe7f77df89: baseline-arm64-baylibre 2026-03-07 01:35:56,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8ddf3911a9cbe7f77df89 2026-03-07 01:35:56,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:35:56,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ddf3911a9cbe7f77df89 HTTP/1.1" 200 None 2026-03-07 01:35:56,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:35:56,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 01:35:56,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:35:56,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8ddf3911a9cbe7f77df89 HTTP/1.1" 200 None 2026-03-07 01:35:56,850 - lava_callback - ERROR - Error processing callback for node 69a8ddf3911a9cbe7f77df89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48634 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:37:16,740 - lava_callback - INFO - Received callback for node 69a8de49911a9cbe7f77dfce INFO: 172.20.0.1:48650 - "POST /node/69a8de49911a9cbe7f77dfce HTTP/1.0" 202 Accepted 2026-03-07 01:37:16,745 - lava_callback - INFO - Starting async job submit for node 69a8de49911a9cbe7f77dfce 2026-03-07 01:37:16,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:37:16,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8de49911a9cbe7f77dfce HTTP/1.1" 200 None 2026-03-07 01:37:16,764 - lava_callback - DEBUG - Processing node 69a8de49911a9cbe7f77dfce: baseline-arm64-baylibre 2026-03-07 01:37:16,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8de49911a9cbe7f77dfce 2026-03-07 01:37:16,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:37:16,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8de49911a9cbe7f77dfce HTTP/1.1" 200 None 2026-03-07 01:37:16,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:37:16,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 01:37:16,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:37:16,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8de49911a9cbe7f77dfce HTTP/1.1" 200 None 2026-03-07 01:37:16,823 - lava_callback - ERROR - Error processing callback for node 69a8de49911a9cbe7f77dfce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50478 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:38:10,765 - lava_callback - INFO - Received callback for node 69ab814defa461f55e59dd51 INFO: 172.20.0.1:33684 - "POST /node/69ab814defa461f55e59dd51 HTTP/1.0" 202 Accepted 2026-03-07 01:38:10,772 - lava_callback - INFO - Starting async job submit for node 69ab814defa461f55e59dd51 2026-03-07 01:38:10,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:38:10,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab814defa461f55e59dd51 HTTP/1.1" 200 None 2026-03-07 01:38:10,816 - lava_callback - DEBUG - Processing node 69ab814defa461f55e59dd51: baseline-arm64 2026-03-07 01:38:10,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:38:11,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:38:11,135 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab814defa461f55e59dd51/log.txt.gz 2026-03-07 01:38:11,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:38:11,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:38:11,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab814defa461f55e59dd51/lava-logs.yaml 2026-03-07 01:38:11,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:38:11,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:38:11,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab814defa461f55e59dd51/lava_callback.json.gz 2026-03-07 01:38:11,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:38:11,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab814defa461f55e59dd51 HTTP/1.1" 200 None 2026-03-07 01:38:11,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:38:11,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:38:11,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:38:11,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab814defa461f55e59dd51 HTTP/1.1" 200 None 2026-03-07 01:38:11,696 - lava_callback - INFO - Completed processing callback for node 69ab814defa461f55e59dd51 2026-03-07 01:38:12,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:38:12,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57456 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:38:56,783 - lava_callback - INFO - Received callback for node 69a8de9f911a9cbe7f77e008 INFO: 172.20.0.1:57460 - "POST /node/69a8de9f911a9cbe7f77e008 HTTP/1.0" 202 Accepted 2026-03-07 01:38:56,789 - lava_callback - INFO - Starting async job submit for node 69a8de9f911a9cbe7f77e008 2026-03-07 01:38:56,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:38:56,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8de9f911a9cbe7f77e008 HTTP/1.1" 200 None 2026-03-07 01:38:56,805 - lava_callback - DEBUG - Processing node 69a8de9f911a9cbe7f77e008: baseline-arm64-baylibre 2026-03-07 01:38:56,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8de9f911a9cbe7f77e008 2026-03-07 01:38:56,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:38:56,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8de9f911a9cbe7f77e008 HTTP/1.1" 200 None 2026-03-07 01:38:56,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:38:56,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 01:38:56,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:38:56,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8de9f911a9cbe7f77e008 HTTP/1.1" 200 None 2026-03-07 01:38:56,871 - lava_callback - ERROR - Error processing callback for node 69a8de9f911a9cbe7f77e008: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47658 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:39:30,497 - lava_callback - INFO - Received callback for node 69ab7d13efa461f55e59da1d INFO: 172.20.0.1:41226 - "POST /node/69ab7d13efa461f55e59da1d HTTP/1.0" 202 Accepted 2026-03-07 01:39:30,503 - lava_callback - INFO - Starting async job submit for node 69ab7d13efa461f55e59da1d 2026-03-07 01:39:30,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:39:30,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d13efa461f55e59da1d HTTP/1.1" 200 None 2026-03-07 01:39:30,549 - lava_callback - DEBUG - Processing node 69ab7d13efa461f55e59da1d: baseline-arm64-broonie 2026-03-07 01:39:30,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:39:31,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:39:31,055 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d13efa461f55e59da1d/log.txt.gz 2026-03-07 01:39:31,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:39:31,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:39:31,449 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d13efa461f55e59da1d/lava-logs.yaml 2026-03-07 01:39:31,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:39:31,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:39:31,638 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d13efa461f55e59da1d/lava_callback.json.gz 2026-03-07 01:39:31,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:39:31,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d13efa461f55e59da1d HTTP/1.1" 200 None 2026-03-07 01:39:31,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:39:31,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:39:31,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:39:31,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d13efa461f55e59da1d HTTP/1.1" 200 None 2026-03-07 01:39:31,736 - lava_callback - INFO - Completed processing callback for node 69ab7d13efa461f55e59da1d INFO: 172.20.0.1:41240 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:39:42,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:39:42,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60102 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:40:16,934 - lava_callback - INFO - Received callback for node 69a8def3911a9cbe7f77e044 INFO: 172.20.0.1:60118 - "POST /node/69a8def3911a9cbe7f77e044 HTTP/1.0" 202 Accepted 2026-03-07 01:40:16,940 - lava_callback - INFO - Starting async job submit for node 69a8def3911a9cbe7f77e044 2026-03-07 01:40:16,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:16,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8def3911a9cbe7f77e044 HTTP/1.1" 200 None 2026-03-07 01:40:16,959 - lava_callback - DEBUG - Processing node 69a8def3911a9cbe7f77e044: baseline-arm64-baylibre 2026-03-07 01:40:16,959 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8def3911a9cbe7f77e044 2026-03-07 01:40:16,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:16,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8def3911a9cbe7f77e044 HTTP/1.1" 200 None 2026-03-07 01:40:16,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:17,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 01:40:17,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:17,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8def3911a9cbe7f77e044 HTTP/1.1" 200 None 2026-03-07 01:40:17,029 - lava_callback - ERROR - Error processing callback for node 69a8def3911a9cbe7f77e044: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45956 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:40:32,117 - lava_callback - INFO - Received callback for node 69ab7c90efa461f55e59d938 INFO: 172.20.0.1:53396 - "POST /node/69ab7c90efa461f55e59d938 HTTP/1.0" 202 Accepted 2026-03-07 01:40:32,123 - lava_callback - INFO - Starting async job submit for node 69ab7c90efa461f55e59d938 2026-03-07 01:40:32,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:32,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7c90efa461f55e59d938 HTTP/1.1" 200 None 2026-03-07 01:40:32,163 - lava_callback - DEBUG - Processing node 69ab7c90efa461f55e59d938: ltp-ipc 2026-03-07 01:40:32,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:40:32,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:40:32,664 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69ab7c90efa461f55e59d938/log.txt.gz 2026-03-07 01:40:32,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:40:33,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:40:33,099 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69ab7c90efa461f55e59d938/lava-logs.yaml 2026-03-07 01:40:33,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:40:33,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:40:33,290 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69ab7c90efa461f55e59d938/lava_callback.json.gz 2026-03-07 01:40:33,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:33,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7c90efa461f55e59d938 HTTP/1.1" 200 None 2026-03-07 01:40:33,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:33,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:40:33,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:33,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7c90efa461f55e59d938 HTTP/1.1" 200 None 2026-03-07 01:40:33,384 - lava_callback - INFO - Completed processing callback for node 69ab7c90efa461f55e59d938 2026-03-07 01:40:33,581 - lava_callback - INFO - Received callback for node 69ab7d19efa461f55e59da32 INFO: 172.20.0.1:53412 - "POST /node/69ab7d19efa461f55e59da32 HTTP/1.0" 202 Accepted 2026-03-07 01:40:33,591 - lava_callback - INFO - Starting async job submit for node 69ab7d19efa461f55e59da32 2026-03-07 01:40:33,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:33,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d19efa461f55e59da32 HTTP/1.1" 200 None 2026-03-07 01:40:33,645 - lava_callback - DEBUG - Processing node 69ab7d19efa461f55e59da32: baseline-arm64-broonie 2026-03-07 01:40:33,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:40:34,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:40:34,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d19efa461f55e59da32/log.txt.gz 2026-03-07 01:40:34,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:40:34,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:40:34,416 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d19efa461f55e59da32/lava-logs.yaml 2026-03-07 01:40:34,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:40:34,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:40:34,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d19efa461f55e59da32/lava_callback.json.gz 2026-03-07 01:40:34,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:34,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d19efa461f55e59da32 HTTP/1.1" 200 None 2026-03-07 01:40:34,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:34,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:40:34,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:34,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d19efa461f55e59da32 HTTP/1.1" 200 None 2026-03-07 01:40:34,721 - lava_callback - INFO - Completed processing callback for node 69ab7d19efa461f55e59da32 INFO: 172.20.0.1:53420 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:40:42,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:40:42,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44342 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:41:28,473 - lava_callback - INFO - Received callback for node 69ab7fc7efa461f55e59dca8 INFO: 172.20.0.1:44346 - "POST /node/69ab7fc7efa461f55e59dca8 HTTP/1.0" 202 Accepted 2026-03-07 01:41:28,480 - lava_callback - INFO - Starting async job submit for node 69ab7fc7efa461f55e59dca8 2026-03-07 01:41:28,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:28,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7fc7efa461f55e59dca8 HTTP/1.1" 200 None 2026-03-07 01:41:28,534 - lava_callback - DEBUG - Processing node 69ab7fc7efa461f55e59dca8: baseline-arm64 2026-03-07 01:41:28,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:41:29,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:41:29,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7fc7efa461f55e59dca8/log.txt.gz 2026-03-07 01:41:29,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:41:29,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:41:29,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7fc7efa461f55e59dca8/lava-logs.yaml 2026-03-07 01:41:29,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:41:29,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:41:29,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab7fc7efa461f55e59dca8/lava_callback.json.gz DEBUG: Setup failed for 69ab7fc7efa461f55e59dca8. Transitting job node result: incomplete -> fail 2026-03-07 01:41:29,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:29,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7fc7efa461f55e59dca8 HTTP/1.1" 200 None 2026-03-07 01:41:29,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:29,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:41:29,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:29,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7fc7efa461f55e59dca8 HTTP/1.1" 200 None 2026-03-07 01:41:29,823 - lava_callback - INFO - Completed processing callback for node 69ab7fc7efa461f55e59dca8 2026-03-07 01:41:33,367 - lava_callback - INFO - Received callback for node 69ab7cf6efa461f55e59d9bf INFO: 172.20.0.1:37632 - "POST /node/69ab7cf6efa461f55e59d9bf HTTP/1.0" 202 Accepted 2026-03-07 01:41:33,376 - lava_callback - INFO - Starting async job submit for node 69ab7cf6efa461f55e59d9bf 2026-03-07 01:41:33,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:33,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf6efa461f55e59d9bf HTTP/1.1" 200 None 2026-03-07 01:41:33,438 - lava_callback - DEBUG - Processing node 69ab7cf6efa461f55e59d9bf: baseline-nfs-arm64 2026-03-07 01:41:34,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:41:34,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:41:34,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf6efa461f55e59d9bf/log.txt.gz 2026-03-07 01:41:35,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:41:35,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:41:35,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf6efa461f55e59d9bf/lava-logs.yaml 2026-03-07 01:41:35,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:41:36,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:41:36,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab7cf6efa461f55e59d9bf/lava_callback.json.gz DEBUG: Setup failed for 69ab7cf6efa461f55e59d9bf. Transitting job node result: incomplete -> fail 2026-03-07 01:41:36,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:36,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7cf6efa461f55e59d9bf HTTP/1.1" 200 None 2026-03-07 01:41:36,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:36,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:41:36,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:36,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7cf6efa461f55e59d9bf HTTP/1.1" 200 None 2026-03-07 01:41:36,302 - lava_callback - INFO - Completed processing callback for node 69ab7cf6efa461f55e59d9bf INFO: 172.20.0.1:37642 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:41:36,976 - lava_callback - INFO - Received callback for node 69a8df4a911a9cbe7f77e07c INFO: 172.20.0.1:37656 - "POST /node/69a8df4a911a9cbe7f77e07c HTTP/1.0" 202 Accepted 2026-03-07 01:41:36,981 - lava_callback - INFO - Starting async job submit for node 69a8df4a911a9cbe7f77e07c 2026-03-07 01:41:36,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:36,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8df4a911a9cbe7f77e07c HTTP/1.1" 200 None 2026-03-07 01:41:36,997 - lava_callback - DEBUG - Processing node 69a8df4a911a9cbe7f77e07c: baseline-arm64-baylibre 2026-03-07 01:41:36,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8df4a911a9cbe7f77e07c 2026-03-07 01:41:36,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:37,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8df4a911a9cbe7f77e07c HTTP/1.1" 200 None 2026-03-07 01:41:37,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:37,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 01:41:37,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:37,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8df4a911a9cbe7f77e07c HTTP/1.1" 200 None 2026-03-07 01:41:37,058 - lava_callback - ERROR - Error processing callback for node 69a8df4a911a9cbe7f77e07c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 01:41:42,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:42,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 01:41:43,469 - lava_callback - INFO - Received callback for node 69ab7c00efa461f55e59d90c INFO: 172.20.0.1:54728 - "POST /node/69ab7c00efa461f55e59d90c HTTP/1.0" 202 Accepted 2026-03-07 01:41:43,475 - lava_callback - INFO - Starting async job submit for node 69ab7c00efa461f55e59d90c 2026-03-07 01:41:43,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:43,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7c00efa461f55e59d90c HTTP/1.1" 200 None 2026-03-07 01:41:43,570 - lava_callback - DEBUG - Processing node 69ab7c00efa461f55e59d90c: ltp-smoke 2026-03-07 01:41:44,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:41:44,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:41:44,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab7c00efa461f55e59d90c/log.txt.gz 2026-03-07 01:41:44,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:41:44,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:41:44,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab7c00efa461f55e59d90c/lava-logs.yaml 2026-03-07 01:41:44,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:41:44,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:41:44,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab7c00efa461f55e59d90c/lava_callback.json.gz 2026-03-07 01:41:45,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:45,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7c00efa461f55e59d90c HTTP/1.1" 200 None 2026-03-07 01:41:45,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:45,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e3aefa461f55e59cdbd HTTP/1.1" 200 None 2026-03-07 01:41:45,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:41:45,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7c00efa461f55e59d90c HTTP/1.1" 200 None 2026-03-07 01:41:45,283 - lava_callback - INFO - Completed processing callback for node 69ab7c00efa461f55e59d90c INFO: 172.20.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51856 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:42:12,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:42:12,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59968 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:42:33,936 - lava_callback - INFO - Received callback for node 69ab8255efa461f55e59ddd6 INFO: 172.20.0.1:59884 - "POST /node/69ab8255efa461f55e59ddd6 HTTP/1.0" 202 Accepted 2026-03-07 01:42:33,943 - lava_callback - INFO - Starting async job submit for node 69ab8255efa461f55e59ddd6 2026-03-07 01:42:33,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:42:33,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8255efa461f55e59ddd6 HTTP/1.1" 200 None 2026-03-07 01:42:33,987 - lava_callback - DEBUG - Processing node 69ab8255efa461f55e59ddd6: baseline-arm64 2026-03-07 01:42:34,122 - lava_callback - WARNING - Failed to upload log 2026-03-07 01:42:34,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:42:34,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:42:34,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab8255efa461f55e59ddd6/lava-logs.yaml 2026-03-07 01:42:34,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:42:34,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:42:34,500 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab8255efa461f55e59ddd6/lava_callback.json.gz 2026-03-07 01:42:34,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:42:34,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8255efa461f55e59ddd6 HTTP/1.1" 200 None 2026-03-07 01:42:34,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:42:34,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:42:34,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:42:34,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8255efa461f55e59ddd6 HTTP/1.1" 200 None 2026-03-07 01:42:34,667 - lava_callback - INFO - Completed processing callback for node 69ab8255efa461f55e59ddd6 INFO: 172.20.0.1:59900 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:42:42,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:42:42,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40790 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:42:56,849 - lava_callback - INFO - Received callback for node 69aa1b619c5f93e4f05eeab4 INFO: 172.20.0.1:40796 - "POST /node/69aa1b619c5f93e4f05eeab4 HTTP/1.0" 202 Accepted 2026-03-07 01:42:56,855 - lava_callback - INFO - Starting async job submit for node 69aa1b619c5f93e4f05eeab4 2026-03-07 01:42:56,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:42:56,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1b619c5f93e4f05eeab4 HTTP/1.1" 200 None 2026-03-07 01:42:56,901 - lava_callback - DEBUG - Processing node 69aa1b619c5f93e4f05eeab4: baseline-x86 2026-03-07 01:42:57,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:42:57,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:42:57,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa1b619c5f93e4f05eeab4/log.txt.gz 2026-03-07 01:42:57,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:42:57,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:42:57,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa1b619c5f93e4f05eeab4/lava-logs.yaml 2026-03-07 01:42:57,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:42:57,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:42:57,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa1b619c5f93e4f05eeab4/lava_callback.json.gz DEBUG: Setup failed for 69aa1b619c5f93e4f05eeab4. Transitting job node result: incomplete -> fail 2026-03-07 01:42:57,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:42:57,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1b619c5f93e4f05eeab4 HTTP/1.1" 200 None 2026-03-07 01:42:57,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:42:57,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85b19440c1da21c23722a HTTP/1.1" 200 None 2026-03-07 01:42:57,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:42:57,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa1b619c5f93e4f05eeab4 HTTP/1.1" 200 None 2026-03-07 01:42:58,009 - lava_callback - INFO - Completed processing callback for node 69aa1b619c5f93e4f05eeab4 INFO: 172.20.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46876 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:43:12,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:43:12,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46406 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:43:17,016 - lava_callback - INFO - Received callback for node 69a8dfa0911a9cbe7f77e0aa INFO: 172.20.0.1:46420 - "POST /node/69a8dfa0911a9cbe7f77e0aa HTTP/1.0" 202 Accepted 2026-03-07 01:43:17,021 - lava_callback - INFO - Starting async job submit for node 69a8dfa0911a9cbe7f77e0aa 2026-03-07 01:43:17,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:43:17,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dfa0911a9cbe7f77e0aa HTTP/1.1" 200 None 2026-03-07 01:43:17,038 - lava_callback - DEBUG - Processing node 69a8dfa0911a9cbe7f77e0aa: baseline-arm64-baylibre 2026-03-07 01:43:17,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8dfa0911a9cbe7f77e0aa 2026-03-07 01:43:17,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:43:17,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dfa0911a9cbe7f77e0aa HTTP/1.1" 200 None 2026-03-07 01:43:17,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:43:17,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 01:43:17,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:43:17,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8dfa0911a9cbe7f77e0aa HTTP/1.1" 200 None 2026-03-07 01:43:17,093 - lava_callback - ERROR - Error processing callback for node 69a8dfa0911a9cbe7f77e0aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56764 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:44:37,116 - lava_callback - INFO - Received callback for node 69a8dff7911a9cbe7f77e0ec INFO: 172.20.0.1:56780 - "POST /node/69a8dff7911a9cbe7f77e0ec HTTP/1.0" 202 Accepted 2026-03-07 01:44:37,121 - lava_callback - INFO - Starting async job submit for node 69a8dff7911a9cbe7f77e0ec 2026-03-07 01:44:37,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:44:37,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dff7911a9cbe7f77e0ec HTTP/1.1" 200 None 2026-03-07 01:44:37,148 - lava_callback - DEBUG - Processing node 69a8dff7911a9cbe7f77e0ec: baseline-arm64-baylibre 2026-03-07 01:44:37,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8dff7911a9cbe7f77e0ec 2026-03-07 01:44:37,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:44:37,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8dff7911a9cbe7f77e0ec HTTP/1.1" 200 None 2026-03-07 01:44:37,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:44:37,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 01:44:37,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:44:37,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8dff7911a9cbe7f77e0ec HTTP/1.1" 200 None 2026-03-07 01:44:37,202 - lava_callback - ERROR - Error processing callback for node 69a8dff7911a9cbe7f77e0ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34808 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:46:37,246 - lava_callback - INFO - Received callback for node 69a8e06d911a9cbe7f77e14b INFO: 172.20.0.1:34818 - "POST /node/69a8e06d911a9cbe7f77e14b HTTP/1.0" 202 Accepted 2026-03-07 01:46:37,251 - lava_callback - INFO - Starting async job submit for node 69a8e06d911a9cbe7f77e14b 2026-03-07 01:46:37,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:46:37,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e06d911a9cbe7f77e14b HTTP/1.1" 200 None 2026-03-07 01:46:37,267 - lava_callback - DEBUG - Processing node 69a8e06d911a9cbe7f77e14b: baseline-arm-baylibre 2026-03-07 01:46:37,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e06d911a9cbe7f77e14b 2026-03-07 01:46:37,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:46:37,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e06d911a9cbe7f77e14b HTTP/1.1" 200 None 2026-03-07 01:46:37,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:46:37,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 01:46:37,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:46:37,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e06d911a9cbe7f77e14b HTTP/1.1" 200 None 2026-03-07 01:46:37,387 - lava_callback - ERROR - Error processing callback for node 69a8e06d911a9cbe7f77e14b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33284 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:48:12,012 - lava_callback - INFO - Received callback for node 69ab7be6efa461f55e59d907 INFO: 172.20.0.1:55096 - "POST /node/69ab7be6efa461f55e59d907 HTTP/1.0" 202 Accepted 2026-03-07 01:48:12,061 - lava_callback - INFO - Starting async job submit for node 69ab7be6efa461f55e59d907 2026-03-07 01:48:12,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:48:12,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7be6efa461f55e59d907 HTTP/1.1" 200 None 2026-03-07 01:48:12,101 - lava_callback - DEBUG - Processing node 69ab7be6efa461f55e59d907: baseline-arm-pengutronix 2026-03-07 01:48:12,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:48:12,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:48:12,387 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7be6efa461f55e59d907/log.txt.gz 2026-03-07 01:48:12,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:48:12,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:48:12,640 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7be6efa461f55e59d907/lava-logs.yaml 2026-03-07 01:48:12,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:48:12,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:48:12,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab7be6efa461f55e59d907/lava_callback.json.gz DEBUG: Setup failed for 69ab7be6efa461f55e59d907. Transitting job node result: incomplete -> fail 2026-03-07 01:48:12,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:48:12,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7be6efa461f55e59d907 HTTP/1.1" 200 None 2026-03-07 01:48:12,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:48:12,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:48:12,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:48:12,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7be6efa461f55e59d907 HTTP/1.1" 200 None 2026-03-07 01:48:12,931 - lava_callback - INFO - Completed processing callback for node 69ab7be6efa461f55e59d907 INFO: 172.20.0.1:55104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55114 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:48:17,362 - lava_callback - INFO - Received callback for node 69a8e0d7911a9cbe7f77e1e4 INFO: 172.20.0.1:55120 - "POST /node/69a8e0d7911a9cbe7f77e1e4 HTTP/1.0" 202 Accepted 2026-03-07 01:48:17,368 - lava_callback - INFO - Starting async job submit for node 69a8e0d7911a9cbe7f77e1e4 2026-03-07 01:48:17,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:48:17,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e0d7911a9cbe7f77e1e4 HTTP/1.1" 200 None 2026-03-07 01:48:17,384 - lava_callback - DEBUG - Processing node 69a8e0d7911a9cbe7f77e1e4: baseline-arm64-baylibre 2026-03-07 01:48:17,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e0d7911a9cbe7f77e1e4 2026-03-07 01:48:17,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:48:17,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e0d7911a9cbe7f77e1e4 HTTP/1.1" 200 None 2026-03-07 01:48:17,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:48:17,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 01:48:17,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:48:17,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e0d7911a9cbe7f77e1e4 HTTP/1.1" 200 None 2026-03-07 01:48:17,438 - lava_callback - ERROR - Error processing callback for node 69a8e0d7911a9cbe7f77e1e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42148 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:48:42,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:48:42,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48314 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:49:05,227 - lava_callback - INFO - Received callback for node 69ab83a4efa461f55e59de6b INFO: 172.20.0.1:41690 - "POST /node/69ab83a4efa461f55e59de6b HTTP/1.0" 202 Accepted 2026-03-07 01:49:05,235 - lava_callback - INFO - Starting async job submit for node 69ab83a4efa461f55e59de6b 2026-03-07 01:49:05,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:49:05,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab83a4efa461f55e59de6b HTTP/1.1" 200 None 2026-03-07 01:49:05,281 - lava_callback - DEBUG - Processing node 69ab83a4efa461f55e59de6b: baseline-arm64 2026-03-07 01:49:05,476 - lava_callback - WARNING - Failed to upload log 2026-03-07 01:49:05,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:49:05,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:49:05,784 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab83a4efa461f55e59de6b/lava-logs.yaml 2026-03-07 01:49:05,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:49:05,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:49:05,931 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab83a4efa461f55e59de6b/lava_callback.json.gz 2026-03-07 01:49:05,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:49:05,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab83a4efa461f55e59de6b HTTP/1.1" 200 None 2026-03-07 01:49:05,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:49:05,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:49:05,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:49:06,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab83a4efa461f55e59de6b HTTP/1.1" 200 None 2026-03-07 01:49:06,080 - lava_callback - INFO - Completed processing callback for node 69ab83a4efa461f55e59de6b INFO: 172.20.0.1:41702 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:49:12,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:49:12,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51352 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:50:00,070 - lava_callback - INFO - Received callback for node 69aa1ba29c5f93e4f05eeae3 INFO: 172.20.0.1:50940 - "POST /node/69aa1ba29c5f93e4f05eeae3 HTTP/1.0" 202 Accepted 2026-03-07 01:50:00,076 - lava_callback - INFO - Starting async job submit for node 69aa1ba29c5f93e4f05eeae3 2026-03-07 01:50:00,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:50:00,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1ba29c5f93e4f05eeae3 HTTP/1.1" 200 None 2026-03-07 01:50:00,124 - lava_callback - DEBUG - Processing node 69aa1ba29c5f93e4f05eeae3: baseline-x86 2026-03-07 01:50:00,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:50:00,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:50:00,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa1ba29c5f93e4f05eeae3/log.txt.gz 2026-03-07 01:50:00,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:50:00,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:50:00,916 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa1ba29c5f93e4f05eeae3/lava-logs.yaml 2026-03-07 01:50:00,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:50:01,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:50:01,058 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa1ba29c5f93e4f05eeae3/lava_callback.json.gz DEBUG: Setup failed for 69aa1ba29c5f93e4f05eeae3. Transitting job node result: incomplete -> fail 2026-03-07 01:50:01,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:50:01,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1ba29c5f93e4f05eeae3 HTTP/1.1" 200 None 2026-03-07 01:50:01,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:50:01,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8d000e9e7049205c4c9 HTTP/1.1" 200 None 2026-03-07 01:50:01,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:50:01,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa1ba29c5f93e4f05eeae3 HTTP/1.1" 200 None 2026-03-07 01:50:01,276 - lava_callback - INFO - Completed processing callback for node 69aa1ba29c5f93e4f05eeae3 2026-03-07 01:50:03,939 - lava_callback - INFO - Received callback for node 69ab804eefa461f55e59dcdf INFO: 172.20.0.1:50950 - "POST /node/69ab804eefa461f55e59dcdf HTTP/1.0" 202 Accepted 2026-03-07 01:50:03,946 - lava_callback - INFO - Starting async job submit for node 69ab804eefa461f55e59dcdf 2026-03-07 01:50:03,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:50:04,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab804eefa461f55e59dcdf HTTP/1.1" 200 None 2026-03-07 01:50:04,013 - lava_callback - DEBUG - Processing node 69ab804eefa461f55e59dcdf: baseline-arm 2026-03-07 01:50:04,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:50:04,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:50:04,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab804eefa461f55e59dcdf/log.txt.gz 2026-03-07 01:50:05,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:50:05,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:50:05,348 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab804eefa461f55e59dcdf/lava-logs.yaml 2026-03-07 01:50:05,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:50:05,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:50:05,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab804eefa461f55e59dcdf/lava_callback.json.gz DEBUG: Setup failed for 69ab804eefa461f55e59dcdf. Transitting job node result: incomplete -> fail 2026-03-07 01:50:05,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:50:05,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab804eefa461f55e59dcdf HTTP/1.1" 200 None 2026-03-07 01:50:05,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:50:05,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:50:05,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:50:05,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab804eefa461f55e59dcdf HTTP/1.1" 200 None 2026-03-07 01:50:05,839 - lava_callback - INFO - Completed processing callback for node 69ab804eefa461f55e59dcdf INFO: 172.20.0.1:50964 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:50:12,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:50:12,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60434 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:51:37,482 - lava_callback - INFO - Received callback for node 69a8e1a3911a9cbe7f77e285 INFO: 172.20.0.1:60444 - "POST /node/69a8e1a3911a9cbe7f77e285 HTTP/1.0" 202 Accepted 2026-03-07 01:51:37,488 - lava_callback - INFO - Starting async job submit for node 69a8e1a3911a9cbe7f77e285 2026-03-07 01:51:37,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:51:37,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e1a3911a9cbe7f77e285 HTTP/1.1" 200 None 2026-03-07 01:51:37,519 - lava_callback - DEBUG - Processing node 69a8e1a3911a9cbe7f77e285: baseline-arm-baylibre 2026-03-07 01:51:37,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e1a3911a9cbe7f77e285 2026-03-07 01:51:37,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:51:37,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e1a3911a9cbe7f77e285 HTTP/1.1" 200 None 2026-03-07 01:51:37,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:51:37,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 01:51:37,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:51:37,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e1a3911a9cbe7f77e285 HTTP/1.1" 200 None 2026-03-07 01:51:37,582 - lava_callback - ERROR - Error processing callback for node 69a8e1a3911a9cbe7f77e285: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47304 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:52:05,513 - lava_callback - INFO - Received callback for node 69aa1be29c5f93e4f05eeafa INFO: 172.20.0.1:53228 - "POST /node/69aa1be29c5f93e4f05eeafa HTTP/1.0" 202 Accepted 2026-03-07 01:52:05,519 - lava_callback - INFO - Starting async job submit for node 69aa1be29c5f93e4f05eeafa 2026-03-07 01:52:05,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:05,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1be29c5f93e4f05eeafa HTTP/1.1" 200 None 2026-03-07 01:52:05,564 - lava_callback - DEBUG - Processing node 69aa1be29c5f93e4f05eeafa: baseline-x86 2026-03-07 01:52:05,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:52:06,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:52:06,063 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa1be29c5f93e4f05eeafa/log.txt.gz 2026-03-07 01:52:06,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:52:06,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:52:06,420 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa1be29c5f93e4f05eeafa/lava-logs.yaml 2026-03-07 01:52:06,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:53236 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:52:06,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:52:06,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa1be29c5f93e4f05eeafa/lava_callback.json.gz DEBUG: Setup failed for 69aa1be29c5f93e4f05eeafa. Transitting job node result: incomplete -> fail 2026-03-07 01:52:06,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:06,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1be29c5f93e4f05eeafa HTTP/1.1" 200 None 2026-03-07 01:52:06,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:06,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8d000e9e7049205c4c9 HTTP/1.1" 200 None 2026-03-07 01:52:06,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:06,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa1be29c5f93e4f05eeafa HTTP/1.1" 200 None 2026-03-07 01:52:06,805 - lava_callback - INFO - Completed processing callback for node 69aa1be29c5f93e4f05eeafa 2026-03-07 01:52:12,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:12,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 01:52:13,502 - lava_callback - INFO - Received callback for node 69aa22678c4d487a0e751447 INFO: 172.20.0.1:42304 - "POST /node/69aa22678c4d487a0e751447 HTTP/1.0" 202 Accepted 2026-03-07 01:52:13,508 - lava_callback - INFO - Starting async job submit for node 69aa22678c4d487a0e751447 2026-03-07 01:52:13,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:13,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa22678c4d487a0e751447 HTTP/1.1" 200 None 2026-03-07 01:52:13,563 - lava_callback - DEBUG - Processing node 69aa22678c4d487a0e751447: baseline-x86 2026-03-07 01:52:13,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:52:14,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:52:14,025 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa22678c4d487a0e751447/log.txt.gz 2026-03-07 01:52:14,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:52:14,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:52:14,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa22678c4d487a0e751447/lava-logs.yaml 2026-03-07 01:52:14,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:52:14,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:52:14,591 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa22678c4d487a0e751447/lava_callback.json.gz 2026-03-07 01:52:14,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:14,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa22678c4d487a0e751447 HTTP/1.1" 200 None 2026-03-07 01:52:14,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:14,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d638c4d487a0e751178 HTTP/1.1" 200 None 2026-03-07 01:52:14,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:14,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa22678c4d487a0e751447 HTTP/1.1" 200 None 2026-03-07 01:52:14,668 - lava_callback - INFO - Completed processing callback for node 69aa22678c4d487a0e751447 INFO: 172.20.0.1:42320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39304 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:52:37,569 - lava_callback - INFO - Received callback for node 69a8e1d2911a9cbe7f77e2d5 INFO: 172.20.0.1:39306 - "POST /node/69a8e1d2911a9cbe7f77e2d5 HTTP/1.0" 202 Accepted 2026-03-07 01:52:37,574 - lava_callback - INFO - Starting async job submit for node 69a8e1d2911a9cbe7f77e2d5 2026-03-07 01:52:37,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:37,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e1d2911a9cbe7f77e2d5 HTTP/1.1" 200 None 2026-03-07 01:52:37,595 - lava_callback - DEBUG - Processing node 69a8e1d2911a9cbe7f77e2d5: baseline-arm-baylibre 2026-03-07 01:52:37,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e1d2911a9cbe7f77e2d5 2026-03-07 01:52:37,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:37,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e1d2911a9cbe7f77e2d5 HTTP/1.1" 200 None 2026-03-07 01:52:37,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:37,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 01:52:37,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:37,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e1d2911a9cbe7f77e2d5 HTTP/1.1" 200 None 2026-03-07 01:52:37,675 - lava_callback - ERROR - Error processing callback for node 69a8e1d2911a9cbe7f77e2d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 01:52:42,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:52:42,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34996 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:55:37,707 - lava_callback - INFO - Received callback for node 69a8e285911a9cbe7f77e3a6 INFO: 172.20.0.1:35008 - "POST /node/69a8e285911a9cbe7f77e3a6 HTTP/1.0" 202 Accepted 2026-03-07 01:55:37,714 - lava_callback - INFO - Starting async job submit for node 69a8e285911a9cbe7f77e3a6 2026-03-07 01:55:37,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:55:37,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e285911a9cbe7f77e3a6 HTTP/1.1" 200 None 2026-03-07 01:55:37,736 - lava_callback - DEBUG - Processing node 69a8e285911a9cbe7f77e3a6: baseline-arm-baylibre 2026-03-07 01:55:37,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e285911a9cbe7f77e3a6 2026-03-07 01:55:37,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:55:37,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e285911a9cbe7f77e3a6 HTTP/1.1" 200 None 2026-03-07 01:55:37,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:55:37,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 01:55:37,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:55:37,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e285911a9cbe7f77e3a6 HTTP/1.1" 200 None 2026-03-07 01:55:37,790 - lava_callback - ERROR - Error processing callback for node 69a8e285911a9cbe7f77e3a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43254 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:55:51,500 - lava_callback - INFO - Received callback for node 69ab7d11efa461f55e59da19 INFO: 172.20.0.1:41090 - "POST /node/69ab7d11efa461f55e59da19 HTTP/1.0" 202 Accepted 2026-03-07 01:55:51,507 - lava_callback - INFO - Starting async job submit for node 69ab7d11efa461f55e59da19 2026-03-07 01:55:51,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:55:51,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d11efa461f55e59da19 HTTP/1.1" 200 None 2026-03-07 01:55:51,560 - lava_callback - DEBUG - Processing node 69ab7d11efa461f55e59da19: baseline-arm64-broonie 2026-03-07 01:55:51,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:55:51,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:55:51,993 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d11efa461f55e59da19/log.txt.gz 2026-03-07 01:55:52,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:55:52,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:55:52,404 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d11efa461f55e59da19/lava-logs.yaml 2026-03-07 01:55:52,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:55:52,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:55:52,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d11efa461f55e59da19/lava_callback.json.gz 2026-03-07 01:55:52,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:55:52,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d11efa461f55e59da19 HTTP/1.1" 200 None 2026-03-07 01:55:52,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:55:52,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:55:52,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:55:52,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d11efa461f55e59da19 HTTP/1.1" 200 None 2026-03-07 01:55:52,685 - lava_callback - INFO - Completed processing callback for node 69ab7d11efa461f55e59da19 INFO: 172.20.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34598 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:56:12,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:56:12,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38962 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:56:31,097 - lava_callback - INFO - Received callback for node 69ab859cefa461f55e59df31 INFO: 172.20.0.1:51826 - "POST /node/69ab859cefa461f55e59df31 HTTP/1.0" 202 Accepted 2026-03-07 01:56:31,104 - lava_callback - INFO - Starting async job submit for node 69ab859cefa461f55e59df31 2026-03-07 01:56:31,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:56:31,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab859cefa461f55e59df31 HTTP/1.1" 200 None 2026-03-07 01:56:31,153 - lava_callback - DEBUG - Processing node 69ab859cefa461f55e59df31: baseline-arm64 2026-03-07 01:56:31,365 - lava_callback - WARNING - Failed to upload log 2026-03-07 01:56:31,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:56:31,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:56:31,685 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab859cefa461f55e59df31/lava-logs.yaml 2026-03-07 01:56:31,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:56:31,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:56:31,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab859cefa461f55e59df31/lava_callback.json.gz 2026-03-07 01:56:31,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:56:31,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab859cefa461f55e59df31 HTTP/1.1" 200 None 2026-03-07 01:56:31,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:56:31,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:56:31,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:56:31,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab859cefa461f55e59df31 HTTP/1.1" 200 None 2026-03-07 01:56:31,995 - lava_callback - INFO - Completed processing callback for node 69ab859cefa461f55e59df31 INFO: 172.20.0.1:51828 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:56:37,701 - lava_callback - INFO - Received callback for node 69a8e2c0911a9cbe7f77e3fc INFO: 172.20.0.1:51844 - "POST /node/69a8e2c0911a9cbe7f77e3fc HTTP/1.0" 202 Accepted 2026-03-07 01:56:37,706 - lava_callback - INFO - Starting async job submit for node 69a8e2c0911a9cbe7f77e3fc 2026-03-07 01:56:37,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:56:37,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e2c0911a9cbe7f77e3fc HTTP/1.1" 200 None 2026-03-07 01:56:37,722 - lava_callback - DEBUG - Processing node 69a8e2c0911a9cbe7f77e3fc: baseline-arm64-baylibre 2026-03-07 01:56:37,722 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e2c0911a9cbe7f77e3fc 2026-03-07 01:56:37,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:56:37,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e2c0911a9cbe7f77e3fc HTTP/1.1" 200 None 2026-03-07 01:56:37,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:56:37,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 01:56:37,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:56:37,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e2c0911a9cbe7f77e3fc HTTP/1.1" 200 None 2026-03-07 01:56:37,779 - lava_callback - ERROR - Error processing callback for node 69a8e2c0911a9cbe7f77e3fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 01:56:42,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:56:42,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53352 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:58:07,587 - lava_callback - INFO - Received callback for node 69ab81a2efa461f55e59dd6b INFO: 172.20.0.1:53356 - "POST /node/69ab81a2efa461f55e59dd6b HTTP/1.0" 202 Accepted 2026-03-07 01:58:07,593 - lava_callback - INFO - Starting async job submit for node 69ab81a2efa461f55e59dd6b 2026-03-07 01:58:07,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:58:07,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab81a2efa461f55e59dd6b HTTP/1.1" 200 None 2026-03-07 01:58:07,639 - lava_callback - DEBUG - Processing node 69ab81a2efa461f55e59dd6b: baseline-arm-clabbe 2026-03-07 01:58:07,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:58:08,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:58:08,003 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab81a2efa461f55e59dd6b/log.txt.gz 2026-03-07 01:58:08,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:58:08,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:58:08,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab81a2efa461f55e59dd6b/lava-logs.yaml 2026-03-07 01:58:08,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:58:08,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:58:08,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab81a2efa461f55e59dd6b/lava_callback.json.gz DEBUG: Setup failed for 69ab81a2efa461f55e59dd6b. Transitting job node result: incomplete -> fail 2026-03-07 01:58:08,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:58:08,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab81a2efa461f55e59dd6b HTTP/1.1" 200 None 2026-03-07 01:58:08,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:58:08,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 01:58:08,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:58:08,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab81a2efa461f55e59dd6b HTTP/1.1" 200 None 2026-03-07 01:58:08,666 - lava_callback - INFO - Completed processing callback for node 69ab81a2efa461f55e59dd6b 2026-03-07 01:58:12,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:58:12,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45910 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:58:37,908 - lava_callback - INFO - Received callback for node 69a8e338911a9cbe7f77e46a INFO: 172.20.0.1:45914 - "POST /node/69a8e338911a9cbe7f77e46a HTTP/1.0" 202 Accepted 2026-03-07 01:58:37,914 - lava_callback - INFO - Starting async job submit for node 69a8e338911a9cbe7f77e46a 2026-03-07 01:58:37,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:58:37,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e338911a9cbe7f77e46a HTTP/1.1" 200 None 2026-03-07 01:58:37,954 - lava_callback - DEBUG - Processing node 69a8e338911a9cbe7f77e46a: baseline-arm-baylibre 2026-03-07 01:58:37,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e338911a9cbe7f77e46a 2026-03-07 01:58:37,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:58:37,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e338911a9cbe7f77e46a HTTP/1.1" 200 None 2026-03-07 01:58:37,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:58:37,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 01:58:37,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:58:38,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e338911a9cbe7f77e46a HTTP/1.1" 200 None 2026-03-07 01:58:38,014 - lava_callback - ERROR - Error processing callback for node 69a8e338911a9cbe7f77e46a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51200 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 01:59:16,148 - lava_callback - INFO - Received callback for node 69ab84b6efa461f55e59dedf INFO: 172.20.0.1:51208 - "POST /node/69ab84b6efa461f55e59dedf HTTP/1.0" 202 Accepted 2026-03-07 01:59:16,156 - lava_callback - INFO - Starting async job submit for node 69ab84b6efa461f55e59dedf 2026-03-07 01:59:16,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:59:16,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab84b6efa461f55e59dedf HTTP/1.1" 200 None 2026-03-07 01:59:16,219 - lava_callback - DEBUG - Processing node 69ab84b6efa461f55e59dedf: baseline-arm64 INFO: 172.20.0.1:51212 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:59:16,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:59:16,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:59:16,853 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab84b6efa461f55e59dedf/log.txt.gz 2026-03-07 01:59:17,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:59:17,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:59:17,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab84b6efa461f55e59dedf/lava-logs.yaml 2026-03-07 01:59:17,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 01:59:17,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 01:59:17,530 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab84b6efa461f55e59dedf/lava_callback.json.gz DEBUG: Setup failed for 69ab84b6efa461f55e59dedf. Transitting job node result: incomplete -> fail 2026-03-07 01:59:17,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:59:17,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab84b6efa461f55e59dedf HTTP/1.1" 200 None 2026-03-07 01:59:17,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:59:17,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 01:59:17,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:59:17,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab84b6efa461f55e59dedf HTTP/1.1" 200 None 2026-03-07 01:59:17,877 - lava_callback - INFO - Completed processing callback for node 69ab84b6efa461f55e59dedf INFO: 172.20.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58562 - "GET / HTTP/1.0" 200 OK 2026-03-07 01:59:42,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 01:59:42,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38424 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:01:58,157 - lava_callback - INFO - Received callback for node 69a8e411911a9cbe7f77e567 INFO: 172.20.0.1:38434 - "POST /node/69a8e411911a9cbe7f77e567 HTTP/1.0" 202 Accepted 2026-03-07 02:01:58,163 - lava_callback - INFO - Starting async job submit for node 69a8e411911a9cbe7f77e567 2026-03-07 02:01:58,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:01:58,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e411911a9cbe7f77e567 HTTP/1.1" 200 None 2026-03-07 02:01:58,191 - lava_callback - DEBUG - Processing node 69a8e411911a9cbe7f77e567: baseline-arm-baylibre 2026-03-07 02:01:58,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e411911a9cbe7f77e567 2026-03-07 02:01:58,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:01:58,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e411911a9cbe7f77e567 HTTP/1.1" 200 None 2026-03-07 02:01:58,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:01:58,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 02:01:58,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:01:58,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e411911a9cbe7f77e567 HTTP/1.1" 200 None 2026-03-07 02:01:58,255 - lava_callback - ERROR - Error processing callback for node 69a8e411911a9cbe7f77e567: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58894 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:03:35,253 - lava_callback - INFO - Received callback for node 69ab8735efa461f55e59dfdb INFO: 172.20.0.1:36472 - "POST /node/69ab8735efa461f55e59dfdb HTTP/1.0" 202 Accepted 2026-03-07 02:03:35,260 - lava_callback - INFO - Starting async job submit for node 69ab8735efa461f55e59dfdb 2026-03-07 02:03:35,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:03:35,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8735efa461f55e59dfdb HTTP/1.1" 200 None 2026-03-07 02:03:35,307 - lava_callback - DEBUG - Processing node 69ab8735efa461f55e59dfdb: baseline-arm64 2026-03-07 02:03:35,455 - lava_callback - WARNING - Failed to upload log 2026-03-07 02:03:35,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:03:35,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:03:35,729 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab8735efa461f55e59dfdb/lava-logs.yaml 2026-03-07 02:03:35,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:03:35,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:03:35,889 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab8735efa461f55e59dfdb/lava_callback.json.gz 2026-03-07 02:03:35,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:03:35,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8735efa461f55e59dfdb HTTP/1.1" 200 None 2026-03-07 02:03:35,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:03:35,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 02:03:35,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:03:35,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8735efa461f55e59dfdb HTTP/1.1" 200 None 2026-03-07 02:03:36,049 - lava_callback - INFO - Completed processing callback for node 69ab8735efa461f55e59dfdb INFO: 172.20.0.1:36478 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:03:38,093 - lava_callback - INFO - Received callback for node 69a8e46e911a9cbe7f77e5e6 INFO: 172.20.0.1:36492 - "POST /node/69a8e46e911a9cbe7f77e5e6 HTTP/1.0" 202 Accepted 2026-03-07 02:03:38,099 - lava_callback - INFO - Starting async job submit for node 69a8e46e911a9cbe7f77e5e6 2026-03-07 02:03:38,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:03:38,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e46e911a9cbe7f77e5e6 HTTP/1.1" 200 None 2026-03-07 02:03:38,114 - lava_callback - DEBUG - Processing node 69a8e46e911a9cbe7f77e5e6: baseline-arm-baylibre 2026-03-07 02:03:38,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e46e911a9cbe7f77e5e6 2026-03-07 02:03:38,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:03:38,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e46e911a9cbe7f77e5e6 HTTP/1.1" 200 None 2026-03-07 02:03:38,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:03:38,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 02:03:38,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:03:38,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e46e911a9cbe7f77e5e6 HTTP/1.1" 200 None 2026-03-07 02:03:38,170 - lava_callback - ERROR - Error processing callback for node 69a8e46e911a9cbe7f77e5e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 02:03:42,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:03:42,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49820 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:04:58,285 - lava_callback - INFO - Received callback for node 69aa20e28c4d487a0e751264 INFO: 172.20.0.1:49822 - "POST /node/69aa20e28c4d487a0e751264 HTTP/1.0" 202 Accepted 2026-03-07 02:04:58,291 - lava_callback - INFO - Starting async job submit for node 69aa20e28c4d487a0e751264 2026-03-07 02:04:58,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:04:58,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa20e28c4d487a0e751264 HTTP/1.1" 200 None 2026-03-07 02:04:58,344 - lava_callback - DEBUG - Processing node 69aa20e28c4d487a0e751264: baseline-x86 2026-03-07 02:04:58,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:04:58,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:04:58,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa20e28c4d487a0e751264/log.txt.gz 2026-03-07 02:04:58,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:04:59,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:04:59,130 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa20e28c4d487a0e751264/lava-logs.yaml 2026-03-07 02:04:59,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:04:59,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:04:59,304 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa20e28c4d487a0e751264/lava_callback.json.gz DEBUG: Setup failed for 69aa20e28c4d487a0e751264. Transitting job node result: incomplete -> fail 2026-03-07 02:04:59,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:04:59,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa20e28c4d487a0e751264 HTTP/1.1" 200 None 2026-03-07 02:04:59,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:04:59,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85b19440c1da21c23722a HTTP/1.1" 200 None 2026-03-07 02:04:59,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:49824 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:04:59,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa20e28c4d487a0e751264 HTTP/1.1" 200 None 2026-03-07 02:04:59,521 - lava_callback - INFO - Completed processing callback for node 69aa20e28c4d487a0e751264 INFO: 172.20.0.1:39946 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:05:12,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:05:13,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58932 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:08:21,537 - lava_callback - INFO - Received callback for node 69ab7d15efa461f55e59da25 INFO: 172.20.0.1:53912 - "POST /node/69ab7d15efa461f55e59da25 HTTP/1.0" 202 Accepted 2026-03-07 02:08:21,543 - lava_callback - INFO - Starting async job submit for node 69ab7d15efa461f55e59da25 2026-03-07 02:08:21,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:08:21,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d15efa461f55e59da25 HTTP/1.1" 200 None 2026-03-07 02:08:21,598 - lava_callback - DEBUG - Processing node 69ab7d15efa461f55e59da25: baseline-arm64-broonie 2026-03-07 02:08:21,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:08:21,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:08:21,996 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d15efa461f55e59da25/log.txt.gz 2026-03-07 02:08:22,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:08:22,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:08:22,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d15efa461f55e59da25/lava-logs.yaml 2026-03-07 02:08:22,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:08:22,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:08:22,572 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d15efa461f55e59da25/lava_callback.json.gz 2026-03-07 02:08:22,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:08:22,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d15efa461f55e59da25 HTTP/1.1" 200 None 2026-03-07 02:08:22,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:08:22,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 02:08:22,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:08:22,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d15efa461f55e59da25 HTTP/1.1" 200 None 2026-03-07 02:08:22,651 - lava_callback - INFO - Completed processing callback for node 69ab7d15efa461f55e59da25 INFO: 172.20.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49982 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:08:43,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:08:43,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39904 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:11:38,547 - lava_callback - INFO - Received callback for node 69a8e652911a9cbe7f77e7db INFO: 172.20.0.1:39916 - "POST /node/69a8e652911a9cbe7f77e7db HTTP/1.0" 202 Accepted 2026-03-07 02:11:38,552 - lava_callback - INFO - Starting async job submit for node 69a8e652911a9cbe7f77e7db 2026-03-07 02:11:38,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:11:38,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e652911a9cbe7f77e7db HTTP/1.1" 200 None 2026-03-07 02:11:38,568 - lava_callback - DEBUG - Processing node 69a8e652911a9cbe7f77e7db: baseline-arm-baylibre 2026-03-07 02:11:38,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e652911a9cbe7f77e7db 2026-03-07 02:11:38,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:11:38,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e652911a9cbe7f77e7db HTTP/1.1" 200 None 2026-03-07 02:11:38,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:11:38,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 02:11:38,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:11:38,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e652911a9cbe7f77e7db HTTP/1.1" 200 None 2026-03-07 02:11:38,631 - lava_callback - ERROR - Error processing callback for node 69a8e652911a9cbe7f77e7db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47188 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:12:18,521 - lava_callback - INFO - Received callback for node 69a8e680911a9cbe7f77e80f INFO: 172.20.0.1:47202 - "POST /node/69a8e680911a9cbe7f77e80f HTTP/1.0" 202 Accepted 2026-03-07 02:12:18,527 - lava_callback - INFO - Starting async job submit for node 69a8e680911a9cbe7f77e80f 2026-03-07 02:12:18,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:12:18,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e680911a9cbe7f77e80f HTTP/1.1" 200 None 2026-03-07 02:12:18,545 - lava_callback - DEBUG - Processing node 69a8e680911a9cbe7f77e80f: baseline-arm-baylibre 2026-03-07 02:12:18,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e680911a9cbe7f77e80f 2026-03-07 02:12:18,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:12:18,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e680911a9cbe7f77e80f HTTP/1.1" 200 None 2026-03-07 02:12:18,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:12:18,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 02:12:18,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:12:18,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e680911a9cbe7f77e80f HTTP/1.1" 200 None 2026-03-07 02:12:18,628 - lava_callback - ERROR - Error processing callback for node 69a8e680911a9cbe7f77e80f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57154 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:13:05,337 - lava_callback - INFO - Received callback for node 69ab8506efa461f55e59defe INFO: 172.20.0.1:45916 - "POST /node/69ab8506efa461f55e59defe HTTP/1.0" 202 Accepted 2026-03-07 02:13:05,344 - lava_callback - INFO - Starting async job submit for node 69ab8506efa461f55e59defe 2026-03-07 02:13:05,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:05,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8506efa461f55e59defe HTTP/1.1" 200 None 2026-03-07 02:13:05,406 - lava_callback - DEBUG - Processing node 69ab8506efa461f55e59defe: baseline-nfs-arm64 INFO: 172.20.0.1:45924 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:13:06,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:13:06,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:13:06,858 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab8506efa461f55e59defe/log.txt.gz 2026-03-07 02:13:07,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:13:07,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:13:07,759 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab8506efa461f55e59defe/lava-logs.yaml 2026-03-07 02:13:07,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:13:07,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:13:07,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab8506efa461f55e59defe/lava_callback.json.gz DEBUG: Setup failed for 69ab8506efa461f55e59defe. Transitting job node result: incomplete -> fail 2026-03-07 02:13:08,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:08,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8506efa461f55e59defe HTTP/1.1" 200 None 2026-03-07 02:13:08,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:08,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 02:13:08,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:08,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8506efa461f55e59defe HTTP/1.1" 200 None 2026-03-07 02:13:08,257 - lava_callback - INFO - Completed processing callback for node 69ab8506efa461f55e59defe 2026-03-07 02:13:13,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:13,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58330 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:13:18,637 - lava_callback - INFO - Received callback for node 69a8e6ad911a9cbe7f77e839 INFO: 172.20.0.1:58334 - "POST /node/69a8e6ad911a9cbe7f77e839 HTTP/1.0" 202 Accepted 2026-03-07 02:13:18,643 - lava_callback - INFO - Starting async job submit for node 69a8e6ad911a9cbe7f77e839 2026-03-07 02:13:18,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:18,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e6ad911a9cbe7f77e839 HTTP/1.1" 200 None 2026-03-07 02:13:18,666 - lava_callback - DEBUG - Processing node 69a8e6ad911a9cbe7f77e839: baseline-arm-baylibre 2026-03-07 02:13:18,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e6ad911a9cbe7f77e839 2026-03-07 02:13:18,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:18,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e6ad911a9cbe7f77e839 HTTP/1.1" 200 None 2026-03-07 02:13:18,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:18,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 02:13:18,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:18,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e6ad911a9cbe7f77e839 HTTP/1.1" 200 None 2026-03-07 02:13:18,731 - lava_callback - ERROR - Error processing callback for node 69a8e6ad911a9cbe7f77e839: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 02:13:21,836 - lava_callback - INFO - Received callback for node 69ab859aefa461f55e59df2e INFO: 172.20.0.1:60624 - "POST /node/69ab859aefa461f55e59df2e HTTP/1.0" 202 Accepted 2026-03-07 02:13:21,843 - lava_callback - INFO - Starting async job submit for node 69ab859aefa461f55e59df2e 2026-03-07 02:13:21,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:21,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab859aefa461f55e59df2e HTTP/1.1" 200 None 2026-03-07 02:13:21,929 - lava_callback - DEBUG - Processing node 69ab859aefa461f55e59df2e: ltp-smoke 2026-03-07 02:13:22,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:13:22,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:13:22,658 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab859aefa461f55e59df2e/log.txt.gz 2026-03-07 02:13:22,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:13:23,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:13:23,179 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab859aefa461f55e59df2e/lava-logs.yaml 2026-03-07 02:13:23,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:13:23,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:13:23,354 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ab859aefa461f55e59df2e/lava_callback.json.gz 2026-03-07 02:13:23,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:23,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab859aefa461f55e59df2e HTTP/1.1" 200 None 2026-03-07 02:13:23,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:23,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e3aefa461f55e59cdbd HTTP/1.1" 200 None 2026-03-07 02:13:23,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:23,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab859aefa461f55e59df2e HTTP/1.1" 200 None 2026-03-07 02:13:23,701 - lava_callback - INFO - Completed processing callback for node 69ab859aefa461f55e59df2e INFO: 172.20.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42944 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:13:43,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:13:43,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59304 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:14:01,672 - lava_callback - INFO - Received callback for node 69ab7d0fefa461f55e59d9f7 INFO: 172.20.0.1:39452 - "POST /node/69ab7d0fefa461f55e59d9f7 HTTP/1.0" 202 Accepted 2026-03-07 02:14:01,678 - lava_callback - INFO - Starting async job submit for node 69ab7d0fefa461f55e59d9f7 2026-03-07 02:14:01,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:14:01,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d0fefa461f55e59d9f7 HTTP/1.1" 200 None 2026-03-07 02:14:01,715 - lava_callback - DEBUG - Processing node 69ab7d0fefa461f55e59d9f7: baseline-arm64-broonie 2026-03-07 02:14:01,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:14:02,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:14:02,085 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d0fefa461f55e59d9f7/log.txt.gz 2026-03-07 02:14:02,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:14:02,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:14:02,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d0fefa461f55e59d9f7/lava-logs.yaml 2026-03-07 02:14:02,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:14:02,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:14:02,519 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d0fefa461f55e59d9f7/lava_callback.json.gz 2026-03-07 02:14:02,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:14:02,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d0fefa461f55e59d9f7 HTTP/1.1" 200 None 2026-03-07 02:14:02,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:14:02,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 02:14:02,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:14:02,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d0fefa461f55e59d9f7 HTTP/1.1" 200 None 2026-03-07 02:14:02,640 - lava_callback - INFO - Completed processing callback for node 69ab7d0fefa461f55e59d9f7 INFO: 172.20.0.1:39464 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:14:13,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:14:13,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33618 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:15:18,751 - lava_callback - INFO - Received callback for node 69a8e731911a9cbe7f77e8d7 INFO: 172.20.0.1:33626 - "POST /node/69a8e731911a9cbe7f77e8d7 HTTP/1.0" 202 Accepted 2026-03-07 02:15:18,757 - lava_callback - INFO - Starting async job submit for node 69a8e731911a9cbe7f77e8d7 2026-03-07 02:15:18,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:15:18,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e731911a9cbe7f77e8d7 HTTP/1.1" 200 None 2026-03-07 02:15:18,773 - lava_callback - DEBUG - Processing node 69a8e731911a9cbe7f77e8d7: baseline-arm-baylibre 2026-03-07 02:15:18,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e731911a9cbe7f77e8d7 2026-03-07 02:15:18,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:15:18,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e731911a9cbe7f77e8d7 HTTP/1.1" 200 None 2026-03-07 02:15:18,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:15:18,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 02:15:18,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:15:18,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e731911a9cbe7f77e8d7 HTTP/1.1" 200 None 2026-03-07 02:15:18,829 - lava_callback - ERROR - Error processing callback for node 69a8e731911a9cbe7f77e8d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38994 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:17:38,880 - lava_callback - INFO - Received callback for node 69a8e7b4911a9cbe7f77e950 INFO: 172.20.0.1:39004 - "POST /node/69a8e7b4911a9cbe7f77e950 HTTP/1.0" 202 Accepted 2026-03-07 02:17:38,886 - lava_callback - INFO - Starting async job submit for node 69a8e7b4911a9cbe7f77e950 2026-03-07 02:17:38,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:17:38,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e7b4911a9cbe7f77e950 HTTP/1.1" 200 None 2026-03-07 02:17:38,923 - lava_callback - DEBUG - Processing node 69a8e7b4911a9cbe7f77e950: baseline-arm-baylibre 2026-03-07 02:17:38,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8e7b4911a9cbe7f77e950 2026-03-07 02:17:38,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:17:38,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8e7b4911a9cbe7f77e950 HTTP/1.1" 200 None 2026-03-07 02:17:38,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:17:38,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 02:17:38,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:17:38,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8e7b4911a9cbe7f77e950 HTTP/1.1" 200 None 2026-03-07 02:17:38,991 - lava_callback - ERROR - Error processing callback for node 69a8e7b4911a9cbe7f77e950: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51338 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:18:03,952 - lava_callback - INFO - Received callback for node 69ab8909efa461f55e59e099 INFO: 172.20.0.1:54758 - "POST /node/69ab8909efa461f55e59e099 HTTP/1.0" 202 Accepted 2026-03-07 02:18:03,959 - lava_callback - INFO - Starting async job submit for node 69ab8909efa461f55e59e099 2026-03-07 02:18:03,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:18:04,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8909efa461f55e59e099 HTTP/1.1" 200 None 2026-03-07 02:18:04,037 - lava_callback - DEBUG - Processing node 69ab8909efa461f55e59e099: baseline-arm64 2026-03-07 02:18:04,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:18:04,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:18:04,566 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab8909efa461f55e59e099/log.txt.gz 2026-03-07 02:18:04,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:18:05,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:18:05,015 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab8909efa461f55e59e099/lava-logs.yaml 2026-03-07 02:18:05,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:18:05,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:18:05,194 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ab8909efa461f55e59e099/lava_callback.json.gz DEBUG: Setup failed for 69ab8909efa461f55e59e099. Transitting job node result: incomplete -> fail 2026-03-07 02:18:05,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:18:05,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8909efa461f55e59e099 HTTP/1.1" 200 None 2026-03-07 02:18:05,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:18:05,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 02:18:05,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:18:05,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8909efa461f55e59e099 HTTP/1.1" 200 None 2026-03-07 02:18:05,419 - lava_callback - INFO - Completed processing callback for node 69ab8909efa461f55e59e099 INFO: 172.20.0.1:54766 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:18:13,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:18:13,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45424 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:18:21,299 - lava_callback - INFO - Received callback for node 69ab8784efa461f55e59e000 INFO: 172.20.0.1:56792 - "POST /node/69ab8784efa461f55e59e000 HTTP/1.0" 202 Accepted 2026-03-07 02:18:21,305 - lava_callback - INFO - Starting async job submit for node 69ab8784efa461f55e59e000 2026-03-07 02:18:21,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:18:21,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8784efa461f55e59e000 HTTP/1.1" 200 None 2026-03-07 02:18:21,372 - lava_callback - DEBUG - Processing node 69ab8784efa461f55e59e000: baseline-arm 2026-03-07 02:18:21,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:18:21,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:18:21,982 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ab8784efa461f55e59e000/log.txt.gz 2026-03-07 02:18:22,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:18:22,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:18:22,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ab8784efa461f55e59e000/lava-logs.yaml 2026-03-07 02:18:22,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:18:22,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:18:22,682 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ab8784efa461f55e59e000/lava_callback.json.gz DEBUG: Setup failed for 69ab8784efa461f55e59e000. Transitting job node result: incomplete -> fail 2026-03-07 02:18:22,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:18:22,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8784efa461f55e59e000 HTTP/1.1" 200 None 2026-03-07 02:18:22,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:18:22,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 02:18:22,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:18:22,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8784efa461f55e59e000 HTTP/1.1" 200 None 2026-03-07 02:18:22,935 - lava_callback - INFO - Completed processing callback for node 69ab8784efa461f55e59e000 INFO: 172.20.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40992 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:18:43,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:18:43,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32918 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38006 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:25:19,215 - lava_callback - INFO - Received callback for node 69aa2be98c4d487a0e751faa INFO: 172.20.0.1:38018 - "POST /node/69aa2be98c4d487a0e751faa HTTP/1.0" 202 Accepted 2026-03-07 02:25:19,221 - lava_callback - INFO - Starting async job submit for node 69aa2be98c4d487a0e751faa 2026-03-07 02:25:19,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:25:19,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa2be98c4d487a0e751faa HTTP/1.1" 200 None 2026-03-07 02:25:19,267 - lava_callback - DEBUG - Processing node 69aa2be98c4d487a0e751faa: baseline-x86 2026-03-07 02:25:19,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:25:19,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:25:19,679 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa2be98c4d487a0e751faa/log.txt.gz 2026-03-07 02:25:19,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:25:20,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:25:20,087 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa2be98c4d487a0e751faa/lava-logs.yaml 2026-03-07 02:25:20,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:25:20,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:25:20,280 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa2be98c4d487a0e751faa/lava_callback.json.gz DEBUG: Setup failed for 69aa2be98c4d487a0e751faa. Transitting job node result: incomplete -> fail 2026-03-07 02:25:20,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:25:20,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa2be98c4d487a0e751faa HTTP/1.1" 200 None 2026-03-07 02:25:20,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:25:20,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a697103d518458fb33ea36 HTTP/1.1" 200 None 2026-03-07 02:25:20,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:25:20,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa2be98c4d487a0e751faa HTTP/1.1" 200 None 2026-03-07 02:25:20,487 - lava_callback - INFO - Completed processing callback for node 69aa2be98c4d487a0e751faa INFO: 172.20.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48416 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:25:43,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:25:43,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40820 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:27:48,693 - lava_callback - INFO - Received callback for node 69ab889aefa461f55e59e065 INFO: 172.20.0.1:40836 - "POST /node/69ab889aefa461f55e59e065 HTTP/1.0" 202 Accepted 2026-03-07 02:27:48,704 - lava_callback - INFO - Starting async job submit for node 69ab889aefa461f55e59e065 2026-03-07 02:27:48,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:27:48,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab889aefa461f55e59e065 HTTP/1.1" 200 None 2026-03-07 02:27:48,781 - lava_callback - DEBUG - Processing node 69ab889aefa461f55e59e065: baseline-arm-clabbe 2026-03-07 02:27:49,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:27:49,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:27:49,245 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab889aefa461f55e59e065/log.txt.gz 2026-03-07 02:27:49,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:27:49,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:27:49,571 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab889aefa461f55e59e065/lava-logs.yaml 2026-03-07 02:27:49,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:27:49,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:27:49,726 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ab889aefa461f55e59e065/lava_callback.json.gz DEBUG: Setup failed for 69ab889aefa461f55e59e065. Transitting job node result: incomplete -> fail 2026-03-07 02:27:49,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:27:49,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab889aefa461f55e59e065 HTTP/1.1" 200 None 2026-03-07 02:27:49,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:27:49,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 02:27:49,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:27:49,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab889aefa461f55e59e065 HTTP/1.1" 200 None 2026-03-07 02:27:49,921 - lava_callback - INFO - Completed processing callback for node 69ab889aefa461f55e59e065 INFO: 172.20.0.1:49252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46414 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:28:13,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:28:13,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51730 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:32:13,530 - lava_callback - INFO - Received callback for node 69ab86ceefa461f55e59dfba INFO: 172.20.0.1:52184 - "POST /node/69ab86ceefa461f55e59dfba HTTP/1.0" 202 Accepted 2026-03-07 02:32:13,577 - lava_callback - INFO - Starting async job submit for node 69ab86ceefa461f55e59dfba 2026-03-07 02:32:13,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:32:13,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab86ceefa461f55e59dfba HTTP/1.1" 200 None 2026-03-07 02:32:13,617 - lava_callback - DEBUG - Processing node 69ab86ceefa461f55e59dfba: baseline-arm-pengutronix 2026-03-07 02:32:13,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:32:13,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:32:13,881 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab86ceefa461f55e59dfba/log.txt.gz 2026-03-07 02:32:13,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:32:14,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:32:14,133 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab86ceefa461f55e59dfba/lava-logs.yaml 2026-03-07 02:32:14,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:32:14,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:32:14,264 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab86ceefa461f55e59dfba/lava_callback.json.gz DEBUG: Setup failed for 69ab86ceefa461f55e59dfba. Transitting job node result: incomplete -> fail 2026-03-07 02:32:14,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:32:14,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab86ceefa461f55e59dfba HTTP/1.1" 200 None 2026-03-07 02:32:14,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:32:14,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 02:32:14,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:32:14,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab86ceefa461f55e59dfba HTTP/1.1" 200 None 2026-03-07 02:32:14,433 - lava_callback - INFO - Completed processing callback for node 69ab86ceefa461f55e59dfba INFO: 172.20.0.1:52196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50442 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:32:43,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:32:43,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39078 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:35:02,524 - lava_callback - INFO - Received callback for node 69ab7d0defa461f55e59d9f1 INFO: 172.20.0.1:39088 - "POST /node/69ab7d0defa461f55e59d9f1 HTTP/1.0" 202 Accepted 2026-03-07 02:35:02,530 - lava_callback - INFO - Starting async job submit for node 69ab7d0defa461f55e59d9f1 2026-03-07 02:35:02,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:35:02,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d0defa461f55e59d9f1 HTTP/1.1" 200 None 2026-03-07 02:35:02,569 - lava_callback - DEBUG - Processing node 69ab7d0defa461f55e59d9f1: baseline-arm64-broonie 2026-03-07 02:35:02,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:35:02,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:35:02,970 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d0defa461f55e59d9f1/log.txt.gz 2026-03-07 02:35:03,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:35:03,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:35:03,318 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d0defa461f55e59d9f1/lava-logs.yaml 2026-03-07 02:35:03,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:35:03,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:35:03,486 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d0defa461f55e59d9f1/lava_callback.json.gz 2026-03-07 02:35:03,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:35:03,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d0defa461f55e59d9f1 HTTP/1.1" 200 None 2026-03-07 02:35:03,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:35:03,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 02:35:03,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:35:03,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d0defa461f55e59d9f1 HTTP/1.1" 200 None 2026-03-07 02:35:03,582 - lava_callback - INFO - Completed processing callback for node 69ab7d0defa461f55e59d9f1 2026-03-07 02:35:05,283 - lava_callback - INFO - Received callback for node 69ab8a38efa461f55e59e11b INFO: 172.20.0.1:39096 - "POST /node/69ab8a38efa461f55e59e11b HTTP/1.0" 202 Accepted 2026-03-07 02:35:05,291 - lava_callback - INFO - Starting async job submit for node 69ab8a38efa461f55e59e11b 2026-03-07 02:35:05,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:35:05,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8a38efa461f55e59e11b HTTP/1.1" 200 None 2026-03-07 02:35:05,349 - lava_callback - DEBUG - Processing node 69ab8a38efa461f55e59e11b: baseline-nfs-arm64 INFO: 172.20.0.1:39112 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:35:06,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:35:06,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:35:06,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab8a38efa461f55e59e11b/log.txt.gz 2026-03-07 02:35:07,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:35:07,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:35:07,716 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab8a38efa461f55e59e11b/lava-logs.yaml 2026-03-07 02:35:07,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:35:07,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:35:07,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab8a38efa461f55e59e11b/lava_callback.json.gz DEBUG: Setup failed for 69ab8a38efa461f55e59e11b. Transitting job node result: incomplete -> fail 2026-03-07 02:35:08,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:35:08,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8a38efa461f55e59e11b HTTP/1.1" 200 None 2026-03-07 02:35:08,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:35:08,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 02:35:08,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:35:08,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8a38efa461f55e59e11b HTTP/1.1" 200 None 2026-03-07 02:35:08,198 - lava_callback - INFO - Completed processing callback for node 69ab8a38efa461f55e59e11b 2026-03-07 02:35:13,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:35:13,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60768 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:41:39,762 - lava_callback - INFO - Received callback for node 69aa33448c4d487a0e752330 INFO: 172.20.0.1:58906 - "POST /node/69aa33448c4d487a0e752330 HTTP/1.0" 202 Accepted 2026-03-07 02:41:39,768 - lava_callback - INFO - Starting async job submit for node 69aa33448c4d487a0e752330 2026-03-07 02:41:39,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:41:39,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa33448c4d487a0e752330 HTTP/1.1" 200 None 2026-03-07 02:41:39,816 - lava_callback - DEBUG - Processing node 69aa33448c4d487a0e752330: baseline-x86 2026-03-07 02:41:40,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:41:40,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:41:40,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa33448c4d487a0e752330/log.txt.gz 2026-03-07 02:41:40,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:41:40,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:41:40,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa33448c4d487a0e752330/lava-logs.yaml 2026-03-07 02:41:40,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:41:40,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:41:40,740 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa33448c4d487a0e752330/lava_callback.json.gz DEBUG: Setup failed for 69aa33448c4d487a0e752330. Transitting job node result: incomplete -> fail 2026-03-07 02:41:40,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:41:40,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa33448c4d487a0e752330 HTTP/1.1" 200 None 2026-03-07 02:41:40,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:41:40,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a697103d518458fb33ea36 HTTP/1.1" 200 None 2026-03-07 02:41:40,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:41:40,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa33448c4d487a0e752330 HTTP/1.1" 200 None 2026-03-07 02:41:40,962 - lava_callback - INFO - Completed processing callback for node 69aa33448c4d487a0e752330 2026-03-07 02:41:43,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:41:43,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43878 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:43:03,712 - lava_callback - INFO - Received callback for node 69aa35918c4d487a0e752432 INFO: 172.20.0.1:43880 - "POST /node/69aa35918c4d487a0e752432 HTTP/1.0" 202 Accepted 2026-03-07 02:43:03,718 - lava_callback - INFO - Starting async job submit for node 69aa35918c4d487a0e752432 2026-03-07 02:43:03,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:43:03,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa35918c4d487a0e752432 HTTP/1.1" 200 None 2026-03-07 02:43:03,761 - lava_callback - DEBUG - Processing node 69aa35918c4d487a0e752432: baseline-x86 2026-03-07 02:43:03,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:43:04,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:43:04,159 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa35918c4d487a0e752432/log.txt.gz 2026-03-07 02:43:04,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:43:04,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:43:04,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa35918c4d487a0e752432/lava-logs.yaml 2026-03-07 02:43:04,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:43:04,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:43:04,673 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa35918c4d487a0e752432/lava_callback.json.gz DEBUG: Setup failed for 69aa35918c4d487a0e752432. Transitting job node result: incomplete -> fail 2026-03-07 02:43:04,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:43:04,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa35918c4d487a0e752432 HTTP/1.1" 200 None 2026-03-07 02:43:04,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:43:04,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a697103d518458fb33ea36 HTTP/1.1" 200 None 2026-03-07 02:43:04,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:43:04,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa35918c4d487a0e752432 HTTP/1.1" 200 None 2026-03-07 02:43:04,884 - lava_callback - INFO - Completed processing callback for node 69aa35918c4d487a0e752432 INFO: 172.20.0.1:43894 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:43:13,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:43:13,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43644 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:44:20,416 - lava_callback - INFO - Received callback for node 69a8edf6911a9cbe7f77efeb INFO: 172.20.0.1:58862 - "POST /node/69a8edf6911a9cbe7f77efeb HTTP/1.0" 202 Accepted 2026-03-07 02:44:20,422 - lava_callback - INFO - Starting async job submit for node 69a8edf6911a9cbe7f77efeb 2026-03-07 02:44:20,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:44:20,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8edf6911a9cbe7f77efeb HTTP/1.1" 200 None 2026-03-07 02:44:20,438 - lava_callback - DEBUG - Processing node 69a8edf6911a9cbe7f77efeb: baseline-arm64-baylibre 2026-03-07 02:44:20,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8edf6911a9cbe7f77efeb 2026-03-07 02:44:20,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:44:20,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8edf6911a9cbe7f77efeb HTTP/1.1" 200 None 2026-03-07 02:44:20,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:44:20,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 02:44:20,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:44:20,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8edf6911a9cbe7f77efeb HTTP/1.1" 200 None 2026-03-07 02:44:20,528 - lava_callback - ERROR - Error processing callback for node 69a8edf6911a9cbe7f77efeb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54974 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:46:02,376 - lava_callback - INFO - Received callback for node 69aa361e8c4d487a0e75246b INFO: 172.20.0.1:54976 - "POST /node/69aa361e8c4d487a0e75246b HTTP/1.0" 202 Accepted 2026-03-07 02:46:02,382 - lava_callback - INFO - Starting async job submit for node 69aa361e8c4d487a0e75246b 2026-03-07 02:46:02,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:46:02,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa361e8c4d487a0e75246b HTTP/1.1" 200 None 2026-03-07 02:46:02,429 - lava_callback - DEBUG - Processing node 69aa361e8c4d487a0e75246b: baseline-x86 2026-03-07 02:46:02,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:46:02,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:46:02,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa361e8c4d487a0e75246b/log.txt.gz 2026-03-07 02:46:02,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:46:03,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:46:03,154 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa361e8c4d487a0e75246b/lava-logs.yaml 2026-03-07 02:46:03,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:46:03,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:46:03,322 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa361e8c4d487a0e75246b/lava_callback.json.gz DEBUG: Setup failed for 69aa361e8c4d487a0e75246b. Transitting job node result: incomplete -> fail 2026-03-07 02:46:03,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:46:03,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa361e8c4d487a0e75246b HTTP/1.1" 200 None 2026-03-07 02:46:03,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:46:03,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9ad129c5f93e4f05eb2eb HTTP/1.1" 200 None 2026-03-07 02:46:03,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:46:03,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa361e8c4d487a0e75246b HTTP/1.1" 200 None 2026-03-07 02:46:03,540 - lava_callback - INFO - Completed processing callback for node 69aa361e8c4d487a0e75246b INFO: 172.20.0.1:54990 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:46:13,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:46:13,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46024 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:46:40,641 - lava_callback - INFO - Received callback for node 69a8ee85911a9cbe7f77f06a INFO: 172.20.0.1:53778 - "POST /node/69a8ee85911a9cbe7f77f06a HTTP/1.0" 202 Accepted 2026-03-07 02:46:40,646 - lava_callback - INFO - Starting async job submit for node 69a8ee85911a9cbe7f77f06a 2026-03-07 02:46:40,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:46:40,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ee85911a9cbe7f77f06a HTTP/1.1" 200 None 2026-03-07 02:46:40,662 - lava_callback - DEBUG - Processing node 69a8ee85911a9cbe7f77f06a: baseline-arm64-baylibre 2026-03-07 02:46:40,662 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8ee85911a9cbe7f77f06a 2026-03-07 02:46:40,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:46:40,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8ee85911a9cbe7f77f06a HTTP/1.1" 200 None 2026-03-07 02:46:40,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:46:40,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 02:46:40,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:46:40,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8ee85911a9cbe7f77f06a HTTP/1.1" 200 None 2026-03-07 02:46:40,723 - lava_callback - ERROR - Error processing callback for node 69a8ee85911a9cbe7f77f06a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56168 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:50:21,410 - lava_callback - INFO - Received callback for node 69aa5fd68c4d487a0e753603 INFO: 172.20.0.1:54248 - "POST /node/69aa5fd68c4d487a0e753603 HTTP/1.0" 202 Accepted 2026-03-07 02:50:21,419 - lava_callback - INFO - Starting async job submit for node 69aa5fd68c4d487a0e753603 2026-03-07 02:50:21,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:50:21,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa5fd68c4d487a0e753603 HTTP/1.1" 200 None 2026-03-07 02:50:21,484 - lava_callback - DEBUG - Processing node 69aa5fd68c4d487a0e753603: baseline-x86 2026-03-07 02:50:21,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:50:22,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:50:22,348 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa5fd68c4d487a0e753603/log.txt.gz 2026-03-07 02:50:22,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:50:23,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:50:23,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa5fd68c4d487a0e753603/lava-logs.yaml 2026-03-07 02:50:23,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:50:23,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:50:23,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa5fd68c4d487a0e753603/lava_callback.json.gz 2026-03-07 02:50:23,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:50:23,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa5fd68c4d487a0e753603 HTTP/1.1" 200 None 2026-03-07 02:50:23,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:50:23,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a70a80e31b554803095c33 HTTP/1.1" 200 None 2026-03-07 02:50:23,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:50:23,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa5fd68c4d487a0e753603 HTTP/1.1" 200 None 2026-03-07 02:50:23,325 - lava_callback - INFO - Completed processing callback for node 69aa5fd68c4d487a0e753603 INFO: 172.20.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37526 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:50:43,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:50:43,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60780 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:51:54,483 - lava_callback - INFO - Received callback for node 69ab8e3befa461f55e59e211 INFO: 172.20.0.1:59802 - "POST /node/69ab8e3befa461f55e59e211 HTTP/1.0" 202 Accepted 2026-03-07 02:51:54,533 - lava_callback - INFO - Starting async job submit for node 69ab8e3befa461f55e59e211 2026-03-07 02:51:54,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:51:54,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8e3befa461f55e59e211 HTTP/1.1" 200 None 2026-03-07 02:51:54,572 - lava_callback - DEBUG - Processing node 69ab8e3befa461f55e59e211: baseline-arm-pengutronix 2026-03-07 02:51:54,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:51:54,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:51:54,843 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab8e3befa461f55e59e211/log.txt.gz 2026-03-07 02:51:54,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:51:55,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:51:55,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab8e3befa461f55e59e211/lava-logs.yaml 2026-03-07 02:51:55,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:51:55,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:51:55,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ab8e3befa461f55e59e211/lava_callback.json.gz DEBUG: Setup failed for 69ab8e3befa461f55e59e211. Transitting job node result: incomplete -> fail 2026-03-07 02:51:55,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:51:55,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8e3befa461f55e59e211 HTTP/1.1" 200 None 2026-03-07 02:51:55,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:51:55,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-07 02:51:55,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:51:55,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8e3befa461f55e59e211 HTTP/1.1" 200 None 2026-03-07 02:51:55,438 - lava_callback - INFO - Completed processing callback for node 69ab8e3befa461f55e59e211 INFO: 172.20.0.1:59816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34972 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:52:13,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:52:13,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40216 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:55:06,134 - lava_callback - INFO - Received callback for node 69ab8ee4efa461f55e59e24b INFO: 172.20.0.1:40222 - "POST /node/69ab8ee4efa461f55e59e24b HTTP/1.0" 202 Accepted 2026-03-07 02:55:06,142 - lava_callback - INFO - Starting async job submit for node 69ab8ee4efa461f55e59e24b 2026-03-07 02:55:06,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:55:06,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8ee4efa461f55e59e24b HTTP/1.1" 200 None 2026-03-07 02:55:06,212 - lava_callback - DEBUG - Processing node 69ab8ee4efa461f55e59e24b: baseline-nfs-arm64 INFO: 172.20.0.1:40236 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:55:07,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:55:07,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:55:07,702 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab8ee4efa461f55e59e24b/log.txt.gz 2026-03-07 02:55:08,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:55:08,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:55:08,610 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab8ee4efa461f55e59e24b/lava-logs.yaml 2026-03-07 02:55:08,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 02:55:08,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 02:55:08,827 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ab8ee4efa461f55e59e24b/lava_callback.json.gz DEBUG: Setup failed for 69ab8ee4efa461f55e59e24b. Transitting job node result: incomplete -> fail 2026-03-07 02:55:08,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:55:08,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8ee4efa461f55e59e24b HTTP/1.1" 200 None 2026-03-07 02:55:08,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:55:08,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 02:55:08,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:55:08,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8ee4efa461f55e59e24b HTTP/1.1" 200 None 2026-03-07 02:55:09,075 - lava_callback - INFO - Completed processing callback for node 69ab8ee4efa461f55e59e24b 2026-03-07 02:55:13,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:55:13,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45724 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:56:41,090 - lava_callback - INFO - Received callback for node 69a8f0e3911a9cbe7f77f2ac INFO: 172.20.0.1:45236 - "POST /node/69a8f0e3911a9cbe7f77f2ac HTTP/1.0" 202 Accepted 2026-03-07 02:56:41,096 - lava_callback - INFO - Starting async job submit for node 69a8f0e3911a9cbe7f77f2ac 2026-03-07 02:56:41,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:56:41,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f0e3911a9cbe7f77f2ac HTTP/1.1" 200 None 2026-03-07 02:56:41,113 - lava_callback - DEBUG - Processing node 69a8f0e3911a9cbe7f77f2ac: baseline-arm64-baylibre 2026-03-07 02:56:41,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f0e3911a9cbe7f77f2ac 2026-03-07 02:56:41,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:56:41,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f0e3911a9cbe7f77f2ac HTTP/1.1" 200 None 2026-03-07 02:56:41,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:56:41,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 02:56:41,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:56:41,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f0e3911a9cbe7f77f2ac HTTP/1.1" 200 None 2026-03-07 02:56:41,174 - lava_callback - ERROR - Error processing callback for node 69a8f0e3911a9cbe7f77f2ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37000 - "GET / HTTP/1.0" 200 OK 2026-03-07 02:59:41,282 - lava_callback - INFO - Received callback for node 69a8f191911a9cbe7f77f372 INFO: 172.20.0.1:47882 - "POST /node/69a8f191911a9cbe7f77f372 HTTP/1.0" 202 Accepted 2026-03-07 02:59:41,288 - lava_callback - INFO - Starting async job submit for node 69a8f191911a9cbe7f77f372 2026-03-07 02:59:41,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:59:41,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f191911a9cbe7f77f372 HTTP/1.1" 200 None 2026-03-07 02:59:41,304 - lava_callback - DEBUG - Processing node 69a8f191911a9cbe7f77f372: baseline-arm64-baylibre 2026-03-07 02:59:41,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f191911a9cbe7f77f372 2026-03-07 02:59:41,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:59:41,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f191911a9cbe7f77f372 HTTP/1.1" 200 None 2026-03-07 02:59:41,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:59:41,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 02:59:41,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 02:59:41,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f191911a9cbe7f77f372 HTTP/1.1" 200 None 2026-03-07 02:59:41,382 - lava_callback - ERROR - Error processing callback for node 69a8f191911a9cbe7f77f372: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41336 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:04:01,532 - lava_callback - INFO - Received callback for node 69a8f28f911a9cbe7f77f47f INFO: 172.20.0.1:41346 - "POST /node/69a8f28f911a9cbe7f77f47f HTTP/1.0" 202 Accepted 2026-03-07 03:04:01,538 - lava_callback - INFO - Starting async job submit for node 69a8f28f911a9cbe7f77f47f 2026-03-07 03:04:01,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:04:01,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f28f911a9cbe7f77f47f HTTP/1.1" 200 None 2026-03-07 03:04:01,557 - lava_callback - DEBUG - Processing node 69a8f28f911a9cbe7f77f47f: baseline-arm64-baylibre 2026-03-07 03:04:01,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f28f911a9cbe7f77f47f 2026-03-07 03:04:01,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:04:01,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f28f911a9cbe7f77f47f HTTP/1.1" 200 None 2026-03-07 03:04:01,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:04:01,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 03:04:01,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:04:01,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f28f911a9cbe7f77f47f HTTP/1.1" 200 None 2026-03-07 03:04:01,608 - lava_callback - ERROR - Error processing callback for node 69a8f28f911a9cbe7f77f47f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50066 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:05:21,606 - lava_callback - INFO - Received callback for node 69a8f2e5911a9cbe7f77f4ce INFO: 172.20.0.1:39052 - "POST /node/69a8f2e5911a9cbe7f77f4ce HTTP/1.0" 202 Accepted 2026-03-07 03:05:21,612 - lava_callback - INFO - Starting async job submit for node 69a8f2e5911a9cbe7f77f4ce 2026-03-07 03:05:21,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:05:21,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f2e5911a9cbe7f77f4ce HTTP/1.1" 200 None 2026-03-07 03:05:21,628 - lava_callback - DEBUG - Processing node 69a8f2e5911a9cbe7f77f4ce: baseline-arm64-baylibre 2026-03-07 03:05:21,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f2e5911a9cbe7f77f4ce 2026-03-07 03:05:21,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:05:21,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f2e5911a9cbe7f77f4ce HTTP/1.1" 200 None 2026-03-07 03:05:21,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:05:21,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 03:05:21,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:05:21,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f2e5911a9cbe7f77f4ce HTTP/1.1" 200 None 2026-03-07 03:05:21,709 - lava_callback - ERROR - Error processing callback for node 69a8f2e5911a9cbe7f77f4ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38360 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:07:22,489 - lava_callback - INFO - Received callback for node 69aa55df8c4d487a0e75322e INFO: 172.20.0.1:36634 - "POST /node/69aa55df8c4d487a0e75322e HTTP/1.0" 202 Accepted 2026-03-07 03:07:22,495 - lava_callback - INFO - Starting async job submit for node 69aa55df8c4d487a0e75322e 2026-03-07 03:07:22,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:07:22,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa55df8c4d487a0e75322e HTTP/1.1" 200 None 2026-03-07 03:07:22,541 - lava_callback - DEBUG - Processing node 69aa55df8c4d487a0e75322e: baseline-x86 2026-03-07 03:07:22,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:07:22,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:07:22,982 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa55df8c4d487a0e75322e/log.txt.gz 2026-03-07 03:07:23,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:07:23,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:07:23,360 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa55df8c4d487a0e75322e/lava-logs.yaml 2026-03-07 03:07:23,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:07:23,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:07:23,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa55df8c4d487a0e75322e/lava_callback.json.gz DEBUG: Setup failed for 69aa55df8c4d487a0e75322e. Transitting job node result: incomplete -> fail 2026-03-07 03:07:23,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:07:23,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa55df8c4d487a0e75322e HTTP/1.1" 200 None 2026-03-07 03:07:23,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:07:23,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744aa5a0c0e10c4819cef HTTP/1.1" 200 None 2026-03-07 03:07:23,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:07:23,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa55df8c4d487a0e75322e HTTP/1.1" 200 None 2026-03-07 03:07:23,706 - lava_callback - INFO - Completed processing callback for node 69aa55df8c4d487a0e75322e INFO: 172.20.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44194 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:07:43,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:07:43,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39530 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:08:08,182 - lava_callback - INFO - Received callback for node 69aa5e488c4d487a0e75352c INFO: 172.20.0.1:39534 - "POST /node/69aa5e488c4d487a0e75352c HTTP/1.0" 202 Accepted 2026-03-07 03:08:08,188 - lava_callback - INFO - Starting async job submit for node 69aa5e488c4d487a0e75352c 2026-03-07 03:08:08,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:08:08,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa5e488c4d487a0e75352c HTTP/1.1" 200 None 2026-03-07 03:08:08,243 - lava_callback - DEBUG - Processing node 69aa5e488c4d487a0e75352c: baseline-x86 2026-03-07 03:08:08,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:08:08,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:08:08,640 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa5e488c4d487a0e75352c/log.txt.gz 2026-03-07 03:08:08,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:08:08,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:08:08,979 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa5e488c4d487a0e75352c/lava-logs.yaml 2026-03-07 03:08:08,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:08:09,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:08:09,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa5e488c4d487a0e75352c/lava_callback.json.gz DEBUG: Setup failed for 69aa5e488c4d487a0e75352c. Transitting job node result: incomplete -> fail 2026-03-07 03:08:09,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:08:09,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa5e488c4d487a0e75352c HTTP/1.1" 200 None 2026-03-07 03:08:09,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:08:09,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9ad129c5f93e4f05eb2eb HTTP/1.1" 200 None 2026-03-07 03:08:09,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:08:09,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa5e488c4d487a0e75352c HTTP/1.1" 200 None 2026-03-07 03:08:09,350 - lava_callback - INFO - Completed processing callback for node 69aa5e488c4d487a0e75352c 2026-03-07 03:08:13,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:08:13,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43062 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:09:41,867 - lava_callback - INFO - Received callback for node 69a8f3ef911a9cbe7f77f5ae INFO: 172.20.0.1:34018 - "POST /node/69a8f3ef911a9cbe7f77f5ae HTTP/1.0" 202 Accepted 2026-03-07 03:09:41,872 - lava_callback - INFO - Starting async job submit for node 69a8f3ef911a9cbe7f77f5ae 2026-03-07 03:09:41,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:09:41,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f3ef911a9cbe7f77f5ae HTTP/1.1" 200 None 2026-03-07 03:09:41,889 - lava_callback - DEBUG - Processing node 69a8f3ef911a9cbe7f77f5ae: baseline-arm64-baylibre 2026-03-07 03:09:41,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f3ef911a9cbe7f77f5ae 2026-03-07 03:09:41,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:09:41,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f3ef911a9cbe7f77f5ae HTTP/1.1" 200 None 2026-03-07 03:09:41,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:09:41,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 03:09:41,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:09:41,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f3ef911a9cbe7f77f5ae HTTP/1.1" 200 None 2026-03-07 03:09:41,944 - lava_callback - ERROR - Error processing callback for node 69a8f3ef911a9cbe7f77f5ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56340 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:10:40,744 - lava_callback - INFO - Received callback for node 69aa6b378c4d487a0e753917 INFO: 172.20.0.1:48756 - "POST /node/69aa6b378c4d487a0e753917 HTTP/1.0" 202 Accepted 2026-03-07 03:10:40,750 - lava_callback - INFO - Starting async job submit for node 69aa6b378c4d487a0e753917 2026-03-07 03:10:40,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:10:40,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa6b378c4d487a0e753917 HTTP/1.1" 200 None 2026-03-07 03:10:40,799 - lava_callback - DEBUG - Processing node 69aa6b378c4d487a0e753917: baseline-x86 2026-03-07 03:10:41,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:10:41,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:10:41,217 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa6b378c4d487a0e753917/log.txt.gz 2026-03-07 03:10:41,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:10:41,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:10:41,523 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa6b378c4d487a0e753917/lava-logs.yaml 2026-03-07 03:10:41,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:10:41,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:10:41,685 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa6b378c4d487a0e753917/lava_callback.json.gz DEBUG: Setup failed for 69aa6b378c4d487a0e753917. Transitting job node result: incomplete -> fail 2026-03-07 03:10:41,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:10:41,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa6b378c4d487a0e753917 HTTP/1.1" 200 None 2026-03-07 03:10:41,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:10:41,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85b19440c1da21c23722a HTTP/1.1" 200 None 2026-03-07 03:10:41,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:10:41,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa6b378c4d487a0e753917 HTTP/1.1" 200 None 2026-03-07 03:10:41,898 - lava_callback - INFO - Completed processing callback for node 69aa6b378c4d487a0e753917 2026-03-07 03:10:43,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:10:43,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56738 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:14:02,109 - lava_callback - INFO - Received callback for node 69a8f4eb911a9cbe7f77f673 INFO: 172.20.0.1:56754 - "POST /node/69a8f4eb911a9cbe7f77f673 HTTP/1.0" 202 Accepted 2026-03-07 03:14:02,114 - lava_callback - INFO - Starting async job submit for node 69a8f4eb911a9cbe7f77f673 2026-03-07 03:14:02,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:14:02,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f4eb911a9cbe7f77f673 HTTP/1.1" 200 None 2026-03-07 03:14:02,131 - lava_callback - DEBUG - Processing node 69a8f4eb911a9cbe7f77f673: baseline-arm64-baylibre 2026-03-07 03:14:02,131 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f4eb911a9cbe7f77f673 2026-03-07 03:14:02,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:14:02,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f4eb911a9cbe7f77f673 HTTP/1.1" 200 None 2026-03-07 03:14:02,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:14:02,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a7ea227c78d2166ff857f2 HTTP/1.1" 200 None 2026-03-07 03:14:02,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:14:02,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f4eb911a9cbe7f77f673 HTTP/1.1" 200 None 2026-03-07 03:14:02,191 - lava_callback - ERROR - Error processing callback for node 69a8f4eb911a9cbe7f77f673: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48816 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:15:02,105 - lava_callback - INFO - Received callback for node 69a8f531911a9cbe7f77f6a2 INFO: 172.20.0.1:48824 - "POST /node/69a8f531911a9cbe7f77f6a2 HTTP/1.0" 202 Accepted 2026-03-07 03:15:02,111 - lava_callback - INFO - Starting async job submit for node 69a8f531911a9cbe7f77f6a2 2026-03-07 03:15:02,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:15:02,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f531911a9cbe7f77f6a2 HTTP/1.1" 200 None 2026-03-07 03:15:02,127 - lava_callback - DEBUG - Processing node 69a8f531911a9cbe7f77f6a2: baseline-arm-baylibre 2026-03-07 03:15:02,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f531911a9cbe7f77f6a2 2026-03-07 03:15:02,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:15:02,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f531911a9cbe7f77f6a2 HTTP/1.1" 200 None 2026-03-07 03:15:02,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:15:02,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 03:15:02,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:15:02,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f531911a9cbe7f77f6a2 HTTP/1.1" 200 None 2026-03-07 03:15:02,204 - lava_callback - ERROR - Error processing callback for node 69a8f531911a9cbe7f77f6a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44540 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:16:02,192 - lava_callback - INFO - Received callback for node 69a8f55f911a9cbe7f77f6db INFO: 172.20.0.1:44544 - "POST /node/69a8f55f911a9cbe7f77f6db HTTP/1.0" 202 Accepted 2026-03-07 03:16:02,198 - lava_callback - INFO - Starting async job submit for node 69a8f55f911a9cbe7f77f6db 2026-03-07 03:16:02,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:16:02,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f55f911a9cbe7f77f6db HTTP/1.1" 200 None 2026-03-07 03:16:02,214 - lava_callback - DEBUG - Processing node 69a8f55f911a9cbe7f77f6db: baseline-arm-baylibre 2026-03-07 03:16:02,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f55f911a9cbe7f77f6db 2026-03-07 03:16:02,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:16:02,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f55f911a9cbe7f77f6db HTTP/1.1" 200 None 2026-03-07 03:16:02,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:16:02,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 03:16:02,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:16:02,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f55f911a9cbe7f77f6db HTTP/1.1" 200 None 2026-03-07 03:16:02,273 - lava_callback - ERROR - Error processing callback for node 69a8f55f911a9cbe7f77f6db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35292 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:16:42,141 - lava_callback - INFO - Received callback for node 69a8f58c911a9cbe7f77f6fc INFO: 172.20.0.1:44176 - "POST /node/69a8f58c911a9cbe7f77f6fc HTTP/1.0" 202 Accepted 2026-03-07 03:16:42,146 - lava_callback - INFO - Starting async job submit for node 69a8f58c911a9cbe7f77f6fc 2026-03-07 03:16:42,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:16:42,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f58c911a9cbe7f77f6fc HTTP/1.1" 200 None 2026-03-07 03:16:42,163 - lava_callback - DEBUG - Processing node 69a8f58c911a9cbe7f77f6fc: baseline-arm-baylibre 2026-03-07 03:16:42,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f58c911a9cbe7f77f6fc 2026-03-07 03:16:42,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:16:42,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f58c911a9cbe7f77f6fc HTTP/1.1" 200 None 2026-03-07 03:16:42,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:16:42,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 03:16:42,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:16:42,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f58c911a9cbe7f77f6fc HTTP/1.1" 200 None 2026-03-07 03:16:42,231 - lava_callback - ERROR - Error processing callback for node 69a8f58c911a9cbe7f77f6fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58470 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:17:22,200 - lava_callback - INFO - Received callback for node 69a8f5ba911a9cbe7f77f750 INFO: 172.20.0.1:58954 - "POST /node/69a8f5ba911a9cbe7f77f750 HTTP/1.0" 202 Accepted 2026-03-07 03:17:22,208 - lava_callback - INFO - Starting async job submit for node 69a8f5ba911a9cbe7f77f750 2026-03-07 03:17:22,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:17:22,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f5ba911a9cbe7f77f750 HTTP/1.1" 200 None 2026-03-07 03:17:22,224 - lava_callback - DEBUG - Processing node 69a8f5ba911a9cbe7f77f750: baseline-arm-baylibre 2026-03-07 03:17:22,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f5ba911a9cbe7f77f750 2026-03-07 03:17:22,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:17:22,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f5ba911a9cbe7f77f750 HTTP/1.1" 200 None 2026-03-07 03:17:22,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:17:22,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 03:17:22,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:17:22,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f5ba911a9cbe7f77f750 HTTP/1.1" 200 None 2026-03-07 03:17:22,281 - lava_callback - ERROR - Error processing callback for node 69a8f5ba911a9cbe7f77f750: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33862 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:18:22,252 - lava_callback - INFO - Received callback for node 69a8f5e9911a9cbe7f77f76f INFO: 172.20.0.1:43590 - "POST /node/69a8f5e9911a9cbe7f77f76f HTTP/1.0" 202 Accepted 2026-03-07 03:18:22,257 - lava_callback - INFO - Starting async job submit for node 69a8f5e9911a9cbe7f77f76f 2026-03-07 03:18:22,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:18:22,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f5e9911a9cbe7f77f76f HTTP/1.1" 200 None 2026-03-07 03:18:22,274 - lava_callback - DEBUG - Processing node 69a8f5e9911a9cbe7f77f76f: baseline-arm-baylibre 2026-03-07 03:18:22,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f5e9911a9cbe7f77f76f 2026-03-07 03:18:22,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:18:22,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f5e9911a9cbe7f77f76f HTTP/1.1" 200 None 2026-03-07 03:18:22,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:18:22,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 03:18:22,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:18:22,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f5e9911a9cbe7f77f76f HTTP/1.1" 200 None 2026-03-07 03:18:22,329 - lava_callback - ERROR - Error processing callback for node 69a8f5e9911a9cbe7f77f76f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49168 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:20:22,403 - lava_callback - INFO - Received callback for node 69a8f66d911a9cbe7f77f803 INFO: 172.20.0.1:37540 - "POST /node/69a8f66d911a9cbe7f77f803 HTTP/1.0" 202 Accepted 2026-03-07 03:20:22,408 - lava_callback - INFO - Starting async job submit for node 69a8f66d911a9cbe7f77f803 2026-03-07 03:20:22,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:20:22,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f66d911a9cbe7f77f803 HTTP/1.1" 200 None 2026-03-07 03:20:22,425 - lava_callback - DEBUG - Processing node 69a8f66d911a9cbe7f77f803: baseline-arm-baylibre 2026-03-07 03:20:22,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a8f66d911a9cbe7f77f803 2026-03-07 03:20:22,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:20:22,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8f66d911a9cbe7f77f803 HTTP/1.1" 200 None 2026-03-07 03:20:22,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:20:22,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3153d14c84a8c43f97a06 HTTP/1.1" 200 None 2026-03-07 03:20:22,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:20:22,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a8f66d911a9cbe7f77f803 HTTP/1.1" 200 None 2026-03-07 03:20:22,484 - lava_callback - ERROR - Error processing callback for node 69a8f66d911a9cbe7f77f803: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41446 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:33:44,806 - lava_callback - INFO - Received callback for node 69ab7d10efa461f55e59d9fd INFO: 172.20.0.1:54946 - "POST /node/69ab7d10efa461f55e59d9fd HTTP/1.0" 202 Accepted 2026-03-07 03:33:44,812 - lava_callback - INFO - Starting async job submit for node 69ab7d10efa461f55e59d9fd 2026-03-07 03:33:44,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:33:44,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d10efa461f55e59d9fd HTTP/1.1" 200 None 2026-03-07 03:33:44,845 - lava_callback - DEBUG - Processing node 69ab7d10efa461f55e59d9fd: baseline-arm64-broonie 2026-03-07 03:33:45,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:33:45,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:33:45,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d10efa461f55e59d9fd/log.txt.gz 2026-03-07 03:33:45,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:33:45,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:33:45,868 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d10efa461f55e59d9fd/lava-logs.yaml 2026-03-07 03:33:45,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:33:46,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:33:46,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab7d10efa461f55e59d9fd/lava_callback.json.gz 2026-03-07 03:33:46,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:33:46,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7d10efa461f55e59d9fd HTTP/1.1" 200 None 2026-03-07 03:33:46,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:33:46,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 03:33:46,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:33:46,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7d10efa461f55e59d9fd HTTP/1.1" 200 None 2026-03-07 03:33:46,141 - lava_callback - INFO - Completed processing callback for node 69ab7d10efa461f55e59d9fd INFO: 172.20.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39436 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:34:01,909 - lava_callback - INFO - Received callback for node 69aa6b778c4d487a0e75392c INFO: 172.20.0.1:39448 - "POST /node/69aa6b778c4d487a0e75392c HTTP/1.0" 202 Accepted 2026-03-07 03:34:01,915 - lava_callback - INFO - Starting async job submit for node 69aa6b778c4d487a0e75392c 2026-03-07 03:34:01,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:34:01,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa6b778c4d487a0e75392c HTTP/1.1" 200 None 2026-03-07 03:34:01,962 - lava_callback - DEBUG - Processing node 69aa6b778c4d487a0e75392c: baseline-x86 2026-03-07 03:34:02,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:34:02,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:34:02,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa6b778c4d487a0e75392c/log.txt.gz 2026-03-07 03:34:02,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:34:02,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:34:02,717 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa6b778c4d487a0e75392c/lava-logs.yaml 2026-03-07 03:34:02,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:34:02,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:34:02,857 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa6b778c4d487a0e75392c/lava_callback.json.gz DEBUG: Setup failed for 69aa6b778c4d487a0e75392c. Transitting job node result: incomplete -> fail 2026-03-07 03:34:02,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:34:02,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa6b778c4d487a0e75392c HTTP/1.1" 200 None 2026-03-07 03:34:02,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:34:02,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8d000e9e7049205c4c9 HTTP/1.1" 200 None 2026-03-07 03:34:02,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:34:02,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa6b778c4d487a0e75392c HTTP/1.1" 200 None 2026-03-07 03:34:03,078 - lava_callback - INFO - Completed processing callback for node 69aa6b778c4d487a0e75392c INFO: 172.20.0.1:39464 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:34:13,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:34:13,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55818 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:35:32,609 - lava_callback - INFO - Received callback for node 69aa77b18c4d487a0e753c13 INFO: 172.20.0.1:41132 - "POST /node/69aa77b18c4d487a0e753c13 HTTP/1.0" 202 Accepted 2026-03-07 03:35:32,615 - lava_callback - INFO - Starting async job submit for node 69aa77b18c4d487a0e753c13 2026-03-07 03:35:32,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:35:32,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa77b18c4d487a0e753c13 HTTP/1.1" 200 None 2026-03-07 03:35:32,650 - lava_callback - DEBUG - Processing node 69aa77b18c4d487a0e753c13: baseline-x86 2026-03-07 03:35:32,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:35:33,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:35:33,129 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa77b18c4d487a0e753c13/log.txt.gz 2026-03-07 03:35:33,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:35:33,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:35:33,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa77b18c4d487a0e753c13/lava-logs.yaml 2026-03-07 03:35:33,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:35:33,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:35:33,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa77b18c4d487a0e753c13/lava_callback.json.gz 2026-03-07 03:35:33,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:35:33,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa77b18c4d487a0e753c13 HTTP/1.1" 200 None 2026-03-07 03:35:33,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:35:33,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d638c4d487a0e751178 HTTP/1.1" 200 None 2026-03-07 03:35:33,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:35:33,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa77b18c4d487a0e753c13 HTTP/1.1" 200 None 2026-03-07 03:35:33,851 - lava_callback - INFO - Completed processing callback for node 69aa77b18c4d487a0e753c13 INFO: 172.20.0.1:41146 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:35:43,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:35:43,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53628 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:37:05,136 - lava_callback - INFO - Received callback for node 69ab9cacefa461f55e59e71c INFO: 172.20.0.1:53636 - "POST /node/69ab9cacefa461f55e59e71c HTTP/1.0" 202 Accepted 2026-03-07 03:37:05,142 - lava_callback - INFO - Starting async job submit for node 69ab9cacefa461f55e59e71c 2026-03-07 03:37:05,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:37:05,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab9cacefa461f55e59e71c HTTP/1.1" 200 None 2026-03-07 03:37:05,176 - lava_callback - DEBUG - Processing node 69ab9cacefa461f55e59e71c: baseline-arm64-broonie 2026-03-07 03:37:05,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:37:05,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:37:05,684 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab9cacefa461f55e59e71c/log.txt.gz 2026-03-07 03:37:05,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:37:06,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:37:06,130 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab9cacefa461f55e59e71c/lava-logs.yaml 2026-03-07 03:37:06,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:37:06,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:37:06,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab9cacefa461f55e59e71c/lava_callback.json.gz 2026-03-07 03:37:06,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:37:06,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab9cacefa461f55e59e71c HTTP/1.1" 200 None 2026-03-07 03:37:06,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:37:06,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 03:37:06,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:37:06,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab9cacefa461f55e59e71c HTTP/1.1" 200 None 2026-03-07 03:37:06,439 - lava_callback - INFO - Completed processing callback for node 69ab9cacefa461f55e59e71c INFO: 172.20.0.1:53640 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:37:13,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:37:13,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48676 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:40:25,087 - lava_callback - INFO - Received callback for node 69ab9d74efa461f55e59e766 INFO: 172.20.0.1:59466 - "POST /node/69ab9d74efa461f55e59e766 HTTP/1.0" 202 Accepted 2026-03-07 03:40:25,093 - lava_callback - INFO - Starting async job submit for node 69ab9d74efa461f55e59e766 2026-03-07 03:40:25,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:40:25,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab9d74efa461f55e59e766 HTTP/1.1" 200 None 2026-03-07 03:40:25,126 - lava_callback - DEBUG - Processing node 69ab9d74efa461f55e59e766: baseline-arm64-broonie 2026-03-07 03:40:25,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:40:25,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:40:25,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab9d74efa461f55e59e766/log.txt.gz 2026-03-07 03:40:25,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:40:26,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:40:26,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab9d74efa461f55e59e766/lava-logs.yaml 2026-03-07 03:40:26,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:40:26,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:40:26,239 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab9d74efa461f55e59e766/lava_callback.json.gz 2026-03-07 03:40:26,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:40:26,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab9d74efa461f55e59e766 HTTP/1.1" 200 None 2026-03-07 03:40:26,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:40:26,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 03:40:26,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:40:26,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab9d74efa461f55e59e766 HTTP/1.1" 200 None 2026-03-07 03:40:26,394 - lava_callback - INFO - Completed processing callback for node 69ab9d74efa461f55e59e766 INFO: 172.20.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33584 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:40:43,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:40:43,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36888 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:43:45,199 - lava_callback - INFO - Received callback for node 69ab9e3cefa461f55e59e79c INFO: 172.20.0.1:38294 - "POST /node/69ab9e3cefa461f55e59e79c HTTP/1.0" 202 Accepted 2026-03-07 03:43:45,205 - lava_callback - INFO - Starting async job submit for node 69ab9e3cefa461f55e59e79c 2026-03-07 03:43:45,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:43:45,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab9e3cefa461f55e59e79c HTTP/1.1" 200 None 2026-03-07 03:43:45,239 - lava_callback - DEBUG - Processing node 69ab9e3cefa461f55e59e79c: baseline-arm64-broonie 2026-03-07 03:43:45,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:43:45,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:43:45,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab9e3cefa461f55e59e79c/log.txt.gz 2026-03-07 03:43:45,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:43:46,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:43:46,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab9e3cefa461f55e59e79c/lava-logs.yaml 2026-03-07 03:43:46,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:43:46,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:43:46,244 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ab9e3cefa461f55e59e79c/lava_callback.json.gz 2026-03-07 03:43:46,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:43:46,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab9e3cefa461f55e59e79c HTTP/1.1" 200 None 2026-03-07 03:43:46,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:43:46,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-07 03:43:46,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:43:46,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab9e3cefa461f55e59e79c HTTP/1.1" 200 None 2026-03-07 03:43:46,376 - lava_callback - INFO - Completed processing callback for node 69ab9e3cefa461f55e59e79c INFO: 172.20.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36626 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:44:13,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:44:13,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45208 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:53:21,872 - lava_callback - INFO - Received callback for node 69aa70258c4d487a0e7539e2 INFO: 172.20.0.1:48470 - "POST /node/69aa70258c4d487a0e7539e2 HTTP/1.0" 202 Accepted 2026-03-07 03:53:21,878 - lava_callback - INFO - Starting async job submit for node 69aa70258c4d487a0e7539e2 2026-03-07 03:53:21,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:53:21,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa70258c4d487a0e7539e2 HTTP/1.1" 200 None 2026-03-07 03:53:21,940 - lava_callback - DEBUG - Processing node 69aa70258c4d487a0e7539e2: baseline-x86 2026-03-07 03:53:22,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:53:22,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:53:22,353 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa70258c4d487a0e7539e2/log.txt.gz 2026-03-07 03:53:22,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:53:22,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:53:22,713 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa70258c4d487a0e7539e2/lava-logs.yaml 2026-03-07 03:53:22,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:53:22,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:53:22,865 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa70258c4d487a0e7539e2/lava_callback.json.gz DEBUG: Setup failed for 69aa70258c4d487a0e7539e2. Transitting job node result: incomplete -> fail 2026-03-07 03:53:22,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:53:22,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa70258c4d487a0e7539e2 HTTP/1.1" 200 None 2026-03-07 03:53:22,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:53:22,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85b19440c1da21c23722a HTTP/1.1" 200 None 2026-03-07 03:53:22,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:53:22,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa70258c4d487a0e7539e2 HTTP/1.1" 200 None 2026-03-07 03:53:23,056 - lava_callback - INFO - Completed processing callback for node 69aa70258c4d487a0e7539e2 INFO: 172.20.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42042 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:53:43,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:53:43,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60020 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:56:02,227 - lava_callback - INFO - Received callback for node 69aa82ad8c4d487a0e754082 INFO: 172.20.0.1:60022 - "POST /node/69aa82ad8c4d487a0e754082 HTTP/1.0" 202 Accepted 2026-03-07 03:56:02,233 - lava_callback - INFO - Starting async job submit for node 69aa82ad8c4d487a0e754082 2026-03-07 03:56:02,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:56:02,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa82ad8c4d487a0e754082 HTTP/1.1" 200 None 2026-03-07 03:56:02,300 - lava_callback - DEBUG - Processing node 69aa82ad8c4d487a0e754082: baseline-x86 2026-03-07 03:56:02,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:56:02,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:56:02,704 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa82ad8c4d487a0e754082/log.txt.gz 2026-03-07 03:56:02,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:56:03,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:56:03,028 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa82ad8c4d487a0e754082/lava-logs.yaml 2026-03-07 03:56:03,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:56:03,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:56:03,178 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa82ad8c4d487a0e754082/lava_callback.json.gz DEBUG: Setup failed for 69aa82ad8c4d487a0e754082. Transitting job node result: incomplete -> fail 2026-03-07 03:56:03,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:56:03,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa82ad8c4d487a0e754082 HTTP/1.1" 200 None 2026-03-07 03:56:03,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:56:03,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a697103d518458fb33ea36 HTTP/1.1" 200 None 2026-03-07 03:56:03,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:56:03,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa82ad8c4d487a0e754082 HTTP/1.1" 200 None 2026-03-07 03:56:03,399 - lava_callback - INFO - Completed processing callback for node 69aa82ad8c4d487a0e754082 INFO: 172.20.0.1:60026 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:56:13,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:56:13,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53884 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:56:30,541 - lava_callback - INFO - Received callback for node 69aa96dc76ddd5d9e606ddd2 INFO: 172.20.0.1:46230 - "POST /node/69aa96dc76ddd5d9e606ddd2 HTTP/1.0" 202 Accepted 2026-03-07 03:56:30,546 - lava_callback - INFO - Starting async job submit for node 69aa96dc76ddd5d9e606ddd2 2026-03-07 03:56:30,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:56:30,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa96dc76ddd5d9e606ddd2 HTTP/1.1" 200 None 2026-03-07 03:56:30,579 - lava_callback - DEBUG - Processing node 69aa96dc76ddd5d9e606ddd2: baseline-x86 2026-03-07 03:56:30,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:56:31,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:56:31,039 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa96dc76ddd5d9e606ddd2/log.txt.gz 2026-03-07 03:56:31,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:56:31,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:56:31,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa96dc76ddd5d9e606ddd2/lava-logs.yaml 2026-03-07 03:56:31,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:56:31,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:56:31,581 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa96dc76ddd5d9e606ddd2/lava_callback.json.gz 2026-03-07 03:56:31,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:56:31,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa96dc76ddd5d9e606ddd2 HTTP/1.1" 200 None 2026-03-07 03:56:31,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:56:31,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8e0676ddd5d9e606d4bc HTTP/1.1" 200 None 2026-03-07 03:56:31,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:56:31,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa96dc76ddd5d9e606ddd2 HTTP/1.1" 200 None 2026-03-07 03:56:31,660 - lava_callback - INFO - Completed processing callback for node 69aa96dc76ddd5d9e606ddd2 INFO: 172.20.0.1:46232 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:56:43,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:56:43,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39936 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:58:24,439 - lava_callback - INFO - Received callback for node 69aa8aed8c4d487a0e754338 INFO: 172.20.0.1:37376 - "POST /node/69aa8aed8c4d487a0e754338 HTTP/1.0" 202 Accepted 2026-03-07 03:58:24,445 - lava_callback - INFO - Starting async job submit for node 69aa8aed8c4d487a0e754338 2026-03-07 03:58:24,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:58:24,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8aed8c4d487a0e754338 HTTP/1.1" 200 None 2026-03-07 03:58:24,516 - lava_callback - DEBUG - Processing node 69aa8aed8c4d487a0e754338: baseline-x86 2026-03-07 03:58:24,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:58:24,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:58:24,910 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aa8aed8c4d487a0e754338/log.txt.gz 2026-03-07 03:58:25,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:58:25,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:58:25,341 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aa8aed8c4d487a0e754338/lava-logs.yaml 2026-03-07 03:58:25,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:58:25,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:58:25,552 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aa8aed8c4d487a0e754338/lava_callback.json.gz DEBUG: Setup failed for 69aa8aed8c4d487a0e754338. Transitting job node result: incomplete -> fail 2026-03-07 03:58:25,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:58:25,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8aed8c4d487a0e754338 HTTP/1.1" 200 None 2026-03-07 03:58:25,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:58:25,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9ad129c5f93e4f05eb2eb HTTP/1.1" 200 None 2026-03-07 03:58:25,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:58:25,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aa8aed8c4d487a0e754338 HTTP/1.1" 200 None 2026-03-07 03:58:25,815 - lava_callback - INFO - Completed processing callback for node 69aa8aed8c4d487a0e754338 INFO: 172.20.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56070 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:58:43,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:58:43,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50500 - "GET / HTTP/1.0" 200 OK 2026-03-07 03:59:53,833 - lava_callback - INFO - Received callback for node 69aacc8a76ddd5d9e606f069 INFO: 172.20.0.1:39970 - "POST /node/69aacc8a76ddd5d9e606f069 HTTP/1.0" 202 Accepted 2026-03-07 03:59:53,839 - lava_callback - INFO - Starting async job submit for node 69aacc8a76ddd5d9e606f069 2026-03-07 03:59:53,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:59:53,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aacc8a76ddd5d9e606f069 HTTP/1.1" 200 None 2026-03-07 03:59:53,871 - lava_callback - DEBUG - Processing node 69aacc8a76ddd5d9e606f069: baseline-x86 2026-03-07 03:59:54,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:59:54,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:59:54,332 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aacc8a76ddd5d9e606f069/log.txt.gz 2026-03-07 03:59:54,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:59:54,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:59:54,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aacc8a76ddd5d9e606f069/lava-logs.yaml 2026-03-07 03:59:54,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 03:59:54,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 03:59:54,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aacc8a76ddd5d9e606f069/lava_callback.json.gz 2026-03-07 03:59:54,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:59:54,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aacc8a76ddd5d9e606f069 HTTP/1.1" 200 None 2026-03-07 03:59:54,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:59:54,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d638c4d487a0e751178 HTTP/1.1" 200 None 2026-03-07 03:59:54,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 03:59:54,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aacc8a76ddd5d9e606f069 HTTP/1.1" 200 None 2026-03-07 03:59:54,979 - lava_callback - INFO - Completed processing callback for node 69aacc8a76ddd5d9e606f069 INFO: 172.20.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36338 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:00:13,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:00:13,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59686 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:16:23,255 - lava_callback - INFO - Received callback for node 69aac00076ddd5d9e606ed1e INFO: 172.20.0.1:51594 - "POST /node/69aac00076ddd5d9e606ed1e HTTP/1.0" 202 Accepted 2026-03-07 04:16:23,261 - lava_callback - INFO - Starting async job submit for node 69aac00076ddd5d9e606ed1e 2026-03-07 04:16:23,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:16:23,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aac00076ddd5d9e606ed1e HTTP/1.1" 200 None 2026-03-07 04:16:23,316 - lava_callback - DEBUG - Processing node 69aac00076ddd5d9e606ed1e: baseline-x86 2026-03-07 04:16:23,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:16:23,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:16:23,799 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aac00076ddd5d9e606ed1e/log.txt.gz 2026-03-07 04:16:23,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:16:24,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:16:24,142 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aac00076ddd5d9e606ed1e/lava-logs.yaml 2026-03-07 04:16:24,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:16:24,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:16:24,328 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aac00076ddd5d9e606ed1e/lava_callback.json.gz DEBUG: Setup failed for 69aac00076ddd5d9e606ed1e. Transitting job node result: incomplete -> fail 2026-03-07 04:16:24,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:16:24,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aac00076ddd5d9e606ed1e HTTP/1.1" 200 None 2026-03-07 04:16:24,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:16:24,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85b19440c1da21c23722a HTTP/1.1" 200 None 2026-03-07 04:16:24,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:16:24,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aac00076ddd5d9e606ed1e HTTP/1.1" 200 None 2026-03-07 04:16:24,554 - lava_callback - INFO - Completed processing callback for node 69aac00076ddd5d9e606ed1e INFO: 172.20.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60848 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:16:43,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:16:43,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50138 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:22:06,302 - lava_callback - INFO - Received callback for node 69aadfbf76ddd5d9e606f782 INFO: 172.20.0.1:50154 - "POST /node/69aadfbf76ddd5d9e606f782 HTTP/1.0" 202 Accepted 2026-03-07 04:22:06,308 - lava_callback - INFO - Starting async job submit for node 69aadfbf76ddd5d9e606f782 2026-03-07 04:22:06,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:22:06,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aadfbf76ddd5d9e606f782 HTTP/1.1" 200 None 2026-03-07 04:22:06,354 - lava_callback - DEBUG - Processing node 69aadfbf76ddd5d9e606f782: baseline-x86 INFO: 172.20.0.1:50168 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:22:06,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:22:06,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:22:06,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aadfbf76ddd5d9e606f782/log.txt.gz 2026-03-07 04:22:06,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:22:07,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:22:07,133 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aadfbf76ddd5d9e606f782/lava-logs.yaml 2026-03-07 04:22:07,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:22:07,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:22:07,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aadfbf76ddd5d9e606f782/lava_callback.json.gz DEBUG: Setup failed for 69aadfbf76ddd5d9e606f782. Transitting job node result: incomplete -> fail 2026-03-07 04:22:07,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:22:07,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aadfbf76ddd5d9e606f782 HTTP/1.1" 200 None 2026-03-07 04:22:07,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:22:07,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9ad129c5f93e4f05eb2eb HTTP/1.1" 200 None 2026-03-07 04:22:07,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:22:07,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aadfbf76ddd5d9e606f782 HTTP/1.1" 200 None 2026-03-07 04:22:07,531 - lava_callback - INFO - Completed processing callback for node 69aadfbf76ddd5d9e606f782 2026-03-07 04:22:13,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:22:13,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40634 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:25:19,325 - lava_callback - INFO - Received callback for node 69aaefb076ddd5d9e606fccc INFO: 172.20.0.1:40648 - "POST /node/69aaefb076ddd5d9e606fccc HTTP/1.0" 202 Accepted 2026-03-07 04:25:19,331 - lava_callback - INFO - Starting async job submit for node 69aaefb076ddd5d9e606fccc 2026-03-07 04:25:19,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:25:19,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaefb076ddd5d9e606fccc HTTP/1.1" 200 None 2026-03-07 04:25:19,385 - lava_callback - DEBUG - Processing node 69aaefb076ddd5d9e606fccc: baseline-x86 2026-03-07 04:25:19,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:25:19,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:25:19,849 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aaefb076ddd5d9e606fccc/log.txt.gz 2026-03-07 04:25:20,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:25:20,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:25:20,238 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aaefb076ddd5d9e606fccc/lava-logs.yaml 2026-03-07 04:25:20,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:25:20,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:25:20,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aaefb076ddd5d9e606fccc/lava_callback.json.gz 2026-03-07 04:25:20,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:25:20,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aaefb076ddd5d9e606fccc HTTP/1.1" 200 None 2026-03-07 04:25:20,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:25:20,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8e0676ddd5d9e606d4bc HTTP/1.1" 200 None 2026-03-07 04:25:20,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:25:20,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aaefb076ddd5d9e606fccc HTTP/1.1" 200 None 2026-03-07 04:25:20,551 - lava_callback - INFO - Completed processing callback for node 69aaefb076ddd5d9e606fccc INFO: 172.20.0.1:45336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58234 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:25:43,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:25:43,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40476 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:32:07,320 - lava_callback - INFO - Received callback for node 69ab213327cb11dcdfc7694d INFO: 172.20.0.1:40482 - "POST /node/69ab213327cb11dcdfc7694d HTTP/1.0" 202 Accepted 2026-03-07 04:32:07,330 - lava_callback - INFO - Starting async job submit for node 69ab213327cb11dcdfc7694d 2026-03-07 04:32:07,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:32:07,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab213327cb11dcdfc7694d HTTP/1.1" 200 None 2026-03-07 04:32:07,379 - lava_callback - DEBUG - Processing node 69ab213327cb11dcdfc7694d: baseline-x86 2026-03-07 04:32:07,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:32:07,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:32:07,861 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab213327cb11dcdfc7694d/log.txt.gz 2026-03-07 04:32:08,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:32:08,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:32:08,245 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab213327cb11dcdfc7694d/lava-logs.yaml 2026-03-07 04:32:08,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:32:08,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:32:08,422 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab213327cb11dcdfc7694d/lava_callback.json.gz 2026-03-07 04:32:08,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:32:08,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab213327cb11dcdfc7694d HTTP/1.1" 200 None 2026-03-07 04:32:08,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:32:08,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa1d638c4d487a0e751178 HTTP/1.1" 200 None 2026-03-07 04:32:08,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:32:08,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab213327cb11dcdfc7694d HTTP/1.1" 200 None 2026-03-07 04:32:08,505 - lava_callback - INFO - Completed processing callback for node 69ab213327cb11dcdfc7694d 2026-03-07 04:32:13,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:32:13,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51066 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:33:32,562 - lava_callback - INFO - Received callback for node 69ab245f27cb11dcdfc76a38 INFO: 172.20.0.1:56716 - "POST /node/69ab245f27cb11dcdfc76a38 HTTP/1.0" 202 Accepted 2026-03-07 04:33:32,568 - lava_callback - INFO - Starting async job submit for node 69ab245f27cb11dcdfc76a38 2026-03-07 04:33:32,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:33:32,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab245f27cb11dcdfc76a38 HTTP/1.1" 200 None 2026-03-07 04:33:32,600 - lava_callback - DEBUG - Processing node 69ab245f27cb11dcdfc76a38: baseline-x86 2026-03-07 04:33:32,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:33:33,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:33:33,072 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245f27cb11dcdfc76a38/log.txt.gz 2026-03-07 04:33:33,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:33:33,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:33:33,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245f27cb11dcdfc76a38/lava-logs.yaml 2026-03-07 04:33:33,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:33:33,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:33:33,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab245f27cb11dcdfc76a38/lava_callback.json.gz 2026-03-07 04:33:33,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:33:33,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab245f27cb11dcdfc76a38 HTTP/1.1" 200 None 2026-03-07 04:33:33,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:33:33,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafec027cb11dcdfc75912 HTTP/1.1" 200 None 2026-03-07 04:33:33,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:33:33,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab245f27cb11dcdfc76a38 HTTP/1.1" 200 None 2026-03-07 04:33:33,738 - lava_callback - INFO - Completed processing callback for node 69ab245f27cb11dcdfc76a38 INFO: 172.20.0.1:56720 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:33:43,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:33:43,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52540 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:38:33,673 - lava_callback - INFO - Received callback for node 69ab460c27cb11dcdfc776c4 INFO: 172.20.0.1:55880 - "POST /node/69ab460c27cb11dcdfc776c4 HTTP/1.0" 202 Accepted 2026-03-07 04:38:33,679 - lava_callback - INFO - Starting async job submit for node 69ab460c27cb11dcdfc776c4 2026-03-07 04:38:33,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:38:33,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab460c27cb11dcdfc776c4 HTTP/1.1" 200 None 2026-03-07 04:38:33,711 - lava_callback - DEBUG - Processing node 69ab460c27cb11dcdfc776c4: baseline-x86 2026-03-07 04:38:34,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:38:34,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:38:34,296 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab460c27cb11dcdfc776c4/log.txt.gz 2026-03-07 04:38:34,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:38:34,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:38:34,729 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab460c27cb11dcdfc776c4/lava-logs.yaml 2026-03-07 04:38:34,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:38:34,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:38:34,894 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab460c27cb11dcdfc776c4/lava_callback.json.gz 2026-03-07 04:38:34,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:38:34,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab460c27cb11dcdfc776c4 HTTP/1.1" 200 None 2026-03-07 04:38:34,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:38:34,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aa8e0676ddd5d9e606d4bc HTTP/1.1" 200 None 2026-03-07 04:38:34,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:38:34,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab460c27cb11dcdfc776c4 HTTP/1.1" 200 None 2026-03-07 04:38:34,982 - lava_callback - INFO - Completed processing callback for node 69ab460c27cb11dcdfc776c4 INFO: 172.20.0.1:55884 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:38:43,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:38:43,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43618 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:40:32,682 - lava_callback - INFO - Received callback for node 69ab72faefa461f55e59d2a1 INFO: 172.20.0.1:49928 - "POST /node/69ab72faefa461f55e59d2a1 HTTP/1.0" 202 Accepted 2026-03-07 04:40:32,688 - lava_callback - INFO - Starting async job submit for node 69ab72faefa461f55e59d2a1 2026-03-07 04:40:32,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:40:32,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab72faefa461f55e59d2a1 HTTP/1.1" 200 None 2026-03-07 04:40:32,722 - lava_callback - DEBUG - Processing node 69ab72faefa461f55e59d2a1: baseline-x86 2026-03-07 04:40:32,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:40:33,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:40:33,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72faefa461f55e59d2a1/log.txt.gz 2026-03-07 04:40:33,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:40:33,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:40:33,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72faefa461f55e59d2a1/lava-logs.yaml 2026-03-07 04:40:33,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:40:33,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:40:33,762 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab72faefa461f55e59d2a1/lava_callback.json.gz 2026-03-07 04:40:33,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:40:33,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab72faefa461f55e59d2a1 HTTP/1.1" 200 None 2026-03-07 04:40:33,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:40:33,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e5befa461f55e59cde7 HTTP/1.1" 200 None 2026-03-07 04:40:33,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:40:33,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab72faefa461f55e59d2a1 HTTP/1.1" 200 None 2026-03-07 04:40:33,842 - lava_callback - INFO - Completed processing callback for node 69ab72faefa461f55e59d2a1 INFO: 172.20.0.1:49932 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:40:43,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:40:43,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38474 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:41:46,280 - lava_callback - INFO - Received callback for node 69ab7a9fefa461f55e59d855 INFO: 172.20.0.1:59420 - "POST /node/69ab7a9fefa461f55e59d855 HTTP/1.0" 202 Accepted 2026-03-07 04:41:46,286 - lava_callback - INFO - Starting async job submit for node 69ab7a9fefa461f55e59d855 2026-03-07 04:41:46,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:41:46,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7a9fefa461f55e59d855 HTTP/1.1" 200 None 2026-03-07 04:41:46,329 - lava_callback - DEBUG - Processing node 69ab7a9fefa461f55e59d855: baseline-x86 INFO: 172.20.0.1:59430 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:41:46,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:41:46,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:41:46,813 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab7a9fefa461f55e59d855/log.txt.gz 2026-03-07 04:41:46,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:41:47,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:41:47,223 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab7a9fefa461f55e59d855/lava-logs.yaml 2026-03-07 04:41:47,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:41:47,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:41:47,437 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab7a9fefa461f55e59d855/lava_callback.json.gz 2026-03-07 04:41:47,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:41:47,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab7a9fefa461f55e59d855 HTTP/1.1" 200 None 2026-03-07 04:41:47,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:41:47,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafec027cb11dcdfc75912 HTTP/1.1" 200 None 2026-03-07 04:41:47,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:41:47,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab7a9fefa461f55e59d855 HTTP/1.1" 200 None 2026-03-07 04:41:47,540 - lava_callback - INFO - Completed processing callback for node 69ab7a9fefa461f55e59d855 INFO: 172.20.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54196 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:42:13,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:42:13,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55638 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:49:07,339 - lava_callback - INFO - Received callback for node 69a90b37911a9cbe7f77fead INFO: 172.20.0.1:55654 - "POST /node/69a90b37911a9cbe7f77fead HTTP/1.0" 202 Accepted 2026-03-07 04:49:07,345 - lava_callback - INFO - Starting async job submit for node 69a90b37911a9cbe7f77fead 2026-03-07 04:49:07,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:49:07,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90b37911a9cbe7f77fead HTTP/1.1" 200 None 2026-03-07 04:49:07,362 - lava_callback - DEBUG - Processing node 69a90b37911a9cbe7f77fead: baseline-arm-baylibre 2026-03-07 04:49:07,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90b37911a9cbe7f77fead 2026-03-07 04:49:07,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:49:07,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90b37911a9cbe7f77fead HTTP/1.1" 200 None 2026-03-07 04:49:07,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:49:07,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:49:07,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:49:07,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90b37911a9cbe7f77fead HTTP/1.1" 200 None 2026-03-07 04:49:07,421 - lava_callback - ERROR - Error processing callback for node 69a90b37911a9cbe7f77fead: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45526 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:49:47,288 - lava_callback - INFO - Received callback for node 69a90b64911a9cbe7f77fee2 INFO: 172.20.0.1:45538 - "POST /node/69a90b64911a9cbe7f77fee2 HTTP/1.0" 202 Accepted 2026-03-07 04:49:47,293 - lava_callback - INFO - Starting async job submit for node 69a90b64911a9cbe7f77fee2 2026-03-07 04:49:47,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:49:47,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90b64911a9cbe7f77fee2 HTTP/1.1" 200 None 2026-03-07 04:49:47,311 - lava_callback - DEBUG - Processing node 69a90b64911a9cbe7f77fee2: baseline-arm-baylibre 2026-03-07 04:49:47,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90b64911a9cbe7f77fee2 2026-03-07 04:49:47,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:49:47,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90b64911a9cbe7f77fee2 HTTP/1.1" 200 None 2026-03-07 04:49:47,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:49:47,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:49:47,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:49:47,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90b64911a9cbe7f77fee2 HTTP/1.1" 200 None 2026-03-07 04:49:47,399 - lava_callback - ERROR - Error processing callback for node 69a90b64911a9cbe7f77fee2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43804 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:50:47,405 - lava_callback - INFO - Received callback for node 69a90b92911a9cbe7f77ff08 INFO: 172.20.0.1:43808 - "POST /node/69a90b92911a9cbe7f77ff08 HTTP/1.0" 202 Accepted 2026-03-07 04:50:47,410 - lava_callback - INFO - Starting async job submit for node 69a90b92911a9cbe7f77ff08 2026-03-07 04:50:47,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:50:47,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90b92911a9cbe7f77ff08 HTTP/1.1" 200 None 2026-03-07 04:50:47,426 - lava_callback - DEBUG - Processing node 69a90b92911a9cbe7f77ff08: baseline-arm-baylibre 2026-03-07 04:50:47,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90b92911a9cbe7f77ff08 2026-03-07 04:50:47,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:50:47,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90b92911a9cbe7f77ff08 HTTP/1.1" 200 None 2026-03-07 04:50:47,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:50:47,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:50:47,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:50:47,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90b92911a9cbe7f77ff08 HTTP/1.1" 200 None 2026-03-07 04:50:47,480 - lava_callback - ERROR - Error processing callback for node 69a90b92911a9cbe7f77ff08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41528 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:51:27,424 - lava_callback - INFO - Received callback for node 69a90bc0911a9cbe7f77ff6a INFO: 172.20.0.1:41538 - "POST /node/69a90bc0911a9cbe7f77ff6a HTTP/1.0" 202 Accepted 2026-03-07 04:51:27,430 - lava_callback - INFO - Starting async job submit for node 69a90bc0911a9cbe7f77ff6a 2026-03-07 04:51:27,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:51:27,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90bc0911a9cbe7f77ff6a HTTP/1.1" 200 None 2026-03-07 04:51:27,463 - lava_callback - DEBUG - Processing node 69a90bc0911a9cbe7f77ff6a: baseline-arm-baylibre 2026-03-07 04:51:27,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90bc0911a9cbe7f77ff6a 2026-03-07 04:51:27,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:51:27,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90bc0911a9cbe7f77ff6a HTTP/1.1" 200 None 2026-03-07 04:51:27,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:51:27,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:51:27,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:51:27,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90bc0911a9cbe7f77ff6a HTTP/1.1" 200 None 2026-03-07 04:51:27,567 - lava_callback - ERROR - Error processing callback for node 69a90bc0911a9cbe7f77ff6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39958 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:52:07,486 - lava_callback - INFO - Received callback for node 69a90bef911a9cbe7f77ff92 INFO: 172.20.0.1:39968 - "POST /node/69a90bef911a9cbe7f77ff92 HTTP/1.0" 202 Accepted 2026-03-07 04:52:07,491 - lava_callback - INFO - Starting async job submit for node 69a90bef911a9cbe7f77ff92 2026-03-07 04:52:07,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:52:07,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90bef911a9cbe7f77ff92 HTTP/1.1" 200 None 2026-03-07 04:52:07,509 - lava_callback - DEBUG - Processing node 69a90bef911a9cbe7f77ff92: baseline-arm-baylibre 2026-03-07 04:52:07,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90bef911a9cbe7f77ff92 2026-03-07 04:52:07,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:52:07,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90bef911a9cbe7f77ff92 HTTP/1.1" 200 None 2026-03-07 04:52:07,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:52:07,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:52:07,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:52:07,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90bef911a9cbe7f77ff92 HTTP/1.1" 200 None 2026-03-07 04:52:07,570 - lava_callback - ERROR - Error processing callback for node 69a90bef911a9cbe7f77ff92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46398 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:52:47,462 - lava_callback - INFO - Received callback for node 69a90c17911a9cbe7f77ffeb INFO: 172.20.0.1:46410 - "POST /node/69a90c17911a9cbe7f77ffeb HTTP/1.0" 202 Accepted 2026-03-07 04:52:47,467 - lava_callback - INFO - Starting async job submit for node 69a90c17911a9cbe7f77ffeb 2026-03-07 04:52:47,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:52:47,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90c17911a9cbe7f77ffeb HTTP/1.1" 200 None 2026-03-07 04:52:47,483 - lava_callback - DEBUG - Processing node 69a90c17911a9cbe7f77ffeb: baseline-arm-baylibre 2026-03-07 04:52:47,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90c17911a9cbe7f77ffeb 2026-03-07 04:52:47,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:52:47,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90c17911a9cbe7f77ffeb HTTP/1.1" 200 None 2026-03-07 04:52:47,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:52:47,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:52:47,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:52:47,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90c17911a9cbe7f77ffeb HTTP/1.1" 200 None 2026-03-07 04:52:47,546 - lava_callback - ERROR - Error processing callback for node 69a90c17911a9cbe7f77ffeb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38100 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:53:27,564 - lava_callback - INFO - Received callback for node 69a90c41911a9cbe7f78001d INFO: 172.20.0.1:38112 - "POST /node/69a90c41911a9cbe7f78001d HTTP/1.0" 202 Accepted 2026-03-07 04:53:27,570 - lava_callback - INFO - Starting async job submit for node 69a90c41911a9cbe7f78001d 2026-03-07 04:53:27,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:53:27,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90c41911a9cbe7f78001d HTTP/1.1" 200 None 2026-03-07 04:53:27,585 - lava_callback - DEBUG - Processing node 69a90c41911a9cbe7f78001d: baseline-arm-baylibre 2026-03-07 04:53:27,586 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90c41911a9cbe7f78001d 2026-03-07 04:53:27,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:53:27,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90c41911a9cbe7f78001d HTTP/1.1" 200 None 2026-03-07 04:53:27,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:53:27,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:53:27,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:53:27,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90c41911a9cbe7f78001d HTTP/1.1" 200 None 2026-03-07 04:53:27,642 - lava_callback - ERROR - Error processing callback for node 69a90c41911a9cbe7f78001d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34264 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:54:07,510 - lava_callback - INFO - Received callback for node 69a90c6d911a9cbe7f780045 INFO: 172.20.0.1:34272 - "POST /node/69a90c6d911a9cbe7f780045 HTTP/1.0" 202 Accepted 2026-03-07 04:54:07,516 - lava_callback - INFO - Starting async job submit for node 69a90c6d911a9cbe7f780045 2026-03-07 04:54:07,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:54:07,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90c6d911a9cbe7f780045 HTTP/1.1" 200 None 2026-03-07 04:54:07,533 - lava_callback - DEBUG - Processing node 69a90c6d911a9cbe7f780045: baseline-arm-baylibre 2026-03-07 04:54:07,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90c6d911a9cbe7f780045 2026-03-07 04:54:07,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:54:07,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90c6d911a9cbe7f780045 HTTP/1.1" 200 None 2026-03-07 04:54:07,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:54:07,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:54:07,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:54:07,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90c6d911a9cbe7f780045 HTTP/1.1" 200 None 2026-03-07 04:54:07,605 - lava_callback - ERROR - Error processing callback for node 69a90c6d911a9cbe7f780045: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32922 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:55:07,732 - lava_callback - INFO - Received callback for node 69a90c9d911a9cbe7f780098 INFO: 172.20.0.1:32930 - "POST /node/69a90c9d911a9cbe7f780098 HTTP/1.0" 202 Accepted 2026-03-07 04:55:07,737 - lava_callback - INFO - Starting async job submit for node 69a90c9d911a9cbe7f780098 2026-03-07 04:55:07,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:55:07,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90c9d911a9cbe7f780098 HTTP/1.1" 200 None 2026-03-07 04:55:07,753 - lava_callback - DEBUG - Processing node 69a90c9d911a9cbe7f780098: baseline-arm-baylibre 2026-03-07 04:55:07,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90c9d911a9cbe7f780098 2026-03-07 04:55:07,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:55:07,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90c9d911a9cbe7f780098 HTTP/1.1" 200 None 2026-03-07 04:55:07,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:55:07,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:55:07,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:55:07,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90c9d911a9cbe7f780098 HTTP/1.1" 200 None 2026-03-07 04:55:07,812 - lava_callback - ERROR - Error processing callback for node 69a90c9d911a9cbe7f780098: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47502 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:55:47,622 - lava_callback - INFO - Received callback for node 69a90cc9911a9cbe7f7800cf INFO: 172.20.0.1:47504 - "POST /node/69a90cc9911a9cbe7f7800cf HTTP/1.0" 202 Accepted 2026-03-07 04:55:47,628 - lava_callback - INFO - Starting async job submit for node 69a90cc9911a9cbe7f7800cf 2026-03-07 04:55:47,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:55:47,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90cc9911a9cbe7f7800cf HTTP/1.1" 200 None 2026-03-07 04:55:47,653 - lava_callback - DEBUG - Processing node 69a90cc9911a9cbe7f7800cf: baseline-arm-baylibre 2026-03-07 04:55:47,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90cc9911a9cbe7f7800cf 2026-03-07 04:55:47,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:55:47,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90cc9911a9cbe7f7800cf HTTP/1.1" 200 None 2026-03-07 04:55:47,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:55:47,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:55:47,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:55:47,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90cc9911a9cbe7f7800cf HTTP/1.1" 200 None 2026-03-07 04:55:47,724 - lava_callback - ERROR - Error processing callback for node 69a90cc9911a9cbe7f7800cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47190 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:56:27,664 - lava_callback - INFO - Received callback for node 69a90cf6911a9cbe7f780120 INFO: 172.20.0.1:47194 - "POST /node/69a90cf6911a9cbe7f780120 HTTP/1.0" 202 Accepted 2026-03-07 04:56:27,669 - lava_callback - INFO - Starting async job submit for node 69a90cf6911a9cbe7f780120 2026-03-07 04:56:27,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:56:27,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90cf6911a9cbe7f780120 HTTP/1.1" 200 None 2026-03-07 04:56:27,685 - lava_callback - DEBUG - Processing node 69a90cf6911a9cbe7f780120: baseline-arm-baylibre 2026-03-07 04:56:27,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90cf6911a9cbe7f780120 2026-03-07 04:56:27,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:56:27,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90cf6911a9cbe7f780120 HTTP/1.1" 200 None 2026-03-07 04:56:27,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:56:27,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:56:27,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:56:27,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90cf6911a9cbe7f780120 HTTP/1.1" 200 None 2026-03-07 04:56:27,749 - lava_callback - ERROR - Error processing callback for node 69a90cf6911a9cbe7f780120: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48554 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:56:40,125 - lava_callback - INFO - Received callback for node 69ab682427cb11dcdfc77fd4 INFO: 172.20.0.1:54436 - "POST /node/69ab682427cb11dcdfc77fd4 HTTP/1.0" 202 Accepted 2026-03-07 04:56:40,131 - lava_callback - INFO - Starting async job submit for node 69ab682427cb11dcdfc77fd4 2026-03-07 04:56:40,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:56:40,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab682427cb11dcdfc77fd4 HTTP/1.1" 200 None 2026-03-07 04:56:40,173 - lava_callback - DEBUG - Processing node 69ab682427cb11dcdfc77fd4: baseline-x86 2026-03-07 04:56:40,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:56:40,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:56:40,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab682427cb11dcdfc77fd4/log.txt.gz 2026-03-07 04:56:40,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:56:40,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:56:40,846 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab682427cb11dcdfc77fd4/lava-logs.yaml 2026-03-07 04:56:40,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:56:41,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:56:41,030 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab682427cb11dcdfc77fd4/lava_callback.json.gz DEBUG: Setup failed for 69ab682427cb11dcdfc77fd4. Transitting job node result: incomplete -> fail 2026-03-07 04:56:41,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:56:41,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab682427cb11dcdfc77fd4 HTTP/1.1" 200 None 2026-03-07 04:56:41,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:56:41,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9ad129c5f93e4f05eb2eb HTTP/1.1" 200 None 2026-03-07 04:56:41,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:56:41,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab682427cb11dcdfc77fd4 HTTP/1.1" 200 None 2026-03-07 04:56:41,232 - lava_callback - INFO - Completed processing callback for node 69ab682427cb11dcdfc77fd4 2026-03-07 04:56:43,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:56:43,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41768 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:57:07,664 - lava_callback - INFO - Received callback for node 69a90d22911a9cbe7f78014b INFO: 172.20.0.1:41774 - "POST /node/69a90d22911a9cbe7f78014b HTTP/1.0" 202 Accepted 2026-03-07 04:57:07,670 - lava_callback - INFO - Starting async job submit for node 69a90d22911a9cbe7f78014b 2026-03-07 04:57:07,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:57:07,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90d22911a9cbe7f78014b HTTP/1.1" 200 None 2026-03-07 04:57:07,686 - lava_callback - DEBUG - Processing node 69a90d22911a9cbe7f78014b: baseline-arm-baylibre 2026-03-07 04:57:07,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90d22911a9cbe7f78014b 2026-03-07 04:57:07,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:57:07,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90d22911a9cbe7f78014b HTTP/1.1" 200 None 2026-03-07 04:57:07,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:57:07,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8a800e9e7049205c49c HTTP/1.1" 200 None 2026-03-07 04:57:07,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:57:07,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90d22911a9cbe7f78014b HTTP/1.1" 200 None 2026-03-07 04:57:07,759 - lava_callback - ERROR - Error processing callback for node 69a90d22911a9cbe7f78014b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60162 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:58:24,239 - lava_callback - INFO - Received callback for node 69ab644427cb11dcdfc77e8b INFO: 172.20.0.1:52572 - "POST /node/69ab644427cb11dcdfc77e8b HTTP/1.0" 202 Accepted 2026-03-07 04:58:24,245 - lava_callback - INFO - Starting async job submit for node 69ab644427cb11dcdfc77e8b 2026-03-07 04:58:24,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:58:24,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab644427cb11dcdfc77e8b HTTP/1.1" 200 None 2026-03-07 04:58:24,292 - lava_callback - DEBUG - Processing node 69ab644427cb11dcdfc77e8b: baseline-x86 2026-03-07 04:58:24,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:58:24,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:58:24,726 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab644427cb11dcdfc77e8b/log.txt.gz 2026-03-07 04:58:24,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:58:25,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:58:25,111 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab644427cb11dcdfc77e8b/lava-logs.yaml 2026-03-07 04:58:25,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 04:58:25,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 04:58:25,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab644427cb11dcdfc77e8b/lava_callback.json.gz DEBUG: Setup failed for 69ab644427cb11dcdfc77e8b. Transitting job node result: incomplete -> fail 2026-03-07 04:58:25,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:58:25,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab644427cb11dcdfc77e8b HTTP/1.1" 200 None 2026-03-07 04:58:25,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:58:25,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a744aa5a0c0e10c4819cef HTTP/1.1" 200 None 2026-03-07 04:58:25,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:58:25,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab644427cb11dcdfc77e8b HTTP/1.1" 200 None 2026-03-07 04:58:25,454 - lava_callback - INFO - Completed processing callback for node 69ab644427cb11dcdfc77e8b INFO: 172.20.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53450 - "GET / HTTP/1.0" 200 OK 2026-03-07 04:58:43,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 04:58:43,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51634 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:02:04,223 - lava_callback - INFO - Received callback for node 69ab804aefa461f55e59dcdc INFO: 172.20.0.1:51648 - "POST /node/69ab804aefa461f55e59dcdc HTTP/1.0" 202 Accepted 2026-03-07 05:02:04,230 - lava_callback - INFO - Starting async job submit for node 69ab804aefa461f55e59dcdc 2026-03-07 05:02:04,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:02:04,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab804aefa461f55e59dcdc HTTP/1.1" 200 None 2026-03-07 05:02:04,281 - lava_callback - DEBUG - Processing node 69ab804aefa461f55e59dcdc: baseline-x86 2026-03-07 05:02:04,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:02:04,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:02:04,708 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab804aefa461f55e59dcdc/log.txt.gz 2026-03-07 05:02:04,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:02:05,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:02:05,048 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab804aefa461f55e59dcdc/lava-logs.yaml 2026-03-07 05:02:05,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:02:05,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:02:05,184 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab804aefa461f55e59dcdc/lava_callback.json.gz DEBUG: Setup failed for 69ab804aefa461f55e59dcdc. Transitting job node result: incomplete -> fail 2026-03-07 05:02:05,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:02:05,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab804aefa461f55e59dcdc HTTP/1.1" 200 None 2026-03-07 05:02:05,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:02:05,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8d000e9e7049205c4c9 HTTP/1.1" 200 None 2026-03-07 05:02:05,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:02:05,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab804aefa461f55e59dcdc HTTP/1.1" 200 None 2026-03-07 05:02:05,384 - lava_callback - INFO - Completed processing callback for node 69ab804aefa461f55e59dcdc INFO: 172.20.0.1:51658 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:02:13,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:02:13,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58292 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:04:28,221 - lava_callback - INFO - Received callback for node 69a90ecb911a9cbe7f78029c INFO: 172.20.0.1:58298 - "POST /node/69a90ecb911a9cbe7f78029c HTTP/1.0" 202 Accepted 2026-03-07 05:04:28,226 - lava_callback - INFO - Starting async job submit for node 69a90ecb911a9cbe7f78029c 2026-03-07 05:04:28,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:04:28,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90ecb911a9cbe7f78029c HTTP/1.1" 200 None 2026-03-07 05:04:28,241 - lava_callback - DEBUG - Processing node 69a90ecb911a9cbe7f78029c: baseline-arm64-baylibre 2026-03-07 05:04:28,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a90ecb911a9cbe7f78029c 2026-03-07 05:04:28,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:04:28,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a90ecb911a9cbe7f78029c HTTP/1.1" 200 None 2026-03-07 05:04:28,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:04:28,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85aff440c1da21c2371fe HTTP/1.1" 200 None 2026-03-07 05:04:28,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:04:28,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a90ecb911a9cbe7f78029c HTTP/1.1" 200 None 2026-03-07 05:04:28,305 - lava_callback - ERROR - Error processing callback for node 69a90ecb911a9cbe7f78029c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34300 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:15:08,785 - lava_callback - INFO - Received callback for node 69a91155911a9cbe7f7803c9 INFO: 172.20.0.1:34306 - "POST /node/69a91155911a9cbe7f7803c9 HTTP/1.0" 202 Accepted 2026-03-07 05:15:08,790 - lava_callback - INFO - Starting async job submit for node 69a91155911a9cbe7f7803c9 2026-03-07 05:15:08,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:15:08,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a91155911a9cbe7f7803c9 HTTP/1.1" 200 None 2026-03-07 05:15:08,808 - lava_callback - DEBUG - Processing node 69a91155911a9cbe7f7803c9: baseline-arm64-baylibre 2026-03-07 05:15:08,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a91155911a9cbe7f7803c9 2026-03-07 05:15:08,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:15:08,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a91155911a9cbe7f7803c9 HTTP/1.1" 200 None 2026-03-07 05:15:08,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:15:08,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:15:08,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:15:08,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a91155911a9cbe7f7803c9 HTTP/1.1" 200 None 2026-03-07 05:15:08,879 - lava_callback - ERROR - Error processing callback for node 69a91155911a9cbe7f7803c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47768 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:16:28,771 - lava_callback - INFO - Received callback for node 69a911ab911a9cbe7f780400 INFO: 172.20.0.1:47782 - "POST /node/69a911ab911a9cbe7f780400 HTTP/1.0" 202 Accepted 2026-03-07 05:16:28,776 - lava_callback - INFO - Starting async job submit for node 69a911ab911a9cbe7f780400 2026-03-07 05:16:28,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:16:28,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a911ab911a9cbe7f780400 HTTP/1.1" 200 None 2026-03-07 05:16:28,792 - lava_callback - DEBUG - Processing node 69a911ab911a9cbe7f780400: baseline-arm64-baylibre 2026-03-07 05:16:28,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a911ab911a9cbe7f780400 2026-03-07 05:16:28,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:16:28,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a911ab911a9cbe7f780400 HTTP/1.1" 200 None 2026-03-07 05:16:28,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:16:28,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:16:28,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:16:28,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a911ab911a9cbe7f780400 HTTP/1.1" 200 None 2026-03-07 05:16:28,845 - lava_callback - ERROR - Error processing callback for node 69a911ab911a9cbe7f780400: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60802 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:18:08,881 - lava_callback - INFO - Received callback for node 69a91202911a9cbe7f78042f INFO: 172.20.0.1:60818 - "POST /node/69a91202911a9cbe7f78042f HTTP/1.0" 202 Accepted 2026-03-07 05:18:08,887 - lava_callback - INFO - Starting async job submit for node 69a91202911a9cbe7f78042f 2026-03-07 05:18:08,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:18:08,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a91202911a9cbe7f78042f HTTP/1.1" 200 None 2026-03-07 05:18:08,912 - lava_callback - DEBUG - Processing node 69a91202911a9cbe7f78042f: baseline-arm64-baylibre 2026-03-07 05:18:08,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a91202911a9cbe7f78042f 2026-03-07 05:18:08,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:18:08,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a91202911a9cbe7f78042f HTTP/1.1" 200 None 2026-03-07 05:18:08,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:18:08,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:18:08,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:18:08,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a91202911a9cbe7f78042f HTTP/1.1" 200 None 2026-03-07 05:18:08,987 - lava_callback - ERROR - Error processing callback for node 69a91202911a9cbe7f78042f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60526 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:18:44,778 - lava_callback - INFO - Received callback for node 69ab8149efa461f55e59dd47 INFO: 172.20.0.1:43134 - "POST /node/69ab8149efa461f55e59dd47 HTTP/1.0" 202 Accepted 2026-03-07 05:18:44,784 - lava_callback - INFO - Starting async job submit for node 69ab8149efa461f55e59dd47 2026-03-07 05:18:44,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:18:44,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8149efa461f55e59dd47 HTTP/1.1" 200 None 2026-03-07 05:18:44,831 - lava_callback - DEBUG - Processing node 69ab8149efa461f55e59dd47: baseline-x86 2026-03-07 05:18:45,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:18:45,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:18:45,238 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab8149efa461f55e59dd47/log.txt.gz 2026-03-07 05:18:45,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:18:45,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:18:45,667 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab8149efa461f55e59dd47/lava-logs.yaml 2026-03-07 05:18:45,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:18:45,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:18:45,842 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab8149efa461f55e59dd47/lava_callback.json.gz DEBUG: Setup failed for 69ab8149efa461f55e59dd47. Transitting job node result: incomplete -> fail 2026-03-07 05:18:45,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:18:45,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8149efa461f55e59dd47 HTTP/1.1" 200 None 2026-03-07 05:18:45,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:18:45,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85b19440c1da21c23722a HTTP/1.1" 200 None 2026-03-07 05:18:45,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:18:45,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8149efa461f55e59dd47 HTTP/1.1" 200 None 2026-03-07 05:18:46,046 - lava_callback - INFO - Completed processing callback for node 69ab8149efa461f55e59dd47 INFO: 172.20.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36908 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:19:13,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:19:14,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53258 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:20:29,032 - lava_callback - INFO - Received callback for node 69a9129a911a9cbe7f78047c INFO: 172.20.0.1:53262 - "POST /node/69a9129a911a9cbe7f78047c HTTP/1.0" 202 Accepted 2026-03-07 05:20:29,038 - lava_callback - INFO - Starting async job submit for node 69a9129a911a9cbe7f78047c 2026-03-07 05:20:29,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:20:29,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9129a911a9cbe7f78047c HTTP/1.1" 200 None 2026-03-07 05:20:29,063 - lava_callback - DEBUG - Processing node 69a9129a911a9cbe7f78047c: baseline-arm64-baylibre 2026-03-07 05:20:29,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9129a911a9cbe7f78047c 2026-03-07 05:20:29,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:20:29,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9129a911a9cbe7f78047c HTTP/1.1" 200 None 2026-03-07 05:20:29,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:20:29,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:20:29,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:20:29,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9129a911a9cbe7f78047c HTTP/1.1" 200 None 2026-03-07 05:20:29,115 - lava_callback - ERROR - Error processing callback for node 69a9129a911a9cbe7f78047c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33980 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:22:09,106 - lava_callback - INFO - Received callback for node 69a912ed911a9cbe7f7804bf INFO: 172.20.0.1:33986 - "POST /node/69a912ed911a9cbe7f7804bf HTTP/1.0" 202 Accepted 2026-03-07 05:22:09,112 - lava_callback - INFO - Starting async job submit for node 69a912ed911a9cbe7f7804bf 2026-03-07 05:22:09,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:22:09,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a912ed911a9cbe7f7804bf HTTP/1.1" 200 None 2026-03-07 05:22:09,128 - lava_callback - DEBUG - Processing node 69a912ed911a9cbe7f7804bf: baseline-arm64-baylibre 2026-03-07 05:22:09,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a912ed911a9cbe7f7804bf 2026-03-07 05:22:09,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:22:09,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a912ed911a9cbe7f7804bf HTTP/1.1" 200 None 2026-03-07 05:22:09,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:22:09,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:22:09,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:22:09,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a912ed911a9cbe7f7804bf HTTP/1.1" 200 None 2026-03-07 05:22:09,194 - lava_callback - ERROR - Error processing callback for node 69a912ed911a9cbe7f7804bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36612 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:23:29,198 - lava_callback - INFO - Received callback for node 69a91345911a9cbe7f7804fd INFO: 172.20.0.1:36620 - "POST /node/69a91345911a9cbe7f7804fd HTTP/1.0" 202 Accepted 2026-03-07 05:23:29,204 - lava_callback - INFO - Starting async job submit for node 69a91345911a9cbe7f7804fd 2026-03-07 05:23:29,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:23:29,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a91345911a9cbe7f7804fd HTTP/1.1" 200 None 2026-03-07 05:23:29,226 - lava_callback - DEBUG - Processing node 69a91345911a9cbe7f7804fd: baseline-arm64-baylibre 2026-03-07 05:23:29,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a91345911a9cbe7f7804fd 2026-03-07 05:23:29,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:23:29,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a91345911a9cbe7f7804fd HTTP/1.1" 200 None 2026-03-07 05:23:29,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:23:29,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:23:29,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:23:29,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a91345911a9cbe7f7804fd HTTP/1.1" 200 None 2026-03-07 05:23:29,285 - lava_callback - ERROR - Error processing callback for node 69a91345911a9cbe7f7804fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41870 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:23:46,311 - lava_callback - INFO - Received callback for node 69ab8624efa461f55e59df66 INFO: 172.20.0.1:38366 - "POST /node/69ab8624efa461f55e59df66 HTTP/1.0" 202 Accepted 2026-03-07 05:23:46,321 - lava_callback - INFO - Starting async job submit for node 69ab8624efa461f55e59df66 2026-03-07 05:23:46,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:23:46,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8624efa461f55e59df66 HTTP/1.1" 200 None 2026-03-07 05:23:46,397 - lava_callback - DEBUG - Processing node 69ab8624efa461f55e59df66: baseline-x86 INFO: 172.20.0.1:38376 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:23:46,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:23:46,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:23:46,825 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab8624efa461f55e59df66/log.txt.gz 2026-03-07 05:23:46,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:23:47,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:23:47,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab8624efa461f55e59df66/lava-logs.yaml 2026-03-07 05:23:47,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:23:47,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:23:47,318 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab8624efa461f55e59df66/lava_callback.json.gz DEBUG: Setup failed for 69ab8624efa461f55e59df66. Transitting job node result: incomplete -> fail 2026-03-07 05:23:47,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:23:47,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8624efa461f55e59df66 HTTP/1.1" 200 None 2026-03-07 05:23:47,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:23:47,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85b19440c1da21c23722a HTTP/1.1" 200 None 2026-03-07 05:23:47,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:23:47,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8624efa461f55e59df66 HTTP/1.1" 200 None 2026-03-07 05:23:47,535 - lava_callback - INFO - Completed processing callback for node 69ab8624efa461f55e59df66 INFO: 172.20.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51232 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:24:14,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:24:14,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58710 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:24:49,238 - lava_callback - INFO - Received callback for node 69a9139a911a9cbe7f780546 INFO: 172.20.0.1:58724 - "POST /node/69a9139a911a9cbe7f780546 HTTP/1.0" 202 Accepted 2026-03-07 05:24:49,245 - lava_callback - INFO - Starting async job submit for node 69a9139a911a9cbe7f780546 2026-03-07 05:24:49,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:24:49,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9139a911a9cbe7f780546 HTTP/1.1" 200 None 2026-03-07 05:24:49,263 - lava_callback - DEBUG - Processing node 69a9139a911a9cbe7f780546: baseline-arm64-baylibre 2026-03-07 05:24:49,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9139a911a9cbe7f780546 2026-03-07 05:24:49,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:24:49,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9139a911a9cbe7f780546 HTTP/1.1" 200 None 2026-03-07 05:24:49,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:24:49,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:24:49,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:24:49,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9139a911a9cbe7f780546 HTTP/1.1" 200 None 2026-03-07 05:24:49,388 - lava_callback - ERROR - Error processing callback for node 69a9139a911a9cbe7f780546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47816 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:26:29,343 - lava_callback - INFO - Received callback for node 69a913f2911a9cbe7f78058e INFO: 172.20.0.1:47818 - "POST /node/69a913f2911a9cbe7f78058e HTTP/1.0" 202 Accepted 2026-03-07 05:26:29,348 - lava_callback - INFO - Starting async job submit for node 69a913f2911a9cbe7f78058e 2026-03-07 05:26:29,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:26:29,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a913f2911a9cbe7f78058e HTTP/1.1" 200 None 2026-03-07 05:26:29,364 - lava_callback - DEBUG - Processing node 69a913f2911a9cbe7f78058e: baseline-arm64-baylibre 2026-03-07 05:26:29,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a913f2911a9cbe7f78058e 2026-03-07 05:26:29,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:26:29,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a913f2911a9cbe7f78058e HTTP/1.1" 200 None 2026-03-07 05:26:29,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:26:29,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:26:29,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:26:29,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a913f2911a9cbe7f78058e HTTP/1.1" 200 None 2026-03-07 05:26:29,433 - lava_callback - ERROR - Error processing callback for node 69a913f2911a9cbe7f78058e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35414 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:27:49,346 - lava_callback - INFO - Received callback for node 69a91445911a9cbe7f7805c7 INFO: 172.20.0.1:35426 - "POST /node/69a91445911a9cbe7f7805c7 HTTP/1.0" 202 Accepted 2026-03-07 05:27:49,352 - lava_callback - INFO - Starting async job submit for node 69a91445911a9cbe7f7805c7 2026-03-07 05:27:49,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:27:49,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a91445911a9cbe7f7805c7 HTTP/1.1" 200 None 2026-03-07 05:27:49,369 - lava_callback - DEBUG - Processing node 69a91445911a9cbe7f7805c7: baseline-arm64-baylibre 2026-03-07 05:27:49,369 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a91445911a9cbe7f7805c7 2026-03-07 05:27:49,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:27:49,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a91445911a9cbe7f7805c7 HTTP/1.1" 200 None 2026-03-07 05:27:49,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:27:49,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:27:49,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:27:49,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a91445911a9cbe7f7805c7 HTTP/1.1" 200 None 2026-03-07 05:27:49,430 - lava_callback - ERROR - Error processing callback for node 69a91445911a9cbe7f7805c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53146 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:29:09,439 - lava_callback - INFO - Received callback for node 69a9149c911a9cbe7f780610 INFO: 172.20.0.1:53160 - "POST /node/69a9149c911a9cbe7f780610 HTTP/1.0" 202 Accepted 2026-03-07 05:29:09,444 - lava_callback - INFO - Starting async job submit for node 69a9149c911a9cbe7f780610 2026-03-07 05:29:09,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:29:09,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9149c911a9cbe7f780610 HTTP/1.1" 200 None 2026-03-07 05:29:09,461 - lava_callback - DEBUG - Processing node 69a9149c911a9cbe7f780610: baseline-arm64-baylibre 2026-03-07 05:29:09,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9149c911a9cbe7f780610 2026-03-07 05:29:09,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:29:09,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9149c911a9cbe7f780610 HTTP/1.1" 200 None 2026-03-07 05:29:09,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:29:09,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:29:09,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:29:09,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9149c911a9cbe7f780610 HTTP/1.1" 200 None 2026-03-07 05:29:09,541 - lava_callback - ERROR - Error processing callback for node 69a9149c911a9cbe7f780610: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51078 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:30:29,516 - lava_callback - INFO - Received callback for node 69a914f2911a9cbe7f780652 INFO: 172.20.0.1:51086 - "POST /node/69a914f2911a9cbe7f780652 HTTP/1.0" 202 Accepted 2026-03-07 05:30:29,521 - lava_callback - INFO - Starting async job submit for node 69a914f2911a9cbe7f780652 2026-03-07 05:30:29,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:30:29,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a914f2911a9cbe7f780652 HTTP/1.1" 200 None 2026-03-07 05:30:29,566 - lava_callback - DEBUG - Processing node 69a914f2911a9cbe7f780652: baseline-arm64-baylibre 2026-03-07 05:30:29,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a914f2911a9cbe7f780652 2026-03-07 05:30:29,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:30:29,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a914f2911a9cbe7f780652 HTTP/1.1" 200 None 2026-03-07 05:30:29,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:30:29,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:30:29,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:30:29,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a914f2911a9cbe7f780652 HTTP/1.1" 200 None 2026-03-07 05:30:29,662 - lava_callback - ERROR - Error processing callback for node 69a914f2911a9cbe7f780652: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42586 - "GET /%5D HTTP/1.0" 404 Not Found INFO: 172.20.0.1:42590 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:32:09,669 - lava_callback - INFO - Received callback for node 69a91548911a9cbe7f780693 INFO: 172.20.0.1:42594 - "POST /node/69a91548911a9cbe7f780693 HTTP/1.0" 202 Accepted 2026-03-07 05:32:09,675 - lava_callback - INFO - Starting async job submit for node 69a91548911a9cbe7f780693 2026-03-07 05:32:09,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:32:09,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a91548911a9cbe7f780693 HTTP/1.1" 200 None 2026-03-07 05:32:09,698 - lava_callback - DEBUG - Processing node 69a91548911a9cbe7f780693: baseline-arm64-baylibre 2026-03-07 05:32:09,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a91548911a9cbe7f780693 2026-03-07 05:32:09,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:32:09,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a91548911a9cbe7f780693 HTTP/1.1" 200 None 2026-03-07 05:32:09,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:32:09,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:32:09,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:32:09,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a91548911a9cbe7f780693 HTTP/1.1" 200 None 2026-03-07 05:32:09,758 - lava_callback - ERROR - Error processing callback for node 69a91548911a9cbe7f780693: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42540 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:37:49,912 - lava_callback - INFO - Received callback for node 69ab8ccdefa461f55e59e1b9 INFO: 172.20.0.1:37324 - "POST /node/69ab8ccdefa461f55e59e1b9 HTTP/1.0" 202 Accepted 2026-03-07 05:37:49,918 - lava_callback - INFO - Starting async job submit for node 69ab8ccdefa461f55e59e1b9 2026-03-07 05:37:49,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:37:49,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8ccdefa461f55e59e1b9 HTTP/1.1" 200 None 2026-03-07 05:37:49,968 - lava_callback - DEBUG - Processing node 69ab8ccdefa461f55e59e1b9: baseline-x86 2026-03-07 05:37:50,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:37:50,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:37:50,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab8ccdefa461f55e59e1b9/log.txt.gz 2026-03-07 05:37:50,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:37:50,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:37:50,770 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab8ccdefa461f55e59e1b9/lava-logs.yaml 2026-03-07 05:37:50,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:37:51,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:37:51,059 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab8ccdefa461f55e59e1b9/lava_callback.json.gz DEBUG: Setup failed for 69ab8ccdefa461f55e59e1b9. Transitting job node result: incomplete -> fail 2026-03-07 05:37:51,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:37:51,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab8ccdefa461f55e59e1b9 HTTP/1.1" 200 None 2026-03-07 05:37:51,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:37:51,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a697103d518458fb33ea36 HTTP/1.1" 200 None 2026-03-07 05:37:51,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:37:51,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab8ccdefa461f55e59e1b9 HTTP/1.1" 200 None 2026-03-07 05:37:51,270 - lava_callback - INFO - Completed processing callback for node 69ab8ccdefa461f55e59e1b9 INFO: 172.20.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46418 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:38:14,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:38:14,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35504 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:39:05,493 - lava_callback - INFO - Received callback for node 69ab91adefa461f55e59e326 INFO: 172.20.0.1:35520 - "POST /node/69ab91adefa461f55e59e326 HTTP/1.0" 202 Accepted 2026-03-07 05:39:05,499 - lava_callback - INFO - Starting async job submit for node 69ab91adefa461f55e59e326 2026-03-07 05:39:05,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:39:05,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab91adefa461f55e59e326 HTTP/1.1" 200 None 2026-03-07 05:39:05,546 - lava_callback - DEBUG - Processing node 69ab91adefa461f55e59e326: baseline-x86 2026-03-07 05:39:05,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:39:05,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:39:05,986 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ab91adefa461f55e59e326/log.txt.gz 2026-03-07 05:39:06,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:39:06,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:39:06,342 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ab91adefa461f55e59e326/lava-logs.yaml 2026-03-07 05:39:06,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 05:39:06,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 05:39:06,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ab91adefa461f55e59e326/lava_callback.json.gz INFO: 172.20.0.1:35526 - "GET / HTTP/1.0" 200 OK DEBUG: Setup failed for 69ab91adefa461f55e59e326. Transitting job node result: incomplete -> fail 2026-03-07 05:39:06,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:39:06,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab91adefa461f55e59e326 HTTP/1.1" 200 None 2026-03-07 05:39:06,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:39:06,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9ad129c5f93e4f05eb2eb HTTP/1.1" 200 None 2026-03-07 05:39:06,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:39:06,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ab91adefa461f55e59e326 HTTP/1.1" 200 None 2026-03-07 05:39:06,724 - lava_callback - INFO - Completed processing callback for node 69ab91adefa461f55e59e326 2026-03-07 05:39:14,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:39:14,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35336 - "GET / HTTP/1.0" 200 OK 2026-03-07 05:42:50,285 - lava_callback - INFO - Received callback for node 69a917d7911a9cbe7f78084a INFO: 172.20.0.1:56312 - "POST /node/69a917d7911a9cbe7f78084a HTTP/1.0" 202 Accepted 2026-03-07 05:42:50,291 - lava_callback - INFO - Starting async job submit for node 69a917d7911a9cbe7f78084a 2026-03-07 05:42:50,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:42:50,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a917d7911a9cbe7f78084a HTTP/1.1" 200 None 2026-03-07 05:42:50,308 - lava_callback - DEBUG - Processing node 69a917d7911a9cbe7f78084a: baseline-arm64-baylibre 2026-03-07 05:42:50,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a917d7911a9cbe7f78084a 2026-03-07 05:42:50,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:42:50,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a917d7911a9cbe7f78084a HTTP/1.1" 200 None 2026-03-07 05:42:50,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:42:50,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5b8bb00e9e7049205c4ae HTTP/1.1" 200 None 2026-03-07 05:42:50,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 05:42:50,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a917d7911a9cbe7f78084a HTTP/1.1" 200 None 2026-03-07 05:42:50,367 - lava_callback - ERROR - Error processing callback for node 69a917d7911a9cbe7f78084a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38780 - "GET / HTTP/1.0" 200 OK 2026-03-07 06:41:53,479 - lava_callback - INFO - Received callback for node 69a925a4911a9cbe7f780be8 INFO: 172.20.0.1:41384 - "POST /node/69a925a4911a9cbe7f780be8 HTTP/1.0" 202 Accepted 2026-03-07 06:41:53,485 - lava_callback - INFO - Starting async job submit for node 69a925a4911a9cbe7f780be8 2026-03-07 06:41:53,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:41:53,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a925a4911a9cbe7f780be8 HTTP/1.1" 200 None 2026-03-07 06:41:53,500 - lava_callback - DEBUG - Processing node 69a925a4911a9cbe7f780be8: baseline-arm-baylibre 2026-03-07 06:41:53,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a925a4911a9cbe7f780be8 2026-03-07 06:41:53,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:41:53,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a925a4911a9cbe7f780be8 HTTP/1.1" 200 None 2026-03-07 06:41:53,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:41:53,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 06:41:53,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:41:53,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a925a4911a9cbe7f780be8 HTTP/1.1" 200 None 2026-03-07 06:41:53,560 - lava_callback - ERROR - Error processing callback for node 69a925a4911a9cbe7f780be8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49146 - "GET / HTTP/1.0" 200 OK 2026-03-07 06:42:33,491 - lava_callback - INFO - Received callback for node 69a925d1911a9cbe7f780c18 INFO: 172.20.0.1:34728 - "POST /node/69a925d1911a9cbe7f780c18 HTTP/1.0" 202 Accepted 2026-03-07 06:42:33,497 - lava_callback - INFO - Starting async job submit for node 69a925d1911a9cbe7f780c18 2026-03-07 06:42:33,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:42:33,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a925d1911a9cbe7f780c18 HTTP/1.1" 200 None 2026-03-07 06:42:33,514 - lava_callback - DEBUG - Processing node 69a925d1911a9cbe7f780c18: baseline-arm-baylibre 2026-03-07 06:42:33,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a925d1911a9cbe7f780c18 2026-03-07 06:42:33,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:42:33,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a925d1911a9cbe7f780c18 HTTP/1.1" 200 None 2026-03-07 06:42:33,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:42:33,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 06:42:33,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:42:33,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a925d1911a9cbe7f780c18 HTTP/1.1" 200 None 2026-03-07 06:42:33,581 - lava_callback - ERROR - Error processing callback for node 69a925d1911a9cbe7f780c18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42958 - "GET / HTTP/1.0" 200 OK 2026-03-07 06:43:13,636 - lava_callback - INFO - Received callback for node 69a925fd911a9cbe7f780c75 INFO: 172.20.0.1:53440 - "POST /node/69a925fd911a9cbe7f780c75 HTTP/1.0" 202 Accepted 2026-03-07 06:43:13,641 - lava_callback - INFO - Starting async job submit for node 69a925fd911a9cbe7f780c75 2026-03-07 06:43:13,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:43:13,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a925fd911a9cbe7f780c75 HTTP/1.1" 200 None 2026-03-07 06:43:13,657 - lava_callback - DEBUG - Processing node 69a925fd911a9cbe7f780c75: baseline-arm-baylibre 2026-03-07 06:43:13,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a925fd911a9cbe7f780c75 2026-03-07 06:43:13,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:43:13,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a925fd911a9cbe7f780c75 HTTP/1.1" 200 None 2026-03-07 06:43:13,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:43:13,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 06:43:13,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:43:13,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a925fd911a9cbe7f780c75 HTTP/1.1" 200 None 2026-03-07 06:43:13,714 - lava_callback - ERROR - Error processing callback for node 69a925fd911a9cbe7f780c75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48112 - "GET / HTTP/1.0" 200 OK 2026-03-07 06:44:53,651 - lava_callback - INFO - Received callback for node 69a92657911a9cbe7f780cfb INFO: 172.20.0.1:60378 - "POST /node/69a92657911a9cbe7f780cfb HTTP/1.0" 202 Accepted 2026-03-07 06:44:53,656 - lava_callback - INFO - Starting async job submit for node 69a92657911a9cbe7f780cfb 2026-03-07 06:44:53,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:44:53,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92657911a9cbe7f780cfb HTTP/1.1" 200 None 2026-03-07 06:44:53,676 - lava_callback - DEBUG - Processing node 69a92657911a9cbe7f780cfb: baseline-arm-baylibre 2026-03-07 06:44:53,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a92657911a9cbe7f780cfb 2026-03-07 06:44:53,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:44:53,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92657911a9cbe7f780cfb HTTP/1.1" 200 None 2026-03-07 06:44:53,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:44:53,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 06:44:53,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:44:53,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a92657911a9cbe7f780cfb HTTP/1.1" 200 None 2026-03-07 06:44:53,729 - lava_callback - ERROR - Error processing callback for node 69a92657911a9cbe7f780cfb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40360 - "GET / HTTP/1.0" 200 OK 2026-03-07 06:46:13,707 - lava_callback - INFO - Received callback for node 69a926b2911a9cbe7f780d75 INFO: 172.20.0.1:49856 - "POST /node/69a926b2911a9cbe7f780d75 HTTP/1.0" 202 Accepted 2026-03-07 06:46:13,713 - lava_callback - INFO - Starting async job submit for node 69a926b2911a9cbe7f780d75 2026-03-07 06:46:13,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:46:13,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a926b2911a9cbe7f780d75 HTTP/1.1" 200 None 2026-03-07 06:46:13,734 - lava_callback - DEBUG - Processing node 69a926b2911a9cbe7f780d75: baseline-arm-baylibre 2026-03-07 06:46:13,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a926b2911a9cbe7f780d75 2026-03-07 06:46:13,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:46:13,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a926b2911a9cbe7f780d75 HTTP/1.1" 200 None 2026-03-07 06:46:13,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:46:13,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 06:46:13,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:46:13,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a926b2911a9cbe7f780d75 HTTP/1.1" 200 None 2026-03-07 06:46:13,792 - lava_callback - ERROR - Error processing callback for node 69a926b2911a9cbe7f780d75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44040 - "GET / HTTP/1.0" 200 OK 2026-03-07 06:47:13,895 - lava_callback - INFO - Received callback for node 69a926e0911a9cbe7f780d9e INFO: 172.20.0.1:44288 - "POST /node/69a926e0911a9cbe7f780d9e HTTP/1.0" 202 Accepted 2026-03-07 06:47:13,900 - lava_callback - INFO - Starting async job submit for node 69a926e0911a9cbe7f780d9e 2026-03-07 06:47:13,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:47:13,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a926e0911a9cbe7f780d9e HTTP/1.1" 200 None 2026-03-07 06:47:13,919 - lava_callback - DEBUG - Processing node 69a926e0911a9cbe7f780d9e: baseline-arm-baylibre 2026-03-07 06:47:13,920 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a926e0911a9cbe7f780d9e 2026-03-07 06:47:13,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:47:13,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a926e0911a9cbe7f780d9e HTTP/1.1" 200 None 2026-03-07 06:47:13,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:47:13,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 06:47:13,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:47:13,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a926e0911a9cbe7f780d9e HTTP/1.1" 200 None 2026-03-07 06:47:13,975 - lava_callback - ERROR - Error processing callback for node 69a926e0911a9cbe7f780d9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38510 - "GET / HTTP/1.0" 200 OK 2026-03-07 06:49:53,924 - lava_callback - INFO - Received callback for node 69a92783911a9cbe7f780e72 INFO: 172.20.0.1:41172 - "POST /node/69a92783911a9cbe7f780e72 HTTP/1.0" 202 Accepted 2026-03-07 06:49:53,930 - lava_callback - INFO - Starting async job submit for node 69a92783911a9cbe7f780e72 2026-03-07 06:49:53,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:49:53,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92783911a9cbe7f780e72 HTTP/1.1" 200 None 2026-03-07 06:49:53,946 - lava_callback - DEBUG - Processing node 69a92783911a9cbe7f780e72: baseline-arm-baylibre 2026-03-07 06:49:53,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a92783911a9cbe7f780e72 2026-03-07 06:49:53,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:49:53,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92783911a9cbe7f780e72 HTTP/1.1" 200 None 2026-03-07 06:49:53,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:49:53,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 06:49:53,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:49:54,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a92783911a9cbe7f780e72 HTTP/1.1" 200 None 2026-03-07 06:49:54,002 - lava_callback - ERROR - Error processing callback for node 69a92783911a9cbe7f780e72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45014 - "GET / HTTP/1.0" 200 OK 2026-03-07 06:50:53,914 - lava_callback - INFO - Received callback for node 69a927c0911a9cbe7f780ec0 INFO: 172.20.0.1:35572 - "POST /node/69a927c0911a9cbe7f780ec0 HTTP/1.0" 202 Accepted 2026-03-07 06:50:53,919 - lava_callback - INFO - Starting async job submit for node 69a927c0911a9cbe7f780ec0 2026-03-07 06:50:53,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:50:53,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a927c0911a9cbe7f780ec0 HTTP/1.1" 200 None 2026-03-07 06:50:53,935 - lava_callback - DEBUG - Processing node 69a927c0911a9cbe7f780ec0: baseline-arm-baylibre 2026-03-07 06:50:53,935 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a927c0911a9cbe7f780ec0 2026-03-07 06:50:53,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:50:53,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a927c0911a9cbe7f780ec0 HTTP/1.1" 200 None 2026-03-07 06:50:53,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:50:53,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 06:50:53,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:50:53,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a927c0911a9cbe7f780ec0 HTTP/1.1" 200 None 2026-03-07 06:50:53,989 - lava_callback - ERROR - Error processing callback for node 69a927c0911a9cbe7f780ec0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51494 - "GET / HTTP/1.0" 200 OK 2026-03-07 06:54:14,136 - lava_callback - INFO - Received callback for node 69a92893911a9cbe7f780f3e INFO: 172.20.0.1:54326 - "POST /node/69a92893911a9cbe7f780f3e HTTP/1.0" 202 Accepted 2026-03-07 06:54:14,143 - lava_callback - INFO - Starting async job submit for node 69a92893911a9cbe7f780f3e 2026-03-07 06:54:14,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:54:14,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92893911a9cbe7f780f3e HTTP/1.1" 200 None 2026-03-07 06:54:14,163 - lava_callback - DEBUG - Processing node 69a92893911a9cbe7f780f3e: baseline-arm-baylibre 2026-03-07 06:54:14,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a92893911a9cbe7f780f3e 2026-03-07 06:54:14,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:54:14,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92893911a9cbe7f780f3e HTTP/1.1" 200 None 2026-03-07 06:54:14,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:54:14,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 06:54:14,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:54:14,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a92893911a9cbe7f780f3e HTTP/1.1" 200 None 2026-03-07 06:54:14,232 - lava_callback - ERROR - Error processing callback for node 69a92893911a9cbe7f780f3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33622 - "GET / HTTP/1.0" 200 OK 2026-03-07 06:57:34,414 - lava_callback - INFO - Received callback for node 69a9295b911a9cbe7f780ffb INFO: 172.20.0.1:40296 - "POST /node/69a9295b911a9cbe7f780ffb HTTP/1.0" 202 Accepted 2026-03-07 06:57:34,420 - lava_callback - INFO - Starting async job submit for node 69a9295b911a9cbe7f780ffb 2026-03-07 06:57:34,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:57:34,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9295b911a9cbe7f780ffb HTTP/1.1" 200 None 2026-03-07 06:57:34,439 - lava_callback - DEBUG - Processing node 69a9295b911a9cbe7f780ffb: baseline-arm-baylibre 2026-03-07 06:57:34,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9295b911a9cbe7f780ffb 2026-03-07 06:57:34,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:57:34,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9295b911a9cbe7f780ffb HTTP/1.1" 200 None 2026-03-07 06:57:34,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:57:34,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 06:57:34,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:57:34,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9295b911a9cbe7f780ffb HTTP/1.1" 200 None 2026-03-07 06:57:34,505 - lava_callback - ERROR - Error processing callback for node 69a9295b911a9cbe7f780ffb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54160 - "GET / HTTP/1.0" 200 OK 2026-03-07 06:59:14,586 - lava_callback - INFO - Received callback for node 69a929b5911a9cbe7f781088 INFO: 172.20.0.1:34342 - "POST /node/69a929b5911a9cbe7f781088 HTTP/1.0" 202 Accepted 2026-03-07 06:59:14,591 - lava_callback - INFO - Starting async job submit for node 69a929b5911a9cbe7f781088 2026-03-07 06:59:14,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:59:14,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a929b5911a9cbe7f781088 HTTP/1.1" 200 None 2026-03-07 06:59:14,618 - lava_callback - DEBUG - Processing node 69a929b5911a9cbe7f781088: baseline-arm-baylibre 2026-03-07 06:59:14,618 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a929b5911a9cbe7f781088 2026-03-07 06:59:14,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:59:14,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a929b5911a9cbe7f781088 HTTP/1.1" 200 None 2026-03-07 06:59:14,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:59:14,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 06:59:14,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 06:59:14,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a929b5911a9cbe7f781088 HTTP/1.1" 200 None 2026-03-07 06:59:14,708 - lava_callback - ERROR - Error processing callback for node 69a929b5911a9cbe7f781088: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51164 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:00:34,548 - lava_callback - INFO - Received callback for node 69a92a10911a9cbe7f781103 INFO: 172.20.0.1:59520 - "POST /node/69a92a10911a9cbe7f781103 HTTP/1.0" 202 Accepted 2026-03-07 07:00:34,553 - lava_callback - INFO - Starting async job submit for node 69a92a10911a9cbe7f781103 2026-03-07 07:00:34,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:00:34,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92a10911a9cbe7f781103 HTTP/1.1" 200 None 2026-03-07 07:00:34,589 - lava_callback - DEBUG - Processing node 69a92a10911a9cbe7f781103: baseline-arm-baylibre 2026-03-07 07:00:34,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a92a10911a9cbe7f781103 2026-03-07 07:00:34,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:00:34,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92a10911a9cbe7f781103 HTTP/1.1" 200 None 2026-03-07 07:00:34,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:00:34,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385666346680f7a28dbcc HTTP/1.1" 200 None 2026-03-07 07:00:34,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:00:34,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a92a10911a9cbe7f781103 HTTP/1.1" 200 None 2026-03-07 07:00:34,646 - lava_callback - ERROR - Error processing callback for node 69a92a10911a9cbe7f781103: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38760 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:07:34,919 - lava_callback - INFO - Received callback for node 69a92ba4911a9cbe7f7812f9 INFO: 172.20.0.1:36468 - "POST /node/69a92ba4911a9cbe7f7812f9 HTTP/1.0" 202 Accepted 2026-03-07 07:07:34,924 - lava_callback - INFO - Starting async job submit for node 69a92ba4911a9cbe7f7812f9 2026-03-07 07:07:34,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:07:34,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92ba4911a9cbe7f7812f9 HTTP/1.1" 200 None 2026-03-07 07:07:34,940 - lava_callback - DEBUG - Processing node 69a92ba4911a9cbe7f7812f9: baseline-arm64-baylibre 2026-03-07 07:07:34,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a92ba4911a9cbe7f7812f9 2026-03-07 07:07:34,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:07:34,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92ba4911a9cbe7f7812f9 HTTP/1.1" 200 None 2026-03-07 07:07:34,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:07:34,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-07 07:07:34,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:07:34,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a92ba4911a9cbe7f7812f9 HTTP/1.1" 200 None 2026-03-07 07:07:35,029 - lava_callback - ERROR - Error processing callback for node 69a92ba4911a9cbe7f7812f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44466 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:13:09,089 - lava_callback - INFO - Received callback for node 69a92cf3911a9cbe7f7813c7 INFO: 172.20.0.1:44476 - "POST /node/69a92cf3911a9cbe7f7813c7 HTTP/1.0" 202 Accepted 2026-03-07 07:13:09,095 - lava_callback - INFO - Starting async job submit for node 69a92cf3911a9cbe7f7813c7 2026-03-07 07:13:09,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:13:09,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92cf3911a9cbe7f7813c7 HTTP/1.1" 200 None 2026-03-07 07:13:09,113 - lava_callback - DEBUG - Processing node 69a92cf3911a9cbe7f7813c7: baseline-arm64-clabbe 2026-03-07 07:13:09,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a92cf3911a9cbe7f7813c7 2026-03-07 07:13:09,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:13:09,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92cf3911a9cbe7f7813c7 HTTP/1.1" 200 None 2026-03-07 07:13:09,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:13:09,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-07 07:13:09,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:13:09,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a92cf3911a9cbe7f7813c7 HTTP/1.1" 200 None 2026-03-07 07:13:09,171 - lava_callback - ERROR - Error processing callback for node 69a92cf3911a9cbe7f7813c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35656 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:18:09,209 - lava_callback - INFO - Received callback for node 69a92e2b911a9cbe7f7814f6 INFO: 172.20.0.1:35670 - "POST /node/69a92e2b911a9cbe7f7814f6 HTTP/1.0" 202 Accepted 2026-03-07 07:18:09,215 - lava_callback - INFO - Starting async job submit for node 69a92e2b911a9cbe7f7814f6 2026-03-07 07:18:09,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:18:09,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92e2b911a9cbe7f7814f6 HTTP/1.1" 200 None 2026-03-07 07:18:09,231 - lava_callback - DEBUG - Processing node 69a92e2b911a9cbe7f7814f6: baseline-arm-clabbe 2026-03-07 07:18:09,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a92e2b911a9cbe7f7814f6 2026-03-07 07:18:09,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:18:09,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92e2b911a9cbe7f7814f6 HTTP/1.1" 200 None 2026-03-07 07:18:09,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:18:09,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-07 07:18:09,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:18:09,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a92e2b911a9cbe7f7814f6 HTTP/1.1" 200 None 2026-03-07 07:18:09,303 - lava_callback - ERROR - Error processing callback for node 69a92e2b911a9cbe7f7814f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52780 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:19:09,229 - lava_callback - INFO - Received callback for node 69a92e5a911a9cbe7f78153f INFO: 172.20.0.1:52788 - "POST /node/69a92e5a911a9cbe7f78153f HTTP/1.0" 202 Accepted 2026-03-07 07:19:09,235 - lava_callback - INFO - Starting async job submit for node 69a92e5a911a9cbe7f78153f 2026-03-07 07:19:09,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:19:09,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92e5a911a9cbe7f78153f HTTP/1.1" 200 None 2026-03-07 07:19:09,251 - lava_callback - DEBUG - Processing node 69a92e5a911a9cbe7f78153f: baseline-arm-clabbe 2026-03-07 07:19:09,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a92e5a911a9cbe7f78153f 2026-03-07 07:19:09,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:19:09,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a92e5a911a9cbe7f78153f HTTP/1.1" 200 None 2026-03-07 07:19:09,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:19:09,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-07 07:19:09,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:19:09,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a92e5a911a9cbe7f78153f HTTP/1.1" 200 None 2026-03-07 07:19:09,318 - lava_callback - ERROR - Error processing callback for node 69a92e5a911a9cbe7f78153f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57794 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 07:30:16,158 - lava_callback - INFO - Received callback for node 69a930f7911a9cbe7f78186b INFO: 172.20.0.1:57796 - "POST /node/69a930f7911a9cbe7f78186b HTTP/1.0" 202 Accepted 2026-03-07 07:30:16,164 - lava_callback - INFO - Starting async job submit for node 69a930f7911a9cbe7f78186b 2026-03-07 07:30:16,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:30:16,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a930f7911a9cbe7f78186b HTTP/1.1" 200 None 2026-03-07 07:30:16,182 - lava_callback - DEBUG - Processing node 69a930f7911a9cbe7f78186b: baseline-arm64-baylibre 2026-03-07 07:30:16,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a930f7911a9cbe7f78186b 2026-03-07 07:30:16,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:30:16,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a930f7911a9cbe7f78186b HTTP/1.1" 200 None 2026-03-07 07:30:16,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:30:16,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 07:30:16,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:30:16,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a930f7911a9cbe7f78186b HTTP/1.1" 200 None 2026-03-07 07:30:16,246 - lava_callback - ERROR - Error processing callback for node 69a930f7911a9cbe7f78186b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60066 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:31:36,208 - lava_callback - INFO - Received callback for node 69a93151911a9cbe7f7818a0 INFO: 172.20.0.1:48828 - "POST /node/69a93151911a9cbe7f7818a0 HTTP/1.0" 202 Accepted 2026-03-07 07:31:36,214 - lava_callback - INFO - Starting async job submit for node 69a93151911a9cbe7f7818a0 2026-03-07 07:31:36,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:31:36,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93151911a9cbe7f7818a0 HTTP/1.1" 200 None 2026-03-07 07:31:36,229 - lava_callback - DEBUG - Processing node 69a93151911a9cbe7f7818a0: baseline-arm64-baylibre 2026-03-07 07:31:36,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93151911a9cbe7f7818a0 2026-03-07 07:31:36,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:31:36,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93151911a9cbe7f7818a0 HTTP/1.1" 200 None 2026-03-07 07:31:36,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:31:36,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 07:31:36,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:31:36,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93151911a9cbe7f7818a0 HTTP/1.1" 200 None 2026-03-07 07:31:36,296 - lava_callback - ERROR - Error processing callback for node 69a93151911a9cbe7f7818a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37438 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:32:56,236 - lava_callback - INFO - Received callback for node 69a931a6911a9cbe7f7818d5 INFO: 172.20.0.1:47516 - "POST /node/69a931a6911a9cbe7f7818d5 HTTP/1.0" 202 Accepted 2026-03-07 07:32:56,243 - lava_callback - INFO - Starting async job submit for node 69a931a6911a9cbe7f7818d5 2026-03-07 07:32:56,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:32:56,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a931a6911a9cbe7f7818d5 HTTP/1.1" 200 None 2026-03-07 07:32:56,273 - lava_callback - DEBUG - Processing node 69a931a6911a9cbe7f7818d5: baseline-arm64-baylibre 2026-03-07 07:32:56,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a931a6911a9cbe7f7818d5 2026-03-07 07:32:56,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:32:56,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a931a6911a9cbe7f7818d5 HTTP/1.1" 200 None 2026-03-07 07:32:56,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:32:56,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 07:32:56,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:32:56,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a931a6911a9cbe7f7818d5 HTTP/1.1" 200 None 2026-03-07 07:32:56,329 - lava_callback - ERROR - Error processing callback for node 69a931a6911a9cbe7f7818d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52340 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:34:36,332 - lava_callback - INFO - Received callback for node 69a931fb911a9cbe7f781917 INFO: 172.20.0.1:60750 - "POST /node/69a931fb911a9cbe7f781917 HTTP/1.0" 202 Accepted 2026-03-07 07:34:36,338 - lava_callback - INFO - Starting async job submit for node 69a931fb911a9cbe7f781917 2026-03-07 07:34:36,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:34:36,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a931fb911a9cbe7f781917 HTTP/1.1" 200 None 2026-03-07 07:34:36,357 - lava_callback - DEBUG - Processing node 69a931fb911a9cbe7f781917: baseline-arm64-baylibre 2026-03-07 07:34:36,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a931fb911a9cbe7f781917 2026-03-07 07:34:36,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:34:36,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a931fb911a9cbe7f781917 HTTP/1.1" 200 None 2026-03-07 07:34:36,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:34:36,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 07:34:36,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:34:36,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a931fb911a9cbe7f781917 HTTP/1.1" 200 None 2026-03-07 07:34:36,425 - lava_callback - ERROR - Error processing callback for node 69a931fb911a9cbe7f781917: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43294 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:35:56,421 - lava_callback - INFO - Received callback for node 69a93252911a9cbe7f78195b INFO: 172.20.0.1:58810 - "POST /node/69a93252911a9cbe7f78195b HTTP/1.0" 202 Accepted 2026-03-07 07:35:56,427 - lava_callback - INFO - Starting async job submit for node 69a93252911a9cbe7f78195b 2026-03-07 07:35:56,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:35:56,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93252911a9cbe7f78195b HTTP/1.1" 200 None 2026-03-07 07:35:56,443 - lava_callback - DEBUG - Processing node 69a93252911a9cbe7f78195b: baseline-arm64-baylibre 2026-03-07 07:35:56,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93252911a9cbe7f78195b 2026-03-07 07:35:56,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:35:56,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93252911a9cbe7f78195b HTTP/1.1" 200 None 2026-03-07 07:35:56,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:35:56,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 07:35:56,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:35:56,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93252911a9cbe7f78195b HTTP/1.1" 200 None 2026-03-07 07:35:56,500 - lava_callback - ERROR - Error processing callback for node 69a93252911a9cbe7f78195b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40424 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 07:37:16,487 - lava_callback - INFO - Received callback for node 69a932a7911a9cbe7f781990 INFO: 172.20.0.1:40432 - "POST /node/69a932a7911a9cbe7f781990 HTTP/1.0" 202 Accepted 2026-03-07 07:37:16,495 - lava_callback - INFO - Starting async job submit for node 69a932a7911a9cbe7f781990 2026-03-07 07:37:16,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:37:16,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a932a7911a9cbe7f781990 HTTP/1.1" 200 None 2026-03-07 07:37:16,515 - lava_callback - DEBUG - Processing node 69a932a7911a9cbe7f781990: baseline-arm64-baylibre 2026-03-07 07:37:16,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a932a7911a9cbe7f781990 2026-03-07 07:37:16,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:40446 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:37:16,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a932a7911a9cbe7f781990 HTTP/1.1" 200 None 2026-03-07 07:37:16,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:37:16,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 07:37:16,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:37:16,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a932a7911a9cbe7f781990 HTTP/1.1" 200 None 2026-03-07 07:37:16,571 - lava_callback - ERROR - Error processing callback for node 69a932a7911a9cbe7f781990: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57932 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:38:56,522 - lava_callback - INFO - Received callback for node 69a932fb911a9cbe7f7819d6 INFO: 172.20.0.1:54040 - "POST /node/69a932fb911a9cbe7f7819d6 HTTP/1.0" 202 Accepted 2026-03-07 07:38:56,527 - lava_callback - INFO - Starting async job submit for node 69a932fb911a9cbe7f7819d6 2026-03-07 07:38:56,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:54054 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:38:56,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a932fb911a9cbe7f7819d6 HTTP/1.1" 200 None 2026-03-07 07:38:56,544 - lava_callback - DEBUG - Processing node 69a932fb911a9cbe7f7819d6: baseline-arm64-baylibre 2026-03-07 07:38:56,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a932fb911a9cbe7f7819d6 2026-03-07 07:38:56,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:38:56,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a932fb911a9cbe7f7819d6 HTTP/1.1" 200 None 2026-03-07 07:38:56,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:38:56,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 07:38:56,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:38:56,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a932fb911a9cbe7f7819d6 HTTP/1.1" 200 None 2026-03-07 07:38:56,601 - lava_callback - ERROR - Error processing callback for node 69a932fb911a9cbe7f7819d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40244 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:40:16,684 - lava_callback - INFO - Received callback for node 69a93354911a9cbe7f781a17 INFO: 172.20.0.1:40250 - "POST /node/69a93354911a9cbe7f781a17 HTTP/1.0" 202 Accepted 2026-03-07 07:40:16,689 - lava_callback - INFO - Starting async job submit for node 69a93354911a9cbe7f781a17 2026-03-07 07:40:16,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:40:16,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93354911a9cbe7f781a17 HTTP/1.1" 200 None 2026-03-07 07:40:16,723 - lava_callback - DEBUG - Processing node 69a93354911a9cbe7f781a17: baseline-arm64-baylibre 2026-03-07 07:40:16,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93354911a9cbe7f781a17 2026-03-07 07:40:16,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:40:16,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93354911a9cbe7f781a17 HTTP/1.1" 200 None 2026-03-07 07:40:16,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:40:16,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 07:40:16,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:40:16,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93354911a9cbe7f781a17 HTTP/1.1" 200 None 2026-03-07 07:40:16,843 - lava_callback - ERROR - Error processing callback for node 69a93354911a9cbe7f781a17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46688 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:41:56,756 - lava_callback - INFO - Received callback for node 69a933af911a9cbe7f781a60 INFO: 172.20.0.1:46698 - "POST /node/69a933af911a9cbe7f781a60 HTTP/1.0" 202 Accepted 2026-03-07 07:41:56,761 - lava_callback - INFO - Starting async job submit for node 69a933af911a9cbe7f781a60 2026-03-07 07:41:56,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:41:56,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a933af911a9cbe7f781a60 HTTP/1.1" 200 None 2026-03-07 07:41:56,788 - lava_callback - DEBUG - Processing node 69a933af911a9cbe7f781a60: baseline-arm64-baylibre 2026-03-07 07:41:56,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a933af911a9cbe7f781a60 2026-03-07 07:41:56,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:41:56,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a933af911a9cbe7f781a60 HTTP/1.1" 200 None 2026-03-07 07:41:56,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:41:56,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 07:41:56,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:41:56,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a933af911a9cbe7f781a60 HTTP/1.1" 200 None 2026-03-07 07:41:56,888 - lava_callback - ERROR - Error processing callback for node 69a933af911a9cbe7f781a60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51092 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:43:16,868 - lava_callback - INFO - Received callback for node 69a93401911a9cbe7f781aa4 INFO: 172.20.0.1:51104 - "POST /node/69a93401911a9cbe7f781aa4 HTTP/1.0" 202 Accepted 2026-03-07 07:43:16,874 - lava_callback - INFO - Starting async job submit for node 69a93401911a9cbe7f781aa4 2026-03-07 07:43:16,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:43:16,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93401911a9cbe7f781aa4 HTTP/1.1" 200 None 2026-03-07 07:43:16,890 - lava_callback - DEBUG - Processing node 69a93401911a9cbe7f781aa4: baseline-arm64-baylibre 2026-03-07 07:43:16,890 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93401911a9cbe7f781aa4 2026-03-07 07:43:16,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:43:16,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93401911a9cbe7f781aa4 HTTP/1.1" 200 None 2026-03-07 07:43:16,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:43:16,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 07:43:16,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:43:16,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93401911a9cbe7f781aa4 HTTP/1.1" 200 None 2026-03-07 07:43:16,963 - lava_callback - ERROR - Error processing callback for node 69a93401911a9cbe7f781aa4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:44:36,867 - lava_callback - INFO - Received callback for node 69a93457911a9cbe7f781aef INFO: 172.20.0.1:34364 - "POST /node/69a93457911a9cbe7f781aef HTTP/1.0" 202 Accepted 2026-03-07 07:44:36,873 - lava_callback - INFO - Starting async job submit for node 69a93457911a9cbe7f781aef 2026-03-07 07:44:36,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:44:36,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93457911a9cbe7f781aef HTTP/1.1" 200 None 2026-03-07 07:44:36,888 - lava_callback - DEBUG - Processing node 69a93457911a9cbe7f781aef: baseline-arm64-baylibre 2026-03-07 07:44:36,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93457911a9cbe7f781aef 2026-03-07 07:44:36,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:44:36,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93457911a9cbe7f781aef HTTP/1.1" 200 None 2026-03-07 07:44:36,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:44:36,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 07:44:36,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:44:36,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93457911a9cbe7f781aef HTTP/1.1" 200 None 2026-03-07 07:44:36,955 - lava_callback - ERROR - Error processing callback for node 69a93457911a9cbe7f781aef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40068 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:45:56,950 - lava_callback - INFO - Received callback for node 69a934ab911a9cbe7f781b3c INFO: 172.20.0.1:40072 - "POST /node/69a934ab911a9cbe7f781b3c HTTP/1.0" 202 Accepted 2026-03-07 07:45:56,956 - lava_callback - INFO - Starting async job submit for node 69a934ab911a9cbe7f781b3c 2026-03-07 07:45:56,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:45:56,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a934ab911a9cbe7f781b3c HTTP/1.1" 200 None 2026-03-07 07:45:56,976 - lava_callback - DEBUG - Processing node 69a934ab911a9cbe7f781b3c: baseline-arm64-baylibre 2026-03-07 07:45:56,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a934ab911a9cbe7f781b3c 2026-03-07 07:45:56,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:45:56,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a934ab911a9cbe7f781b3c HTTP/1.1" 200 None 2026-03-07 07:45:56,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:45:57,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 07:45:57,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:45:57,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a934ab911a9cbe7f781b3c HTTP/1.1" 200 None 2026-03-07 07:45:57,031 - lava_callback - ERROR - Error processing callback for node 69a934ab911a9cbe7f781b3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53062 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:47:17,117 - lava_callback - INFO - Received callback for node 69a93503911a9cbe7f781b83 INFO: 172.20.0.1:53074 - "POST /node/69a93503911a9cbe7f781b83 HTTP/1.0" 202 Accepted 2026-03-07 07:47:17,123 - lava_callback - INFO - Starting async job submit for node 69a93503911a9cbe7f781b83 2026-03-07 07:47:17,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:47:17,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93503911a9cbe7f781b83 HTTP/1.1" 200 None 2026-03-07 07:47:17,146 - lava_callback - DEBUG - Processing node 69a93503911a9cbe7f781b83: baseline-arm64-baylibre 2026-03-07 07:47:17,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93503911a9cbe7f781b83 2026-03-07 07:47:17,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:47:17,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93503911a9cbe7f781b83 HTTP/1.1" 200 None 2026-03-07 07:47:17,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:47:17,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 07:47:17,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:47:17,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93503911a9cbe7f781b83 HTTP/1.1" 200 None 2026-03-07 07:47:17,203 - lava_callback - ERROR - Error processing callback for node 69a93503911a9cbe7f781b83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33820 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:50:17,187 - lava_callback - INFO - Received callback for node 69a935b3911a9cbe7f781c04 INFO: 172.20.0.1:33834 - "POST /node/69a935b3911a9cbe7f781c04 HTTP/1.0" 202 Accepted 2026-03-07 07:50:17,192 - lava_callback - INFO - Starting async job submit for node 69a935b3911a9cbe7f781c04 2026-03-07 07:50:17,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:50:17,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a935b3911a9cbe7f781c04 HTTP/1.1" 200 None 2026-03-07 07:50:17,207 - lava_callback - DEBUG - Processing node 69a935b3911a9cbe7f781c04: baseline-arm64-baylibre 2026-03-07 07:50:17,208 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a935b3911a9cbe7f781c04 2026-03-07 07:50:17,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:50:17,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a935b3911a9cbe7f781c04 HTTP/1.1" 200 None 2026-03-07 07:50:17,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:50:17,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 07:50:17,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:50:17,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a935b3911a9cbe7f781c04 HTTP/1.1" 200 None 2026-03-07 07:50:17,268 - lava_callback - ERROR - Error processing callback for node 69a935b3911a9cbe7f781c04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36204 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:54:37,457 - lava_callback - INFO - Received callback for node 69a936ab911a9cbe7f781ccb INFO: 172.20.0.1:36206 - "POST /node/69a936ab911a9cbe7f781ccb HTTP/1.0" 202 Accepted 2026-03-07 07:54:37,462 - lava_callback - INFO - Starting async job submit for node 69a936ab911a9cbe7f781ccb 2026-03-07 07:54:37,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:54:37,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a936ab911a9cbe7f781ccb HTTP/1.1" 200 None 2026-03-07 07:54:37,482 - lava_callback - DEBUG - Processing node 69a936ab911a9cbe7f781ccb: baseline-arm64-baylibre 2026-03-07 07:54:37,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a936ab911a9cbe7f781ccb 2026-03-07 07:54:37,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:54:37,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a936ab911a9cbe7f781ccb HTTP/1.1" 200 None 2026-03-07 07:54:37,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:54:37,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 07:54:37,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:54:37,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a936ab911a9cbe7f781ccb HTTP/1.1" 200 None 2026-03-07 07:54:37,563 - lava_callback - ERROR - Error processing callback for node 69a936ab911a9cbe7f781ccb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58344 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:55:57,506 - lava_callback - INFO - Received callback for node 69a93700911a9cbe7f781d13 INFO: 172.20.0.1:58358 - "POST /node/69a93700911a9cbe7f781d13 HTTP/1.0" 202 Accepted 2026-03-07 07:55:57,515 - lava_callback - INFO - Starting async job submit for node 69a93700911a9cbe7f781d13 2026-03-07 07:55:57,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:55:57,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93700911a9cbe7f781d13 HTTP/1.1" 200 None 2026-03-07 07:55:57,531 - lava_callback - DEBUG - Processing node 69a93700911a9cbe7f781d13: baseline-arm64-baylibre 2026-03-07 07:55:57,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93700911a9cbe7f781d13 2026-03-07 07:55:57,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:55:57,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93700911a9cbe7f781d13 HTTP/1.1" 200 None 2026-03-07 07:55:57,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:55:57,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 07:55:57,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:55:57,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93700911a9cbe7f781d13 HTTP/1.1" 200 None 2026-03-07 07:55:57,588 - lava_callback - ERROR - Error processing callback for node 69a93700911a9cbe7f781d13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51234 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:57:17,570 - lava_callback - INFO - Received callback for node 69a93755911a9cbe7f781d4b INFO: 172.20.0.1:51236 - "POST /node/69a93755911a9cbe7f781d4b HTTP/1.0" 202 Accepted 2026-03-07 07:57:17,576 - lava_callback - INFO - Starting async job submit for node 69a93755911a9cbe7f781d4b 2026-03-07 07:57:17,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:57:17,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93755911a9cbe7f781d4b HTTP/1.1" 200 None 2026-03-07 07:57:17,591 - lava_callback - DEBUG - Processing node 69a93755911a9cbe7f781d4b: baseline-arm64-baylibre 2026-03-07 07:57:17,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93755911a9cbe7f781d4b 2026-03-07 07:57:17,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:57:17,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93755911a9cbe7f781d4b HTTP/1.1" 200 None 2026-03-07 07:57:17,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:57:17,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 07:57:17,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:57:17,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93755911a9cbe7f781d4b HTTP/1.1" 200 None 2026-03-07 07:57:17,653 - lava_callback - ERROR - Error processing callback for node 69a93755911a9cbe7f781d4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57908 - "GET / HTTP/1.0" 200 OK 2026-03-07 07:58:37,681 - lava_callback - INFO - Received callback for node 69a937ab911a9cbe7f781d90 INFO: 172.20.0.1:57922 - "POST /node/69a937ab911a9cbe7f781d90 HTTP/1.0" 202 Accepted 2026-03-07 07:58:37,690 - lava_callback - INFO - Starting async job submit for node 69a937ab911a9cbe7f781d90 2026-03-07 07:58:37,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:58:37,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a937ab911a9cbe7f781d90 HTTP/1.1" 200 None 2026-03-07 07:58:37,713 - lava_callback - DEBUG - Processing node 69a937ab911a9cbe7f781d90: baseline-arm64-baylibre 2026-03-07 07:58:37,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a937ab911a9cbe7f781d90 2026-03-07 07:58:37,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:58:37,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a937ab911a9cbe7f781d90 HTTP/1.1" 200 None 2026-03-07 07:58:37,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:58:37,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 07:58:37,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 07:58:37,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a937ab911a9cbe7f781d90 HTTP/1.1" 200 None 2026-03-07 07:58:37,819 - lava_callback - ERROR - Error processing callback for node 69a937ab911a9cbe7f781d90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46914 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:04:38,041 - lava_callback - INFO - Received callback for node 69a93900911a9cbe7f781ec2 INFO: 172.20.0.1:46930 - "POST /node/69a93900911a9cbe7f781ec2 HTTP/1.0" 202 Accepted 2026-03-07 08:04:38,047 - lava_callback - INFO - Starting async job submit for node 69a93900911a9cbe7f781ec2 2026-03-07 08:04:38,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:04:38,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93900911a9cbe7f781ec2 HTTP/1.1" 200 None 2026-03-07 08:04:38,064 - lava_callback - DEBUG - Processing node 69a93900911a9cbe7f781ec2: baseline-arm64-baylibre 2026-03-07 08:04:38,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93900911a9cbe7f781ec2 2026-03-07 08:04:38,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:04:38,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93900911a9cbe7f781ec2 HTTP/1.1" 200 None 2026-03-07 08:04:38,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:04:38,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a385776346680f7a28dbe0 HTTP/1.1" 200 None 2026-03-07 08:04:38,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:04:38,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93900911a9cbe7f781ec2 HTTP/1.1" 200 None 2026-03-07 08:04:38,123 - lava_callback - ERROR - Error processing callback for node 69a93900911a9cbe7f781ec2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43280 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:05:58,052 - lava_callback - INFO - Received callback for node 69a93955911a9cbe7f781efd INFO: 172.20.0.1:43296 - "POST /node/69a93955911a9cbe7f781efd HTTP/1.0" 202 Accepted 2026-03-07 08:05:58,057 - lava_callback - INFO - Starting async job submit for node 69a93955911a9cbe7f781efd 2026-03-07 08:05:58,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:05:58,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93955911a9cbe7f781efd HTTP/1.1" 200 None 2026-03-07 08:05:58,073 - lava_callback - DEBUG - Processing node 69a93955911a9cbe7f781efd: baseline-arm-baylibre 2026-03-07 08:05:58,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93955911a9cbe7f781efd 2026-03-07 08:05:58,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:05:58,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93955911a9cbe7f781efd HTTP/1.1" 200 None 2026-03-07 08:05:58,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:05:58,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-07 08:05:58,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:05:58,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93955911a9cbe7f781efd HTTP/1.1" 200 None 2026-03-07 08:05:58,135 - lava_callback - ERROR - Error processing callback for node 69a93955911a9cbe7f781efd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59860 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:06:38,001 - lava_callback - INFO - Received callback for node 69a93985911a9cbe7f781f39 INFO: 172.20.0.1:59874 - "POST /node/69a93985911a9cbe7f781f39 HTTP/1.0" 202 Accepted 2026-03-07 08:06:38,007 - lava_callback - INFO - Starting async job submit for node 69a93985911a9cbe7f781f39 2026-03-07 08:06:38,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:06:38,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93985911a9cbe7f781f39 HTTP/1.1" 200 None 2026-03-07 08:06:38,023 - lava_callback - DEBUG - Processing node 69a93985911a9cbe7f781f39: baseline-arm-baylibre 2026-03-07 08:06:38,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93985911a9cbe7f781f39 2026-03-07 08:06:38,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:06:38,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93985911a9cbe7f781f39 HTTP/1.1" 200 None 2026-03-07 08:06:38,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:06:38,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-07 08:06:38,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:06:38,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93985911a9cbe7f781f39 HTTP/1.1" 200 None 2026-03-07 08:06:38,083 - lava_callback - ERROR - Error processing callback for node 69a93985911a9cbe7f781f39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48612 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:07:18,097 - lava_callback - INFO - Received callback for node 69a939b2911a9cbe7f781f89 INFO: 172.20.0.1:48628 - "POST /node/69a939b2911a9cbe7f781f89 HTTP/1.0" 202 Accepted 2026-03-07 08:07:18,103 - lava_callback - INFO - Starting async job submit for node 69a939b2911a9cbe7f781f89 2026-03-07 08:07:18,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:07:18,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a939b2911a9cbe7f781f89 HTTP/1.1" 200 None 2026-03-07 08:07:18,129 - lava_callback - DEBUG - Processing node 69a939b2911a9cbe7f781f89: baseline-arm-baylibre 2026-03-07 08:07:18,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a939b2911a9cbe7f781f89 2026-03-07 08:07:18,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:07:18,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a939b2911a9cbe7f781f89 HTTP/1.1" 200 None 2026-03-07 08:07:18,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:07:18,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-07 08:07:18,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:07:18,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a939b2911a9cbe7f781f89 HTTP/1.1" 200 None 2026-03-07 08:07:18,211 - lava_callback - ERROR - Error processing callback for node 69a939b2911a9cbe7f781f89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34494 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:08:18,098 - lava_callback - INFO - Received callback for node 69a939e0911a9cbe7f781fb7 INFO: 172.20.0.1:34502 - "POST /node/69a939e0911a9cbe7f781fb7 HTTP/1.0" 202 Accepted 2026-03-07 08:08:18,104 - lava_callback - INFO - Starting async job submit for node 69a939e0911a9cbe7f781fb7 2026-03-07 08:08:18,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:08:18,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a939e0911a9cbe7f781fb7 HTTP/1.1" 200 None 2026-03-07 08:08:18,120 - lava_callback - DEBUG - Processing node 69a939e0911a9cbe7f781fb7: baseline-arm-baylibre 2026-03-07 08:08:18,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a939e0911a9cbe7f781fb7 2026-03-07 08:08:18,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:08:18,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a939e0911a9cbe7f781fb7 HTTP/1.1" 200 None 2026-03-07 08:08:18,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:08:18,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-07 08:08:18,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:08:18,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a939e0911a9cbe7f781fb7 HTTP/1.1" 200 None 2026-03-07 08:08:18,179 - lava_callback - ERROR - Error processing callback for node 69a939e0911a9cbe7f781fb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46770 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:08:58,215 - lava_callback - INFO - Received callback for node 69a93a0e911a9cbe7f782012 INFO: 172.20.0.1:46772 - "POST /node/69a93a0e911a9cbe7f782012 HTTP/1.0" 202 Accepted 2026-03-07 08:08:58,221 - lava_callback - INFO - Starting async job submit for node 69a93a0e911a9cbe7f782012 2026-03-07 08:08:58,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:08:58,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93a0e911a9cbe7f782012 HTTP/1.1" 200 None 2026-03-07 08:08:58,238 - lava_callback - DEBUG - Processing node 69a93a0e911a9cbe7f782012: baseline-arm-baylibre 2026-03-07 08:08:58,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a93a0e911a9cbe7f782012 2026-03-07 08:08:58,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:08:58,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93a0e911a9cbe7f782012 HTTP/1.1" 200 None 2026-03-07 08:08:58,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:08:58,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0e532aaccb4c112eb60 HTTP/1.1" 200 None 2026-03-07 08:08:58,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:08:58,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a93a0e911a9cbe7f782012 HTTP/1.1" 200 None 2026-03-07 08:08:58,294 - lava_callback - ERROR - Error processing callback for node 69a93a0e911a9cbe7f782012: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45394 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]