INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55278 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:36:40,294 - lava_callback - INFO - Received callback for node 69fa1c22a9d11f026cebdc90 2026-05-05 16:36:40,300 - lava_callback - INFO - Starting async job submit for node 69fa1c22a9d11f026cebdc90 INFO: 172.21.0.1:48674 - "POST /node/69fa1c22a9d11f026cebdc90 HTTP/1.0" 202 Accepted 2026-05-05 16:36:40,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:36:40,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1c22a9d11f026cebdc90 HTTP/1.1" 200 None 2026-05-05 16:36:40,342 - lava_callback - DEBUG - Processing node 69fa1c22a9d11f026cebdc90: baseline-arm 2026-05-05 16:36:40,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:36:40,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:36:40,710 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1c22a9d11f026cebdc90/log.txt.gz 2026-05-05 16:36:40,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:36:40,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:36:40,998 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1c22a9d11f026cebdc90/lava-logs.yaml 2026-05-05 16:36:41,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:36:41,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:36:41,101 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1c22a9d11f026cebdc90/lava_callback.json.gz 2026-05-05 16:36:41,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:36:41,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1c22a9d11f026cebdc90 HTTP/1.1" 200 None 2026-05-05 16:36:41,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:36:41,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa186ca9d11f026cebb51e HTTP/1.1" 200 None 2026-05-05 16:36:41,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:36:41,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1c22a9d11f026cebdc90 HTTP/1.1" 200 None 2026-05-05 16:36:41,180 - lava_callback - INFO - Completed processing callback for node 69fa1c22a9d11f026cebdc90 INFO: 172.21.0.1:48682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:37:11,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:37:11,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:43:39,705 - lava_callback - INFO - Received callback for node 69fa1e1fa9d11f026cebdcaf INFO: 172.21.0.1:36148 - "POST /node/69fa1e1fa9d11f026cebdcaf HTTP/1.0" 202 Accepted 2026-05-05 16:43:39,711 - lava_callback - INFO - Starting async job submit for node 69fa1e1fa9d11f026cebdcaf 2026-05-05 16:43:39,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:43:39,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1e1fa9d11f026cebdcaf HTTP/1.1" 200 None 2026-05-05 16:43:39,745 - lava_callback - DEBUG - Processing node 69fa1e1fa9d11f026cebdcaf: baseline-x86 2026-05-05 16:43:39,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:43:40,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:43:40,073 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e1fa9d11f026cebdcaf/log.txt.gz 2026-05-05 16:43:40,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:43:40,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:43:40,368 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e1fa9d11f026cebdcaf/lava-logs.yaml 2026-05-05 16:43:40,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:43:40,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:43:40,494 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e1fa9d11f026cebdcaf/lava_callback.json.gz 2026-05-05 16:43:40,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:43:40,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1e1fa9d11f026cebdcaf HTTP/1.1" 200 None 2026-05-05 16:43:40,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:43:40,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa188fa9d11f026cebb545 HTTP/1.1" 200 None 2026-05-05 16:43:40,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:43:40,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1e1fa9d11f026cebdcaf HTTP/1.1" 200 None 2026-05-05 16:43:40,561 - lava_callback - INFO - Completed processing callback for node 69fa1e1fa9d11f026cebdcaf 2026-05-05 16:43:41,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:43:41,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36164 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:43:50,827 - lava_callback - INFO - Received callback for node 69fa1e21a9d11f026cebdcb8 INFO: 172.21.0.1:34892 - "POST /node/69fa1e21a9d11f026cebdcb8 HTTP/1.0" 202 Accepted 2026-05-05 16:43:50,834 - lava_callback - INFO - Starting async job submit for node 69fa1e21a9d11f026cebdcb8 2026-05-05 16:43:50,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:43:50,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1e21a9d11f026cebdcb8 HTTP/1.1" 200 None 2026-05-05 16:43:50,870 - lava_callback - DEBUG - Processing node 69fa1e21a9d11f026cebdcb8: baseline-x86 2026-05-05 16:43:51,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:43:51,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:43:51,171 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e21a9d11f026cebdcb8/log.txt.gz 2026-05-05 16:43:51,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:43:51,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:43:51,426 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e21a9d11f026cebdcb8/lava-logs.yaml 2026-05-05 16:43:51,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:43:51,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:43:51,530 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e21a9d11f026cebdcb8/lava_callback.json.gz 2026-05-05 16:43:51,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:43:51,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1e21a9d11f026cebdcb8 HTTP/1.1" 200 None 2026-05-05 16:43:51,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:43:51,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa188fa9d11f026cebb545 HTTP/1.1" 200 None 2026-05-05 16:43:51,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:43:51,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1e21a9d11f026cebdcb8 HTTP/1.1" 200 None 2026-05-05 16:43:51,605 - lava_callback - INFO - Completed processing callback for node 69fa1e21a9d11f026cebdcb8 INFO: 172.21.0.1:34906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:44:11,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:44:11,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:44:44,795 - lava_callback - INFO - Received callback for node 69fa1e1fa9d11f026cebdcb2 INFO: 172.21.0.1:43142 - "POST /node/69fa1e1fa9d11f026cebdcb2 HTTP/1.0" 202 Accepted 2026-05-05 16:44:44,801 - lava_callback - INFO - Starting async job submit for node 69fa1e1fa9d11f026cebdcb2 2026-05-05 16:44:44,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:44:44,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1e1fa9d11f026cebdcb2 HTTP/1.1" 200 None 2026-05-05 16:44:44,834 - lava_callback - DEBUG - Processing node 69fa1e1fa9d11f026cebdcb2: baseline-x86 2026-05-05 16:44:45,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:44:45,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:44:45,245 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e1fa9d11f026cebdcb2/log.txt.gz 2026-05-05 16:44:45,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:44:45,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:44:45,613 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e1fa9d11f026cebdcb2/lava-logs.yaml 2026-05-05 16:44:45,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:44:45,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:44:45,747 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e1fa9d11f026cebdcb2/lava_callback.json.gz 2026-05-05 16:44:45,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:44:45,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1e1fa9d11f026cebdcb2 HTTP/1.1" 200 None 2026-05-05 16:44:45,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:44:45,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa188fa9d11f026cebb545 HTTP/1.1" 200 None 2026-05-05 16:44:45,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:44:45,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1e1fa9d11f026cebdcb2 HTTP/1.1" 200 None 2026-05-05 16:44:45,864 - lava_callback - INFO - Completed processing callback for node 69fa1e1fa9d11f026cebdcb2 INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:44:55,367 - lava_callback - INFO - Received callback for node 69fa1e22a9d11f026cebdcbb INFO: 172.21.0.1:42158 - "POST /node/69fa1e22a9d11f026cebdcbb HTTP/1.0" 202 Accepted 2026-05-05 16:44:55,374 - lava_callback - INFO - Starting async job submit for node 69fa1e22a9d11f026cebdcbb 2026-05-05 16:44:55,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:44:55,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1e22a9d11f026cebdcbb HTTP/1.1" 200 None 2026-05-05 16:44:55,427 - lava_callback - DEBUG - Processing node 69fa1e22a9d11f026cebdcbb: baseline-x86 2026-05-05 16:44:55,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:44:55,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:44:55,924 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e22a9d11f026cebdcbb/log.txt.gz 2026-05-05 16:44:56,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:44:56,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:44:56,264 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e22a9d11f026cebdcbb/lava-logs.yaml 2026-05-05 16:44:56,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:44:56,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:44:56,418 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e22a9d11f026cebdcbb/lava_callback.json.gz 2026-05-05 16:44:56,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:44:56,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1e22a9d11f026cebdcbb HTTP/1.1" 200 None 2026-05-05 16:44:56,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:44:56,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa188fa9d11f026cebb545 HTTP/1.1" 200 None 2026-05-05 16:44:56,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:44:56,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1e22a9d11f026cebdcbb HTTP/1.1" 200 None 2026-05-05 16:44:56,507 - lava_callback - INFO - Completed processing callback for node 69fa1e22a9d11f026cebdcbb INFO: 172.21.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:45:11,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:45:11,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:46:41,860 - lava_callback - INFO - Received callback for node 69fa1edba9d11f026cebdd0c INFO: 172.21.0.1:33318 - "POST /node/69fa1edba9d11f026cebdd0c HTTP/1.0" 202 Accepted 2026-05-05 16:46:41,866 - lava_callback - INFO - Starting async job submit for node 69fa1edba9d11f026cebdd0c 2026-05-05 16:46:41,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:46:41,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1edba9d11f026cebdd0c HTTP/1.1" 200 None 2026-05-05 16:46:41,900 - lava_callback - DEBUG - Processing node 69fa1edba9d11f026cebdd0c: baseline-arm64 2026-05-05 16:46:42,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:46:42,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:46:42,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edba9d11f026cebdd0c/log.txt.gz 2026-05-05 16:46:42,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:46:42,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:46:42,429 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edba9d11f026cebdd0c/lava-logs.yaml 2026-05-05 16:46:42,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:46:42,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:46:42,527 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edba9d11f026cebdd0c/lava_callback.json.gz 2026-05-05 16:46:42,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:46:42,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1edba9d11f026cebdd0c HTTP/1.1" 200 None 2026-05-05 16:46:42,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:46:42,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:46:42,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:46:42,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1edba9d11f026cebdd0c HTTP/1.1" 200 None 2026-05-05 16:46:42,604 - lava_callback - INFO - Completed processing callback for node 69fa1edba9d11f026cebdd0c INFO: 172.21.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33340 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:46:56,455 - lava_callback - INFO - Received callback for node 69fa1ee7a9d11f026cebdd30 INFO: 172.21.0.1:37842 - "POST /node/69fa1ee7a9d11f026cebdd30 HTTP/1.0" 202 Accepted 2026-05-05 16:46:56,471 - lava_callback - INFO - Starting async job submit for node 69fa1ee7a9d11f026cebdd30 2026-05-05 16:46:56,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:46:56,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee7a9d11f026cebdd30 HTTP/1.1" 200 None 2026-05-05 16:46:56,541 - lava_callback - DEBUG - Processing node 69fa1ee7a9d11f026cebdd30: baseline-arm64 2026-05-05 16:46:56,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:46:56,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:46:56,943 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee7a9d11f026cebdd30/log.txt.gz 2026-05-05 16:46:57,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:46:57,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:46:57,206 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee7a9d11f026cebdd30/lava-logs.yaml 2026-05-05 16:46:57,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:46:57,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:46:57,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee7a9d11f026cebdd30/lava_callback.json.gz 2026-05-05 16:46:57,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:46:57,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee7a9d11f026cebdd30 HTTP/1.1" 200 None 2026-05-05 16:46:57,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:46:57,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:46:57,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:46:57,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ee7a9d11f026cebdd30 HTTP/1.1" 200 None 2026-05-05 16:46:57,460 - lava_callback - INFO - Completed processing callback for node 69fa1ee7a9d11f026cebdd30 2026-05-05 16:47:01,626 - lava_callback - INFO - Received callback for node 69fa1ef5a9d11f026cebdd75 INFO: 172.21.0.1:45350 - "POST /node/69fa1ef5a9d11f026cebdd75 HTTP/1.0" 202 Accepted 2026-05-05 16:47:01,633 - lava_callback - INFO - Starting async job submit for node 69fa1ef5a9d11f026cebdd75 2026-05-05 16:47:01,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:01,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef5a9d11f026cebdd75 HTTP/1.1" 200 None 2026-05-05 16:47:01,649 - lava_callback - DEBUG - Processing node 69fa1ef5a9d11f026cebdd75: baseline-nfs-arm64 2026-05-05 16:47:01,651 - lava_callback - WARNING - Failed to upload log 2026-05-05 16:47:01,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:01,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:01,764 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef5a9d11f026cebdd75/lava-logs.yaml 2026-05-05 16:47:01,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:01,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:01,850 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef5a9d11f026cebdd75/lava_callback.json.gz 2026-05-05 16:47:01,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:01,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef5a9d11f026cebdd75 HTTP/1.1" 200 None 2026-05-05 16:47:01,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:01,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:47:01,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:01,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ef5a9d11f026cebdd75 HTTP/1.1" 200 None 2026-05-05 16:47:01,910 - lava_callback - INFO - Completed processing callback for node 69fa1ef5a9d11f026cebdd75 INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:47:11,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:11,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:47:22,098 - lava_callback - INFO - Received callback for node 69f77c07096243809b56c15e INFO: 172.21.0.1:35828 - "POST /node/69f77c07096243809b56c15e HTTP/1.0" 202 Accepted 2026-05-05 16:47:22,104 - lava_callback - INFO - Starting async job submit for node 69f77c07096243809b56c15e 2026-05-05 16:47:22,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:22,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c07096243809b56c15e HTTP/1.1" 200 None 2026-05-05 16:47:22,120 - lava_callback - DEBUG - Processing node 69f77c07096243809b56c15e: baseline-arm-clabbe 2026-05-05 16:47:22,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77c07096243809b56c15e 2026-05-05 16:47:22,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:22,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c07096243809b56c15e HTTP/1.1" 200 None 2026-05-05 16:47:22,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:22,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 16:47:22,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:22,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77c07096243809b56c15e HTTP/1.1" 200 None 2026-05-05 16:47:22,191 - lava_callback - ERROR - Error processing callback for node 69f77c07096243809b56c15e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:47:28,761 - lava_callback - INFO - Received callback for node 69fa1edda9d11f026cebdd12 INFO: 172.21.0.1:35848 - "POST /node/69fa1edda9d11f026cebdd12 HTTP/1.0" 202 Accepted 2026-05-05 16:47:28,768 - lava_callback - INFO - Starting async job submit for node 69fa1edda9d11f026cebdd12 2026-05-05 16:47:28,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:28,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1edda9d11f026cebdd12 HTTP/1.1" 200 None 2026-05-05 16:47:28,828 - lava_callback - DEBUG - Processing node 69fa1edda9d11f026cebdd12: baseline-arm64 2026-05-05 16:47:29,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:29,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:29,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edda9d11f026cebdd12/log.txt.gz 2026-05-05 16:47:29,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:29,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:29,688 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edda9d11f026cebdd12/lava-logs.yaml 2026-05-05 16:47:29,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:29,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:29,818 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edda9d11f026cebdd12/lava_callback.json.gz 2026-05-05 16:47:29,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:29,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1edda9d11f026cebdd12 HTTP/1.1" 200 None 2026-05-05 16:47:29,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:29,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:47:29,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:29,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1edda9d11f026cebdd12 HTTP/1.1" 200 None 2026-05-05 16:47:29,895 - lava_callback - INFO - Completed processing callback for node 69fa1edda9d11f026cebdd12 INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:47:39,765 - lava_callback - INFO - Received callback for node 69fa1ee0a9d11f026cebdd1b INFO: 172.21.0.1:35896 - "POST /node/69fa1ee0a9d11f026cebdd1b HTTP/1.0" 202 Accepted 2026-05-05 16:47:39,772 - lava_callback - INFO - Starting async job submit for node 69fa1ee0a9d11f026cebdd1b 2026-05-05 16:47:39,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:39,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee0a9d11f026cebdd1b HTTP/1.1" 200 None 2026-05-05 16:47:39,836 - lava_callback - DEBUG - Processing node 69fa1ee0a9d11f026cebdd1b: baseline-arm64 2026-05-05 16:47:39,971 - lava_callback - WARNING - Failed to upload log 2026-05-05 16:47:40,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:40,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:40,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee0a9d11f026cebdd1b/lava-logs.yaml 2026-05-05 16:47:40,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:40,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:40,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee0a9d11f026cebdd1b/lava_callback.json.gz 2026-05-05 16:47:40,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:40,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee0a9d11f026cebdd1b HTTP/1.1" 200 None 2026-05-05 16:47:40,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:40,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:47:40,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:40,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ee0a9d11f026cebdd1b HTTP/1.1" 200 None 2026-05-05 16:47:40,424 - lava_callback - INFO - Completed processing callback for node 69fa1ee0a9d11f026cebdd1b 2026-05-05 16:47:41,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:41,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35906 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:47:44,592 - lava_callback - INFO - Received callback for node 69fa1ee5a9d11f026cebdd2a INFO: 172.21.0.1:35922 - "POST /node/69fa1ee5a9d11f026cebdd2a HTTP/1.0" 202 Accepted 2026-05-05 16:47:44,598 - lava_callback - INFO - Starting async job submit for node 69fa1ee5a9d11f026cebdd2a 2026-05-05 16:47:44,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:44,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee5a9d11f026cebdd2a HTTP/1.1" 200 None 2026-05-05 16:47:44,638 - lava_callback - DEBUG - Processing node 69fa1ee5a9d11f026cebdd2a: baseline-arm64 2026-05-05 16:47:45,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:45,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:45,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee5a9d11f026cebdd2a/log.txt.gz 2026-05-05 16:47:45,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:45,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:45,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee5a9d11f026cebdd2a/lava-logs.yaml 2026-05-05 16:47:45,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:45,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:45,605 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee5a9d11f026cebdd2a/lava_callback.json.gz 2026-05-05 16:47:45,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:45,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee5a9d11f026cebdd2a HTTP/1.1" 200 None 2026-05-05 16:47:45,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:45,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:47:45,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:45,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ee5a9d11f026cebdd2a HTTP/1.1" 200 None 2026-05-05 16:47:45,700 - lava_callback - INFO - Completed processing callback for node 69fa1ee5a9d11f026cebdd2a INFO: 172.21.0.1:35926 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:47:47,228 - lava_callback - INFO - Received callback for node 69fa1ee1a9d11f026cebdd1e INFO: 172.21.0.1:35938 - "POST /node/69fa1ee1a9d11f026cebdd1e HTTP/1.0" 202 Accepted 2026-05-05 16:47:47,238 - lava_callback - INFO - Starting async job submit for node 69fa1ee1a9d11f026cebdd1e 2026-05-05 16:47:47,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:47,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee1a9d11f026cebdd1e HTTP/1.1" 200 None 2026-05-05 16:47:47,288 - lava_callback - DEBUG - Processing node 69fa1ee1a9d11f026cebdd1e: baseline-arm64 2026-05-05 16:47:47,450 - lava_callback - WARNING - Failed to upload log 2026-05-05 16:47:47,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:47,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:47,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee1a9d11f026cebdd1e/lava-logs.yaml 2026-05-05 16:47:47,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:47,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:47,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee1a9d11f026cebdd1e/lava_callback.json.gz 2026-05-05 16:47:47,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:47,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee1a9d11f026cebdd1e HTTP/1.1" 200 None 2026-05-05 16:47:47,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:47,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:47:47,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:47,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ee1a9d11f026cebdd1e HTTP/1.1" 200 None 2026-05-05 16:47:47,887 - lava_callback - INFO - Completed processing callback for node 69fa1ee1a9d11f026cebdd1e 2026-05-05 16:47:48,552 - lava_callback - INFO - Received callback for node 69fa1ee3a9d11f026cebdd24 INFO: 172.21.0.1:35954 - "POST /node/69fa1ee3a9d11f026cebdd24 HTTP/1.0" 202 Accepted 2026-05-05 16:47:48,558 - lava_callback - INFO - Starting async job submit for node 69fa1ee3a9d11f026cebdd24 2026-05-05 16:47:48,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:48,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee3a9d11f026cebdd24 HTTP/1.1" 200 None 2026-05-05 16:47:48,593 - lava_callback - DEBUG - Processing node 69fa1ee3a9d11f026cebdd24: baseline-arm64 2026-05-05 16:47:48,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:48,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:48,923 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee3a9d11f026cebdd24/log.txt.gz 2026-05-05 16:47:49,030 - lava_callback - INFO - Received callback for node 69fa1ee4a9d11f026cebdd27 2026-05-05 16:47:49,051 - lava_callback - INFO - Starting async job submit for node 69fa1ee4a9d11f026cebdd27 INFO: 172.21.0.1:35964 - "POST /node/69fa1ee4a9d11f026cebdd27 HTTP/1.0" 202 Accepted 2026-05-05 16:47:49,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:49,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:49,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee4a9d11f026cebdd27 HTTP/1.1" 200 None 2026-05-05 16:47:49,112 - lava_callback - DEBUG - Processing node 69fa1ee4a9d11f026cebdd27: baseline-arm64 2026-05-05 16:47:49,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:49,297 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee3a9d11f026cebdd24/lava-logs.yaml 2026-05-05 16:47:49,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:49,520 - lava_callback - INFO - Received callback for node 69fa1eeba9d11f026cebdd39 2026-05-05 16:47:49,535 - lava_callback - INFO - Starting async job submit for node 69fa1eeba9d11f026cebdd39 INFO: 172.21.0.1:35974 - "POST /node/69fa1eeba9d11f026cebdd39 HTTP/1.0" 202 Accepted 2026-05-05 16:47:49,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:49,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:49,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eeba9d11f026cebdd39 HTTP/1.1" 200 None 2026-05-05 16:47:49,575 - lava_callback - DEBUG - Processing node 69fa1eeba9d11f026cebdd39: baseline-arm64 2026-05-05 16:47:49,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:49,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:49,648 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee3a9d11f026cebdd24/lava_callback.json.gz 2026-05-05 16:47:49,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:49,727 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee4a9d11f026cebdd27/log.txt.gz 2026-05-05 16:47:49,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee3a9d11f026cebdd24 HTTP/1.1" 200 None 2026-05-05 16:47:49,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:50,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:50,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:47:50,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:50,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:50,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ee3a9d11f026cebdd24 HTTP/1.1" 200 None 2026-05-05 16:47:50,127 - lava_callback - INFO - Completed processing callback for node 69fa1ee3a9d11f026cebdd24 2026-05-05 16:47:50,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:50,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeba9d11f026cebdd39/log.txt.gz 2026-05-05 16:47:50,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:50,300 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee4a9d11f026cebdd27/lava-logs.yaml 2026-05-05 16:47:50,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:50,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:50,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:50,540 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee4a9d11f026cebdd27/lava_callback.json.gz 2026-05-05 16:47:50,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:50,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:50,564 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeba9d11f026cebdd39/lava-logs.yaml 2026-05-05 16:47:50,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:50,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee4a9d11f026cebdd27 HTTP/1.1" 200 None 2026-05-05 16:47:50,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:50,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:47:50,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:50,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ee4a9d11f026cebdd27 HTTP/1.1" 200 None 2026-05-05 16:47:50,621 - lava_callback - INFO - Completed processing callback for node 69fa1ee4a9d11f026cebdd27 2026-05-05 16:47:50,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:50,695 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeba9d11f026cebdd39/lava_callback.json.gz 2026-05-05 16:47:50,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:50,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eeba9d11f026cebdd39 HTTP/1.1" 200 None 2026-05-05 16:47:50,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:50,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:47:50,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:50,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1eeba9d11f026cebdd39 HTTP/1.1" 200 None 2026-05-05 16:47:50,803 - lava_callback - INFO - Completed processing callback for node 69fa1eeba9d11f026cebdd39 2026-05-05 16:47:52,105 - lava_callback - INFO - Received callback for node 69fa1ee8a9d11f026cebdd33 INFO: 172.21.0.1:55838 - "POST /node/69fa1ee8a9d11f026cebdd33 HTTP/1.0" 202 Accepted 2026-05-05 16:47:52,111 - lava_callback - INFO - Starting async job submit for node 69fa1ee8a9d11f026cebdd33 2026-05-05 16:47:52,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:52,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee8a9d11f026cebdd33 HTTP/1.1" 200 None 2026-05-05 16:47:52,149 - lava_callback - DEBUG - Processing node 69fa1ee8a9d11f026cebdd33: baseline-arm64 2026-05-05 16:47:52,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:52,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:52,498 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee8a9d11f026cebdd33/log.txt.gz 2026-05-05 16:47:52,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:52,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:52,800 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee8a9d11f026cebdd33/lava-logs.yaml 2026-05-05 16:47:52,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:52,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:52,931 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee8a9d11f026cebdd33/lava_callback.json.gz 2026-05-05 16:47:52,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:52,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee8a9d11f026cebdd33 HTTP/1.1" 200 None 2026-05-05 16:47:52,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:52,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:47:52,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:53,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ee8a9d11f026cebdd33 HTTP/1.1" 200 None 2026-05-05 16:47:53,012 - lava_callback - INFO - Completed processing callback for node 69fa1ee8a9d11f026cebdd33 2026-05-05 16:47:54,028 - lava_callback - INFO - Received callback for node 69fa1eeaa9d11f026cebdd36 INFO: 172.21.0.1:55848 - "POST /node/69fa1eeaa9d11f026cebdd36 HTTP/1.0" 202 Accepted 2026-05-05 16:47:54,034 - lava_callback - INFO - Starting async job submit for node 69fa1eeaa9d11f026cebdd36 2026-05-05 16:47:54,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:54,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eeaa9d11f026cebdd36 HTTP/1.1" 200 None 2026-05-05 16:47:54,072 - lava_callback - DEBUG - Processing node 69fa1eeaa9d11f026cebdd36: baseline-arm64 2026-05-05 16:47:54,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:54,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:54,413 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeaa9d11f026cebdd36/log.txt.gz 2026-05-05 16:47:54,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:54,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:54,693 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeaa9d11f026cebdd36/lava-logs.yaml 2026-05-05 16:47:54,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:47:54,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:47:54,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeaa9d11f026cebdd36/lava_callback.json.gz 2026-05-05 16:47:54,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:54,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eeaa9d11f026cebdd36 HTTP/1.1" 200 None 2026-05-05 16:47:54,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:54,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:47:54,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:47:54,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1eeaa9d11f026cebdd36 HTTP/1.1" 200 None 2026-05-05 16:47:54,877 - lava_callback - INFO - Completed processing callback for node 69fa1eeaa9d11f026cebdd36 INFO: 172.21.0.1:55854 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:48:01,971 - lava_callback - INFO - Received callback for node 69f77c2c096243809b56c17c INFO: 172.21.0.1:45520 - "POST /node/69f77c2c096243809b56c17c HTTP/1.0" 202 Accepted 2026-05-05 16:48:01,977 - lava_callback - INFO - Starting async job submit for node 69f77c2c096243809b56c17c 2026-05-05 16:48:01,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:01,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c2c096243809b56c17c HTTP/1.1" 200 None 2026-05-05 16:48:01,992 - lava_callback - DEBUG - Processing node 69f77c2c096243809b56c17c: baseline-arm-clabbe 2026-05-05 16:48:01,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77c2c096243809b56c17c 2026-05-05 16:48:01,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:02,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c2c096243809b56c17c HTTP/1.1" 200 None 2026-05-05 16:48:02,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:02,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 16:48:02,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:02,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77c2c096243809b56c17c HTTP/1.1" 200 None 2026-05-05 16:48:02,040 - lava_callback - ERROR - Error processing callback for node 69f77c2c096243809b56c17c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:48:04,121 - lava_callback - INFO - Received callback for node 69fa1edca9d11f026cebdd0f INFO: 172.21.0.1:45528 - "POST /node/69fa1edca9d11f026cebdd0f HTTP/1.0" 202 Accepted 2026-05-05 16:48:04,128 - lava_callback - INFO - Starting async job submit for node 69fa1edca9d11f026cebdd0f 2026-05-05 16:48:04,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:04,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1edca9d11f026cebdd0f HTTP/1.1" 200 None 2026-05-05 16:48:04,162 - lava_callback - DEBUG - Processing node 69fa1edca9d11f026cebdd0f: baseline-arm64 2026-05-05 16:48:04,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:04,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:04,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edca9d11f026cebdd0f/log.txt.gz 2026-05-05 16:48:04,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:04,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:04,875 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edca9d11f026cebdd0f/lava-logs.yaml 2026-05-05 16:48:04,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:04,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:04,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edca9d11f026cebdd0f/lava_callback.json.gz 2026-05-05 16:48:04,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:05,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1edca9d11f026cebdd0f HTTP/1.1" 200 None 2026-05-05 16:48:05,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:05,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:05,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:05,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1edca9d11f026cebdd0f HTTP/1.1" 200 None 2026-05-05 16:48:05,053 - lava_callback - INFO - Completed processing callback for node 69fa1edca9d11f026cebdd0f INFO: 172.21.0.1:45540 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:48:06,934 - lava_callback - INFO - Received callback for node 69fa1eeca9d11f026cebdd3c INFO: 172.21.0.1:45546 - "POST /node/69fa1eeca9d11f026cebdd3c HTTP/1.0" 202 Accepted 2026-05-05 16:48:06,941 - lava_callback - INFO - Starting async job submit for node 69fa1eeca9d11f026cebdd3c 2026-05-05 16:48:06,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:06,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eeca9d11f026cebdd3c HTTP/1.1" 200 None 2026-05-05 16:48:06,976 - lava_callback - DEBUG - Processing node 69fa1eeca9d11f026cebdd3c: baseline-arm64 2026-05-05 16:48:07,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:07,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:07,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeca9d11f026cebdd3c/log.txt.gz 2026-05-05 16:48:07,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:07,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:07,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeca9d11f026cebdd3c/lava-logs.yaml 2026-05-05 16:48:07,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:07,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:07,934 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeca9d11f026cebdd3c/lava_callback.json.gz 2026-05-05 16:48:07,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:07,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eeca9d11f026cebdd3c HTTP/1.1" 200 None 2026-05-05 16:48:07,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:07,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:07,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:08,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1eeca9d11f026cebdd3c HTTP/1.1" 200 None 2026-05-05 16:48:08,017 - lava_callback - INFO - Completed processing callback for node 69fa1eeca9d11f026cebdd3c 2026-05-05 16:48:09,712 - lava_callback - INFO - Received callback for node 69fa1f1ca9d11f026cebde01 INFO: 172.21.0.1:41510 - "POST /node/69fa1f1ca9d11f026cebde01 HTTP/1.0" 202 Accepted 2026-05-05 16:48:09,718 - lava_callback - INFO - Starting async job submit for node 69fa1f1ca9d11f026cebde01 2026-05-05 16:48:09,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:09,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f1ca9d11f026cebde01 HTTP/1.1" 200 None 2026-05-05 16:48:09,753 - lava_callback - DEBUG - Processing node 69fa1f1ca9d11f026cebde01: baseline-arm64-pengutronix 2026-05-05 16:48:09,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:10,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:10,015 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fa1f1ca9d11f026cebde01/log.txt.gz 2026-05-05 16:48:10,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:10,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:10,250 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fa1f1ca9d11f026cebde01/lava-logs.yaml 2026-05-05 16:48:10,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:10,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:10,362 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fa1f1ca9d11f026cebde01/lava_callback.json.gz 2026-05-05 16:48:10,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:10,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f1ca9d11f026cebde01 HTTP/1.1" 200 None 2026-05-05 16:48:10,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:10,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:10,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:10,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f1ca9d11f026cebde01 HTTP/1.1" 200 None 2026-05-05 16:48:10,433 - lava_callback - INFO - Completed processing callback for node 69fa1f1ca9d11f026cebde01 2026-05-05 16:48:11,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:11,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-05 16:48:12,827 - lava_callback - INFO - Received callback for node 69fa1edea9d11f026cebdd15 INFO: 172.21.0.1:41522 - "POST /node/69fa1edea9d11f026cebdd15 HTTP/1.0" 202 Accepted 2026-05-05 16:48:12,833 - lava_callback - INFO - Starting async job submit for node 69fa1edea9d11f026cebdd15 2026-05-05 16:48:12,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:12,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1edea9d11f026cebdd15 HTTP/1.1" 200 None 2026-05-05 16:48:12,880 - lava_callback - DEBUG - Processing node 69fa1edea9d11f026cebdd15: baseline-arm64 2026-05-05 16:48:13,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:13,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:13,246 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edea9d11f026cebdd15/log.txt.gz 2026-05-05 16:48:13,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:13,474 - lava_callback - INFO - Received callback for node 69fa1ef3a9d11f026cebdd6f INFO: 172.21.0.1:41524 - "POST /node/69fa1ef3a9d11f026cebdd6f HTTP/1.0" 202 Accepted 2026-05-05 16:48:13,482 - lava_callback - INFO - Starting async job submit for node 69fa1ef3a9d11f026cebdd6f 2026-05-05 16:48:13,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:13,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef3a9d11f026cebdd6f HTTP/1.1" 200 None 2026-05-05 16:48:13,526 - lava_callback - DEBUG - Processing node 69fa1ef3a9d11f026cebdd6f: baseline-nfs-arm64 2026-05-05 16:48:13,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:13,611 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edea9d11f026cebdd15/lava-logs.yaml 2026-05-05 16:48:13,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:13,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:13,932 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1edea9d11f026cebdd15/lava_callback.json.gz 2026-05-05 16:48:13,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:14,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1edea9d11f026cebdd15 HTTP/1.1" 200 None 2026-05-05 16:48:14,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:14,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:14,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:14,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:14,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1edea9d11f026cebdd15 HTTP/1.1" 200 None 2026-05-05 16:48:14,191 - lava_callback - INFO - Completed processing callback for node 69fa1edea9d11f026cebdd15 2026-05-05 16:48:14,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:14,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef3a9d11f026cebdd6f/log.txt.gz 2026-05-05 16:48:14,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:14,799 - lava_callback - INFO - Received callback for node 69fa1ee6a9d11f026cebdd2d INFO: 172.21.0.1:41534 - "POST /node/69fa1ee6a9d11f026cebdd2d HTTP/1.0" 202 Accepted 2026-05-05 16:48:14,807 - lava_callback - INFO - Starting async job submit for node 69fa1ee6a9d11f026cebdd2d 2026-05-05 16:48:14,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:14,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:14,835 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef3a9d11f026cebdd6f/lava-logs.yaml 2026-05-05 16:48:14,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:14,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee6a9d11f026cebdd2d HTTP/1.1" 200 None 2026-05-05 16:48:14,855 - lava_callback - DEBUG - Processing node 69fa1ee6a9d11f026cebdd2d: baseline-arm64 2026-05-05 16:48:15,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:15,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef3a9d11f026cebdd6f/lava_callback.json.gz 2026-05-05 16:48:15,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:41550 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-05 16:48:15,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef3a9d11f026cebdd6f HTTP/1.1" 200 None 2026-05-05 16:48:15,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:15,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:15,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:15,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ef3a9d11f026cebdd6f HTTP/1.1" 200 None 2026-05-05 16:48:15,451 - lava_callback - INFO - Completed processing callback for node 69fa1ef3a9d11f026cebdd6f 2026-05-05 16:48:15,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:15,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:15,590 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee6a9d11f026cebdd2d/log.txt.gz 2026-05-05 16:48:15,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:16,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:16,053 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee6a9d11f026cebdd2d/lava-logs.yaml 2026-05-05 16:48:16,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:16,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:16,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee6a9d11f026cebdd2d/lava_callback.json.gz 2026-05-05 16:48:16,221 - lava_callback - INFO - Received callback for node 69fa1ef9a9d11f026cebdd7e INFO: 172.21.0.1:41556 - "POST /node/69fa1ef9a9d11f026cebdd7e HTTP/1.0" 202 Accepted 2026-05-05 16:48:16,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:16,228 - lava_callback - INFO - Starting async job submit for node 69fa1ef9a9d11f026cebdd7e 2026-05-05 16:48:16,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:16,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee6a9d11f026cebdd2d HTTP/1.1" 200 None 2026-05-05 16:48:16,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:16,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef9a9d11f026cebdd7e HTTP/1.1" 200 None 2026-05-05 16:48:16,276 - lava_callback - DEBUG - Processing node 69fa1ef9a9d11f026cebdd7e: baseline-nfs-arm64 2026-05-05 16:48:16,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:16,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:16,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ee6a9d11f026cebdd2d HTTP/1.1" 200 None 2026-05-05 16:48:16,529 - lava_callback - INFO - Completed processing callback for node 69fa1ee6a9d11f026cebdd2d INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:48:16,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:16,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:16,828 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef9a9d11f026cebdd7e/log.txt.gz 2026-05-05 16:48:17,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:17,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:17,159 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef9a9d11f026cebdd7e/lava-logs.yaml 2026-05-05 16:48:17,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:17,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:17,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef9a9d11f026cebdd7e/lava_callback.json.gz 2026-05-05 16:48:17,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:17,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef9a9d11f026cebdd7e HTTP/1.1" 200 None 2026-05-05 16:48:17,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:17,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:17,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:17,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ef9a9d11f026cebdd7e HTTP/1.1" 200 None 2026-05-05 16:48:17,330 - lava_callback - INFO - Completed processing callback for node 69fa1ef9a9d11f026cebdd7e 2026-05-05 16:48:22,030 - lava_callback - INFO - Received callback for node 69f77c51096243809b56c1a1 INFO: 172.21.0.1:45464 - "POST /node/69f77c51096243809b56c1a1 HTTP/1.0" 202 Accepted 2026-05-05 16:48:22,038 - lava_callback - INFO - Starting async job submit for node 69f77c51096243809b56c1a1 2026-05-05 16:48:22,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:22,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c51096243809b56c1a1 HTTP/1.1" 200 None 2026-05-05 16:48:22,053 - lava_callback - DEBUG - Processing node 69f77c51096243809b56c1a1: baseline-arm-clabbe 2026-05-05 16:48:22,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77c51096243809b56c1a1 2026-05-05 16:48:22,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:22,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c51096243809b56c1a1 HTTP/1.1" 200 None 2026-05-05 16:48:22,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:22,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 16:48:22,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:22,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77c51096243809b56c1a1 HTTP/1.1" 200 None 2026-05-05 16:48:22,116 - lava_callback - ERROR - Error processing callback for node 69f77c51096243809b56c1a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:48:23,366 - lava_callback - INFO - Received callback for node 69fa1f1fa9d11f026cebde0a INFO: 172.21.0.1:45466 - "POST /node/69fa1f1fa9d11f026cebde0a HTTP/1.0" 202 Accepted 2026-05-05 16:48:23,377 - lava_callback - INFO - Starting async job submit for node 69fa1f1fa9d11f026cebde0a 2026-05-05 16:48:23,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:23,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f1fa9d11f026cebde0a HTTP/1.1" 200 None 2026-05-05 16:48:23,415 - lava_callback - DEBUG - Processing node 69fa1f1fa9d11f026cebde0a: baseline-arm64-foundriesio 2026-05-05 16:48:23,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:23,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:23,886 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fa1f1fa9d11f026cebde0a/log.txt.gz 2026-05-05 16:48:24,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:24,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:24,174 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fa1f1fa9d11f026cebde0a/lava-logs.yaml 2026-05-05 16:48:24,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:24,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:24,264 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fa1f1fa9d11f026cebde0a/lava_callback.json.gz 2026-05-05 16:48:24,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:24,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f1fa9d11f026cebde0a HTTP/1.1" 200 None 2026-05-05 16:48:24,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:24,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:24,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:24,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f1fa9d11f026cebde0a HTTP/1.1" 200 None 2026-05-05 16:48:24,349 - lava_callback - INFO - Completed processing callback for node 69fa1f1fa9d11f026cebde0a INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:48:31,053 - lava_callback - INFO - Received callback for node 69fa1eeea9d11f026cebdd5f INFO: 172.21.0.1:58306 - "POST /node/69fa1eeea9d11f026cebdd5f HTTP/1.0" 202 Accepted 2026-05-05 16:48:31,059 - lava_callback - INFO - Starting async job submit for node 69fa1eeea9d11f026cebdd5f 2026-05-05 16:48:31,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:31,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eeea9d11f026cebdd5f HTTP/1.1" 200 None 2026-05-05 16:48:31,096 - lava_callback - DEBUG - Processing node 69fa1eeea9d11f026cebdd5f: baseline-nfs-arm64 2026-05-05 16:48:31,424 - lava_callback - INFO - Received callback for node 69fa1ef7a9d11f026cebdd7b INFO: 172.21.0.1:58320 - "POST /node/69fa1ef7a9d11f026cebdd7b HTTP/1.0" 202 Accepted 2026-05-05 16:48:31,431 - lava_callback - INFO - Starting async job submit for node 69fa1ef7a9d11f026cebdd7b 2026-05-05 16:48:31,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:31,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:31,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef7a9d11f026cebdd7b HTTP/1.1" 200 None 2026-05-05 16:48:31,469 - lava_callback - DEBUG - Processing node 69fa1ef7a9d11f026cebdd7b: baseline-nfs-arm64 2026-05-05 16:48:31,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:31,681 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1eeea9d11f026cebdd5f/log.txt.gz 2026-05-05 16:48:31,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:31,984 - lava_callback - INFO - Received callback for node 69fa1f1da9d11f026cebde04 INFO: 172.21.0.1:58330 - "POST /node/69fa1f1da9d11f026cebde04 HTTP/1.0" 202 Accepted 2026-05-05 16:48:31,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:31,990 - lava_callback - INFO - Starting async job submit for node 69fa1f1da9d11f026cebde04 2026-05-05 16:48:32,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:32,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f1da9d11f026cebde04 HTTP/1.1" 200 None 2026-05-05 16:48:32,025 - lava_callback - DEBUG - Processing node 69fa1f1da9d11f026cebde04: baseline-arm64-pengutronix 2026-05-05 16:48:32,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:32,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:32,322 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fa1f1da9d11f026cebde04/log.txt.gz 2026-05-05 16:48:32,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:32,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef7a9d11f026cebdd7b/log.txt.gz 2026-05-05 16:48:32,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:32,543 - lava_callback - INFO - Received callback for node 69fa1efaa9d11f026cebdd81 2026-05-05 16:48:32,564 - lava_callback - INFO - Starting async job submit for node 69fa1efaa9d11f026cebdd81 2026-05-05 16:48:32,574 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1eeea9d11f026cebdd5f/lava-logs.yaml INFO: 172.21.0.1:58338 - "POST /node/69fa1efaa9d11f026cebdd81 HTTP/1.0" 202 Accepted 2026-05-05 16:48:32,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:32,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:32,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:32,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1efaa9d11f026cebdd81 HTTP/1.1" 200 None 2026-05-05 16:48:32,699 - lava_callback - DEBUG - Processing node 69fa1efaa9d11f026cebdd81: baseline-nfs-arm64 2026-05-05 16:48:32,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:32,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:32,866 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fa1f1da9d11f026cebde04/lava-logs.yaml 2026-05-05 16:48:32,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:32,929 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1eeea9d11f026cebdd5f/lava_callback.json.gz 2026-05-05 16:48:33,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:33,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:33,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:33,098 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef7a9d11f026cebdd7b/lava-logs.yaml 2026-05-05 16:48:33,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eeea9d11f026cebdd5f HTTP/1.1" 200 None 2026-05-05 16:48:33,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:33,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:33,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:33,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:33,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:33,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1eeea9d11f026cebdd5f HTTP/1.1" 200 None 2026-05-05 16:48:33,231 - lava_callback - INFO - Completed processing callback for node 69fa1eeea9d11f026cebdd5f 2026-05-05 16:48:33,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:33,255 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fa1f1da9d11f026cebde04/lava_callback.json.gz 2026-05-05 16:48:33,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:33,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f1da9d11f026cebde04 HTTP/1.1" 200 None 2026-05-05 16:48:33,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:33,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:33,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:33,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f1da9d11f026cebde04 HTTP/1.1" 200 None 2026-05-05 16:48:33,406 - lava_callback - INFO - Completed processing callback for node 69fa1f1da9d11f026cebde04 2026-05-05 16:48:33,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:33,451 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1efaa9d11f026cebdd81/log.txt.gz 2026-05-05 16:48:33,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:33,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef7a9d11f026cebdd7b/lava_callback.json.gz 2026-05-05 16:48:33,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:33,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef7a9d11f026cebdd7b HTTP/1.1" 200 None 2026-05-05 16:48:33,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:33,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:33,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:33,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:33,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ef7a9d11f026cebdd7b HTTP/1.1" 200 None 2026-05-05 16:48:33,812 - lava_callback - INFO - Completed processing callback for node 69fa1ef7a9d11f026cebdd7b 2026-05-05 16:48:33,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:33,944 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1efaa9d11f026cebdd81/lava-logs.yaml 2026-05-05 16:48:33,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:34,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:34,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1efaa9d11f026cebdd81/lava_callback.json.gz 2026-05-05 16:48:34,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:34,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1efaa9d11f026cebdd81 HTTP/1.1" 200 None 2026-05-05 16:48:34,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:34,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:34,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:34,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1efaa9d11f026cebdd81 HTTP/1.1" 200 None 2026-05-05 16:48:34,151 - lava_callback - INFO - Completed processing callback for node 69fa1efaa9d11f026cebdd81 2026-05-05 16:48:36,117 - lava_callback - INFO - Received callback for node 69fa1f56a9d11f026cebdeb1 INFO: 172.21.0.1:58354 - "POST /node/69fa1f56a9d11f026cebdeb1 HTTP/1.0" 202 Accepted 2026-05-05 16:48:36,122 - lava_callback - INFO - Starting async job submit for node 69fa1f56a9d11f026cebdeb1 2026-05-05 16:48:36,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:36,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f56a9d11f026cebdeb1 HTTP/1.1" 200 None 2026-05-05 16:48:36,140 - lava_callback - DEBUG - Processing node 69fa1f56a9d11f026cebdeb1: baseline-nfs-arm64 2026-05-05 16:48:36,141 - lava_callback - WARNING - Failed to upload log 2026-05-05 16:48:36,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:36,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:36,216 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1f56a9d11f026cebdeb1/lava-logs.yaml 2026-05-05 16:48:36,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:36,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:36,310 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1f56a9d11f026cebdeb1/lava_callback.json.gz 2026-05-05 16:48:36,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:36,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f56a9d11f026cebdeb1 HTTP/1.1" 200 None 2026-05-05 16:48:36,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:36,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:36,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:36,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f56a9d11f026cebdeb1 HTTP/1.1" 200 None 2026-05-05 16:48:36,380 - lava_callback - INFO - Completed processing callback for node 69fa1f56a9d11f026cebdeb1 INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:48:39,525 - lava_callback - INFO - Received callback for node 69fa1ef6a9d11f026cebdd78 INFO: 172.21.0.1:58362 - "POST /node/69fa1ef6a9d11f026cebdd78 HTTP/1.0" 202 Accepted 2026-05-05 16:48:39,532 - lava_callback - INFO - Starting async job submit for node 69fa1ef6a9d11f026cebdd78 2026-05-05 16:48:39,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:39,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef6a9d11f026cebdd78 HTTP/1.1" 200 None 2026-05-05 16:48:39,586 - lava_callback - DEBUG - Processing node 69fa1ef6a9d11f026cebdd78: baseline-nfs-arm64 2026-05-05 16:48:40,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:40,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:40,189 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef6a9d11f026cebdd78/log.txt.gz 2026-05-05 16:48:40,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:40,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:40,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef6a9d11f026cebdd78/lava-logs.yaml 2026-05-05 16:48:40,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:40,674 - lava_callback - INFO - Received callback for node 69fa1f1ea9d11f026cebde07 INFO: 172.21.0.1:53024 - "POST /node/69fa1f1ea9d11f026cebde07 HTTP/1.0" 202 Accepted 2026-05-05 16:48:40,683 - lava_callback - INFO - Starting async job submit for node 69fa1f1ea9d11f026cebde07 2026-05-05 16:48:40,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:40,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:40,731 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef6a9d11f026cebdd78/lava_callback.json.gz 2026-05-05 16:48:40,754 - lava_callback - INFO - Received callback for node 69fa1ef1a9d11f026cebdd65 2026-05-05 16:48:40,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f1ea9d11f026cebde07 HTTP/1.1" 200 None INFO: 172.21.0.1:53028 - "POST /node/69fa1ef1a9d11f026cebdd65 HTTP/1.0" 202 Accepted 2026-05-05 16:48:40,770 - lava_callback - INFO - Starting async job submit for node 69fa1ef1a9d11f026cebdd65 2026-05-05 16:48:40,788 - lava_callback - DEBUG - Processing node 69fa1f1ea9d11f026cebde07: baseline-arm64-pengutronix 2026-05-05 16:48:40,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:40,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:40,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef1a9d11f026cebdd65 HTTP/1.1" 200 None 2026-05-05 16:48:40,966 - lava_callback - DEBUG - Processing node 69fa1ef1a9d11f026cebdd65: baseline-nfs-arm64 2026-05-05 16:48:41,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef6a9d11f026cebdd78 HTTP/1.1" 200 None 2026-05-05 16:48:41,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:41,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:41,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:41,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ef6a9d11f026cebdd78 HTTP/1.1" 200 None 2026-05-05 16:48:41,314 - lava_callback - INFO - Completed processing callback for node 69fa1ef6a9d11f026cebdd78 2026-05-05 16:48:41,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:41,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:41,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-05 16:48:41,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:41,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fa1f1ea9d11f026cebde07/log.txt.gz 2026-05-05 16:48:41,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:41,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:42,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:42,015 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef1a9d11f026cebdd65/log.txt.gz 2026-05-05 16:48:42,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:42,147 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fa1f1ea9d11f026cebde07/lava-logs.yaml 2026-05-05 16:48:42,169 - lava_callback - INFO - Received callback for node 69fa1f06a9d11f026cebdda0 INFO: 172.21.0.1:53030 - "POST /node/69fa1f06a9d11f026cebdda0 HTTP/1.0" 202 Accepted 2026-05-05 16:48:42,196 - lava_callback - INFO - Starting async job submit for node 69fa1f06a9d11f026cebdda0 2026-05-05 16:48:42,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:42,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:42,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f06a9d11f026cebdda0 HTTP/1.1" 200 None 2026-05-05 16:48:42,331 - lava_callback - DEBUG - Processing node 69fa1f06a9d11f026cebdda0: baseline-arm64-broonie 2026-05-05 16:48:42,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:42,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:42,559 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69fa1f1ea9d11f026cebde07/lava_callback.json.gz 2026-05-05 16:48:42,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:42,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:42,679 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef1a9d11f026cebdd65/lava-logs.yaml 2026-05-05 16:48:42,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:42,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:42,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f1ea9d11f026cebde07 HTTP/1.1" 200 None 2026-05-05 16:48:42,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:42,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:42,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:42,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:42,820 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f06a9d11f026cebdda0/log.txt.gz 2026-05-05 16:48:42,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:42,887 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef1a9d11f026cebdd65/lava_callback.json.gz 2026-05-05 16:48:42,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f1ea9d11f026cebde07 HTTP/1.1" 200 None 2026-05-05 16:48:42,949 - lava_callback - INFO - Completed processing callback for node 69fa1f1ea9d11f026cebde07 2026-05-05 16:48:42,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:43,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef1a9d11f026cebdd65 HTTP/1.1" 200 None 2026-05-05 16:48:43,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:43,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:43,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:43,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:43,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ef1a9d11f026cebdd65 HTTP/1.1" 200 None 2026-05-05 16:48:43,217 - lava_callback - INFO - Completed processing callback for node 69fa1ef1a9d11f026cebdd65 INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:48:43,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:43,403 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f06a9d11f026cebdda0/lava-logs.yaml 2026-05-05 16:48:43,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:43,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:43,528 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f06a9d11f026cebdda0/lava_callback.json.gz 2026-05-05 16:48:43,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:43,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f06a9d11f026cebdda0 HTTP/1.1" 200 None 2026-05-05 16:48:43,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:43,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:43,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:43,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f06a9d11f026cebdda0 HTTP/1.1" 200 None 2026-05-05 16:48:43,654 - lava_callback - INFO - Completed processing callback for node 69fa1f06a9d11f026cebdda0 2026-05-05 16:48:43,729 - lava_callback - INFO - Received callback for node 69fa1f0da9d11f026cebddd0 INFO: 172.21.0.1:53054 - "POST /node/69fa1f0da9d11f026cebddd0 HTTP/1.0" 202 Accepted 2026-05-05 16:48:43,747 - lava_callback - INFO - Starting async job submit for node 69fa1f0da9d11f026cebddd0 2026-05-05 16:48:43,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:43,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f0da9d11f026cebddd0 HTTP/1.1" 200 None 2026-05-05 16:48:43,837 - lava_callback - DEBUG - Processing node 69fa1f0da9d11f026cebddd0: baseline-arm64-broonie 2026-05-05 16:48:44,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:44,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:44,338 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0da9d11f026cebddd0/log.txt.gz 2026-05-05 16:48:44,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:44,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:44,677 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0da9d11f026cebddd0/lava-logs.yaml 2026-05-05 16:48:44,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:44,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:44,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0da9d11f026cebddd0/lava_callback.json.gz 2026-05-05 16:48:44,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:44,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f0da9d11f026cebddd0 HTTP/1.1" 200 None 2026-05-05 16:48:44,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:44,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:44,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:44,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f0da9d11f026cebddd0 HTTP/1.1" 200 None 2026-05-05 16:48:44,920 - lava_callback - INFO - Completed processing callback for node 69fa1f0da9d11f026cebddd0 INFO: 172.21.0.1:53060 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:48:48,847 - lava_callback - INFO - Received callback for node 69fa1f11a9d11f026cebdde1 INFO: 172.21.0.1:53068 - "POST /node/69fa1f11a9d11f026cebdde1 HTTP/1.0" 202 Accepted 2026-05-05 16:48:48,855 - lava_callback - INFO - Starting async job submit for node 69fa1f11a9d11f026cebdde1 2026-05-05 16:48:48,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:48,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f11a9d11f026cebdde1 HTTP/1.1" 200 None 2026-05-05 16:48:48,897 - lava_callback - DEBUG - Processing node 69fa1f11a9d11f026cebdde1: baseline-arm64-broonie 2026-05-05 16:48:49,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:49,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:49,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f11a9d11f026cebdde1/log.txt.gz 2026-05-05 16:48:49,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:49,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:49,695 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f11a9d11f026cebdde1/lava-logs.yaml 2026-05-05 16:48:49,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:48:49,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:48:49,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f11a9d11f026cebdde1/lava_callback.json.gz 2026-05-05 16:48:49,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:49,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f11a9d11f026cebdde1 HTTP/1.1" 200 None 2026-05-05 16:48:49,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:49,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:48:49,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:48:49,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f11a9d11f026cebdde1 HTTP/1.1" 200 None 2026-05-05 16:48:49,901 - lava_callback - INFO - Completed processing callback for node 69fa1f11a9d11f026cebdde1 INFO: 172.21.0.1:51256 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:49:00,345 - lava_callback - INFO - Received callback for node 69fa1f1ba9d11f026cebddfe INFO: 172.21.0.1:45588 - "POST /node/69fa1f1ba9d11f026cebddfe HTTP/1.0" 202 Accepted 2026-05-05 16:49:00,354 - lava_callback - INFO - Starting async job submit for node 69fa1f1ba9d11f026cebddfe 2026-05-05 16:49:00,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:00,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f1ba9d11f026cebddfe HTTP/1.1" 200 None 2026-05-05 16:49:00,398 - lava_callback - DEBUG - Processing node 69fa1f1ba9d11f026cebddfe: baseline-arm64-kontron 2026-05-05 16:49:00,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:00,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:00,821 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fa1f1ba9d11f026cebddfe/log.txt.gz 2026-05-05 16:49:01,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:01,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:01,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fa1f1ba9d11f026cebddfe/lava-logs.yaml 2026-05-05 16:49:01,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:01,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:01,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69fa1f1ba9d11f026cebddfe/lava_callback.json.gz 2026-05-05 16:49:01,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:01,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f1ba9d11f026cebddfe HTTP/1.1" 200 None 2026-05-05 16:49:01,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:01,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:49:01,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:01,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f1ba9d11f026cebddfe HTTP/1.1" 200 None 2026-05-05 16:49:01,422 - lava_callback - INFO - Completed processing callback for node 69fa1f1ba9d11f026cebddfe 2026-05-05 16:49:02,047 - lava_callback - INFO - Received callback for node 69f77c76096243809b56c1d5 INFO: 172.21.0.1:45594 - "POST /node/69f77c76096243809b56c1d5 HTTP/1.0" 202 Accepted 2026-05-05 16:49:02,054 - lava_callback - INFO - Starting async job submit for node 69f77c76096243809b56c1d5 2026-05-05 16:49:02,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:02,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c76096243809b56c1d5 HTTP/1.1" 200 None 2026-05-05 16:49:02,081 - lava_callback - DEBUG - Processing node 69f77c76096243809b56c1d5: baseline-arm-clabbe 2026-05-05 16:49:02,081 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77c76096243809b56c1d5 2026-05-05 16:49:02,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:02,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c76096243809b56c1d5 HTTP/1.1" 200 None 2026-05-05 16:49:02,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:02,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 16:49:02,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:02,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77c76096243809b56c1d5 HTTP/1.1" 200 None 2026-05-05 16:49:02,137 - lava_callback - ERROR - Error processing callback for node 69f77c76096243809b56c1d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:49:08,462 - lava_callback - INFO - Received callback for node 69fa1f0ba9d11f026cebdda9 INFO: 172.21.0.1:45612 - "POST /node/69fa1f0ba9d11f026cebdda9 HTTP/1.0" 202 Accepted 2026-05-05 16:49:08,469 - lava_callback - INFO - Starting async job submit for node 69fa1f0ba9d11f026cebdda9 2026-05-05 16:49:08,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:08,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f0ba9d11f026cebdda9 HTTP/1.1" 200 None 2026-05-05 16:49:08,510 - lava_callback - DEBUG - Processing node 69fa1f0ba9d11f026cebdda9: baseline-arm64-broonie 2026-05-05 16:49:08,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:08,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:08,975 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0ba9d11f026cebdda9/log.txt.gz 2026-05-05 16:49:09,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:09,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:09,332 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0ba9d11f026cebdda9/lava-logs.yaml 2026-05-05 16:49:09,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:09,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:09,444 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0ba9d11f026cebdda9/lava_callback.json.gz 2026-05-05 16:49:09,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:09,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f0ba9d11f026cebdda9 HTTP/1.1" 200 None 2026-05-05 16:49:09,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:09,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:49:09,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:09,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f0ba9d11f026cebdda9 HTTP/1.1" 200 None 2026-05-05 16:49:09,530 - lava_callback - INFO - Completed processing callback for node 69fa1f0ba9d11f026cebdda9 2026-05-05 16:49:09,914 - lava_callback - INFO - Received callback for node 69fa1f0fa9d11f026cebddde INFO: 172.21.0.1:46592 - "POST /node/69fa1f0fa9d11f026cebddde HTTP/1.0" 202 Accepted 2026-05-05 16:49:09,922 - lava_callback - INFO - Starting async job submit for node 69fa1f0fa9d11f026cebddde 2026-05-05 16:49:09,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:09,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f0fa9d11f026cebddde HTTP/1.1" 200 None 2026-05-05 16:49:09,970 - lava_callback - DEBUG - Processing node 69fa1f0fa9d11f026cebddde: baseline-arm64-broonie 2026-05-05 16:49:10,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:10,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:10,401 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0fa9d11f026cebddde/log.txt.gz 2026-05-05 16:49:10,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:10,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:10,699 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0fa9d11f026cebddde/lava-logs.yaml 2026-05-05 16:49:10,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:10,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:10,835 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0fa9d11f026cebddde/lava_callback.json.gz 2026-05-05 16:49:10,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:10,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f0fa9d11f026cebddde HTTP/1.1" 200 None 2026-05-05 16:49:10,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:10,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:49:10,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:10,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f0fa9d11f026cebddde HTTP/1.1" 200 None 2026-05-05 16:49:10,962 - lava_callback - INFO - Completed processing callback for node 69fa1f0fa9d11f026cebddde 2026-05-05 16:49:11,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:11,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:46608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:49:20,913 - lava_callback - INFO - Received callback for node 69fa1f12a9d11f026cebdde4 INFO: 172.21.0.1:58524 - "POST /node/69fa1f12a9d11f026cebdde4 HTTP/1.0" 202 Accepted 2026-05-05 16:49:20,920 - lava_callback - INFO - Starting async job submit for node 69fa1f12a9d11f026cebdde4 2026-05-05 16:49:20,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:20,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f12a9d11f026cebdde4 HTTP/1.1" 200 None 2026-05-05 16:49:20,967 - lava_callback - DEBUG - Processing node 69fa1f12a9d11f026cebdde4: baseline-arm64-broonie 2026-05-05 16:49:21,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:21,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:21,389 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f12a9d11f026cebdde4/log.txt.gz 2026-05-05 16:49:21,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:21,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:21,724 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f12a9d11f026cebdde4/lava-logs.yaml 2026-05-05 16:49:21,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:21,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:21,840 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f12a9d11f026cebdde4/lava_callback.json.gz 2026-05-05 16:49:21,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:21,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f12a9d11f026cebdde4 HTTP/1.1" 200 None 2026-05-05 16:49:21,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:21,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:49:21,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:21,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f12a9d11f026cebdde4 HTTP/1.1" 200 None 2026-05-05 16:49:21,941 - lava_callback - INFO - Completed processing callback for node 69fa1f12a9d11f026cebdde4 2026-05-05 16:49:23,818 - lava_callback - INFO - Received callback for node 69fa1f17a9d11f026cebddf3 INFO: 172.21.0.1:58530 - "POST /node/69fa1f17a9d11f026cebddf3 HTTP/1.0" 202 Accepted 2026-05-05 16:49:23,828 - lava_callback - INFO - Starting async job submit for node 69fa1f17a9d11f026cebddf3 2026-05-05 16:49:23,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:23,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f17a9d11f026cebddf3 HTTP/1.1" 200 None 2026-05-05 16:49:23,879 - lava_callback - DEBUG - Processing node 69fa1f17a9d11f026cebddf3: baseline-arm64-clabbe 2026-05-05 16:49:24,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:24,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:24,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fa1f17a9d11f026cebddf3/log.txt.gz 2026-05-05 16:49:24,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:24,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:24,530 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fa1f17a9d11f026cebddf3/lava-logs.yaml 2026-05-05 16:49:24,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:24,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:24,618 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69fa1f17a9d11f026cebddf3/lava_callback.json.gz 2026-05-05 16:49:24,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:24,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f17a9d11f026cebddf3 HTTP/1.1" 200 None 2026-05-05 16:49:24,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:24,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:49:24,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:24,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f17a9d11f026cebddf3 HTTP/1.1" 200 None 2026-05-05 16:49:24,721 - lava_callback - INFO - Completed processing callback for node 69fa1f17a9d11f026cebddf3 2026-05-05 16:49:25,477 - lava_callback - INFO - Received callback for node 69fa1ef4a9d11f026cebdd72 INFO: 172.21.0.1:58544 - "POST /node/69fa1ef4a9d11f026cebdd72 HTTP/1.0" 202 Accepted 2026-05-05 16:49:25,485 - lava_callback - INFO - Starting async job submit for node 69fa1ef4a9d11f026cebdd72 2026-05-05 16:49:25,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:25,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef4a9d11f026cebdd72 HTTP/1.1" 200 None 2026-05-05 16:49:25,538 - lava_callback - DEBUG - Processing node 69fa1ef4a9d11f026cebdd72: baseline-nfs-arm64 2026-05-05 16:49:26,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:26,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:26,469 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef4a9d11f026cebdd72/log.txt.gz INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:49:26,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:27,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:27,094 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef4a9d11f026cebdd72/lava-logs.yaml 2026-05-05 16:49:27,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:27,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:27,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef4a9d11f026cebdd72/lava_callback.json.gz 2026-05-05 16:49:27,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:27,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef4a9d11f026cebdd72 HTTP/1.1" 200 None 2026-05-05 16:49:27,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:27,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:49:27,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:27,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ef4a9d11f026cebdd72 HTTP/1.1" 200 None 2026-05-05 16:49:27,468 - lava_callback - INFO - Completed processing callback for node 69fa1ef4a9d11f026cebdd72 INFO: 172.21.0.1:56930 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:49:38,174 - lava_callback - INFO - Received callback for node 69f77c95096243809b56c250 INFO: 172.21.0.1:56932 - "POST /node/69f77c95096243809b56c250 HTTP/1.0" 202 Accepted 2026-05-05 16:49:38,180 - lava_callback - INFO - Starting async job submit for node 69f77c95096243809b56c250 2026-05-05 16:49:38,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:38,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c95096243809b56c250 HTTP/1.1" 200 None 2026-05-05 16:49:38,195 - lava_callback - DEBUG - Processing node 69f77c95096243809b56c250: baseline-arm64-baylibre 2026-05-05 16:49:38,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77c95096243809b56c250 2026-05-05 16:49:38,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:38,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c95096243809b56c250 HTTP/1.1" 200 None 2026-05-05 16:49:38,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:38,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 16:49:38,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:38,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77c95096243809b56c250 HTTP/1.1" 200 None 2026-05-05 16:49:38,277 - lava_callback - ERROR - Error processing callback for node 69f77c95096243809b56c250: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:49:38,862 - lava_callback - INFO - Received callback for node 69f77c97096243809b56c253 INFO: 172.21.0.1:56940 - "POST /node/69f77c97096243809b56c253 HTTP/1.0" 202 Accepted 2026-05-05 16:49:38,877 - lava_callback - INFO - Starting async job submit for node 69f77c97096243809b56c253 2026-05-05 16:49:38,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:38,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c97096243809b56c253 HTTP/1.1" 200 None 2026-05-05 16:49:38,921 - lava_callback - DEBUG - Processing node 69f77c97096243809b56c253: baseline-arm64-baylibre 2026-05-05 16:49:38,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77c97096243809b56c253 2026-05-05 16:49:38,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:38,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c97096243809b56c253 HTTP/1.1" 200 None 2026-05-05 16:49:38,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:38,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 16:49:38,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:38,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77c97096243809b56c253 HTTP/1.1" 200 None 2026-05-05 16:49:38,971 - lava_callback - ERROR - Error processing callback for node 69f77c97096243809b56c253: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:49:41,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:41,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-05 16:49:42,119 - lava_callback - INFO - Received callback for node 69f77c9c096243809b56c25c INFO: 172.21.0.1:45636 - "POST /node/69f77c9c096243809b56c25c HTTP/1.0" 202 Accepted 2026-05-05 16:49:42,125 - lava_callback - INFO - Starting async job submit for node 69f77c9c096243809b56c25c 2026-05-05 16:49:42,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:42,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c9c096243809b56c25c HTTP/1.1" 200 None 2026-05-05 16:49:42,140 - lava_callback - DEBUG - Processing node 69f77c9c096243809b56c25c: baseline-arm-clabbe 2026-05-05 16:49:42,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77c9c096243809b56c25c 2026-05-05 16:49:42,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:42,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77c9c096243809b56c25c HTTP/1.1" 200 None 2026-05-05 16:49:42,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:42,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 16:49:42,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:42,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77c9c096243809b56c25c HTTP/1.1" 200 None 2026-05-05 16:49:42,186 - lava_callback - ERROR - Error processing callback for node 69f77c9c096243809b56c25c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45644 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:49:46,789 - lava_callback - INFO - Received callback for node 69fa1fa4a9d11f026cebdf71 INFO: 172.21.0.1:45650 - "POST /node/69fa1fa4a9d11f026cebdf71 HTTP/1.0" 202 Accepted 2026-05-05 16:49:46,796 - lava_callback - INFO - Starting async job submit for node 69fa1fa4a9d11f026cebdf71 2026-05-05 16:49:46,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:46,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa4a9d11f026cebdf71 HTTP/1.1" 200 None 2026-05-05 16:49:46,820 - lava_callback - DEBUG - Processing node 69fa1fa4a9d11f026cebdf71: baseline-arm 2026-05-05 16:49:46,828 - lava_callback - WARNING - Failed to upload log 2026-05-05 16:49:46,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:46,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:46,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa4a9d11f026cebdf71/lava-logs.yaml 2026-05-05 16:49:46,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:49:47,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:49:47,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa4a9d11f026cebdf71/lava_callback.json.gz 2026-05-05 16:49:47,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:47,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa4a9d11f026cebdf71 HTTP/1.1" 200 None 2026-05-05 16:49:47,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:47,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:49:47,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:49:47,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fa4a9d11f026cebdf71 HTTP/1.1" 200 None 2026-05-05 16:49:47,095 - lava_callback - INFO - Completed processing callback for node 69fa1fa4a9d11f026cebdf71 INFO: 172.21.0.1:48636 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:50:00,833 - lava_callback - INFO - Received callback for node 69fa1f07a9d11f026cebdda3 INFO: 172.21.0.1:36262 - "POST /node/69fa1f07a9d11f026cebdda3 HTTP/1.0" 202 Accepted 2026-05-05 16:50:00,864 - lava_callback - INFO - Starting async job submit for node 69fa1f07a9d11f026cebdda3 2026-05-05 16:50:00,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:00,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f07a9d11f026cebdda3 HTTP/1.1" 200 None 2026-05-05 16:50:00,949 - lava_callback - DEBUG - Processing node 69fa1f07a9d11f026cebdda3: baseline-arm64-broonie 2026-05-05 16:50:01,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:01,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:01,480 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f07a9d11f026cebdda3/log.txt.gz 2026-05-05 16:50:01,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:01,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:01,910 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f07a9d11f026cebdda3/lava-logs.yaml 2026-05-05 16:50:01,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:02,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:02,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f07a9d11f026cebdda3/lava_callback.json.gz 2026-05-05 16:50:02,088 - lava_callback - INFO - Received callback for node 69f77ca7096243809b56c27e INFO: 172.21.0.1:36268 - "POST /node/69f77ca7096243809b56c27e HTTP/1.0" 202 Accepted 2026-05-05 16:50:02,110 - lava_callback - INFO - Starting async job submit for node 69f77ca7096243809b56c27e 2026-05-05 16:50:02,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:02,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:02,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77ca7096243809b56c27e HTTP/1.1" 200 None 2026-05-05 16:50:02,169 - lava_callback - DEBUG - Processing node 69f77ca7096243809b56c27e: baseline-arm64-clabbe 2026-05-05 16:50:02,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77ca7096243809b56c27e 2026-05-05 16:50:02,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:02,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f07a9d11f026cebdda3 HTTP/1.1" 200 None 2026-05-05 16:50:02,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:02,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77ca7096243809b56c27e HTTP/1.1" 200 None 2026-05-05 16:50:02,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:02,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:50:02,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:02,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 16:50:02,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:02,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f07a9d11f026cebdda3 HTTP/1.1" 200 None 2026-05-05 16:50:02,272 - lava_callback - INFO - Completed processing callback for node 69fa1f07a9d11f026cebdda3 2026-05-05 16:50:02,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77ca7096243809b56c27e HTTP/1.1" 200 None 2026-05-05 16:50:02,274 - lava_callback - ERROR - Error processing callback for node 69f77ca7096243809b56c27e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:50:02,816 - lava_callback - INFO - Received callback for node 69f77ca8096243809b56c281 INFO: 172.21.0.1:36272 - "POST /node/69f77ca8096243809b56c281 HTTP/1.0" 202 Accepted 2026-05-05 16:50:02,826 - lava_callback - INFO - Starting async job submit for node 69f77ca8096243809b56c281 2026-05-05 16:50:02,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:02,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77ca8096243809b56c281 HTTP/1.1" 200 None 2026-05-05 16:50:02,852 - lava_callback - DEBUG - Processing node 69f77ca8096243809b56c281: baseline-arm64-clabbe 2026-05-05 16:50:02,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77ca8096243809b56c281 2026-05-05 16:50:02,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:02,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77ca8096243809b56c281 HTTP/1.1" 200 None 2026-05-05 16:50:02,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:02,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 16:50:02,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:02,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77ca8096243809b56c281 HTTP/1.1" 200 None 2026-05-05 16:50:02,928 - lava_callback - ERROR - Error processing callback for node 69f77ca8096243809b56c281: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:50:04,202 - lava_callback - INFO - Received callback for node 69f77ca9096243809b56c2af INFO: 172.21.0.1:36288 - "POST /node/69f77ca9096243809b56c2af HTTP/1.0" 202 Accepted 2026-05-05 16:50:04,213 - lava_callback - INFO - Starting async job submit for node 69f77ca9096243809b56c2af 2026-05-05 16:50:04,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:04,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77ca9096243809b56c2af HTTP/1.1" 200 None 2026-05-05 16:50:04,257 - lava_callback - DEBUG - Processing node 69f77ca9096243809b56c2af: baseline-arm64-clabbe 2026-05-05 16:50:04,257 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77ca9096243809b56c2af 2026-05-05 16:50:04,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:04,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77ca9096243809b56c2af HTTP/1.1" 200 None 2026-05-05 16:50:04,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:04,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 16:50:04,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:04,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77ca9096243809b56c2af HTTP/1.1" 200 None 2026-05-05 16:50:04,417 - lava_callback - ERROR - Error processing callback for node 69f77ca9096243809b56c2af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:50:05,011 - lava_callback - INFO - Received callback for node 69f77caa096243809b56c2b2 INFO: 172.21.0.1:36294 - "POST /node/69f77caa096243809b56c2b2 HTTP/1.0" 202 Accepted 2026-05-05 16:50:05,021 - lava_callback - INFO - Starting async job submit for node 69f77caa096243809b56c2b2 2026-05-05 16:50:05,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:05,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77caa096243809b56c2b2 HTTP/1.1" 200 None 2026-05-05 16:50:05,050 - lava_callback - DEBUG - Processing node 69f77caa096243809b56c2b2: baseline-arm64-clabbe 2026-05-05 16:50:05,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77caa096243809b56c2b2 2026-05-05 16:50:05,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:05,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77caa096243809b56c2b2 HTTP/1.1" 200 None 2026-05-05 16:50:05,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:05,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 16:50:05,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:05,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77caa096243809b56c2b2 HTTP/1.1" 200 None 2026-05-05 16:50:05,127 - lava_callback - ERROR - Error processing callback for node 69f77caa096243809b56c2b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:50:05,824 - lava_callback - INFO - Received callback for node 69f77cad096243809b56c2bf INFO: 172.21.0.1:36296 - "POST /node/69f77cad096243809b56c2bf HTTP/1.0" 202 Accepted 2026-05-05 16:50:05,835 - lava_callback - INFO - Starting async job submit for node 69f77cad096243809b56c2bf 2026-05-05 16:50:05,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:05,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77cad096243809b56c2bf HTTP/1.1" 200 None 2026-05-05 16:50:05,876 - lava_callback - DEBUG - Processing node 69f77cad096243809b56c2bf: baseline-arm64-clabbe 2026-05-05 16:50:05,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77cad096243809b56c2bf 2026-05-05 16:50:05,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:05,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77cad096243809b56c2bf HTTP/1.1" 200 None 2026-05-05 16:50:05,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:05,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 16:50:05,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:05,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77cad096243809b56c2bf HTTP/1.1" 200 None 2026-05-05 16:50:05,962 - lava_callback - ERROR - Error processing callback for node 69f77cad096243809b56c2bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36304 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:50:06,794 - lava_callback - INFO - Received callback for node 69f77cac096243809b56c2b8 2026-05-05 16:50:06,820 - lava_callback - INFO - Starting async job submit for node 69f77cac096243809b56c2b8 2026-05-05 16:50:06,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36310 - "POST /node/69f77cac096243809b56c2b8 HTTP/1.0" 202 Accepted 2026-05-05 16:50:06,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77cac096243809b56c2b8 HTTP/1.1" 200 None 2026-05-05 16:50:06,875 - lava_callback - DEBUG - Processing node 69f77cac096243809b56c2b8: baseline-arm64-clabbe 2026-05-05 16:50:06,876 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77cac096243809b56c2b8 2026-05-05 16:50:06,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:06,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77cac096243809b56c2b8 HTTP/1.1" 200 None 2026-05-05 16:50:06,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:06,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 16:50:06,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:06,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77cac096243809b56c2b8 HTTP/1.1" 200 None 2026-05-05 16:50:06,978 - lava_callback - ERROR - Error processing callback for node 69f77cac096243809b56c2b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:50:11,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:11,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:50:21,045 - lava_callback - INFO - Received callback for node 69fa1fa7a9d11f026cebdf8d INFO: 172.21.0.1:56358 - "POST /node/69fa1fa7a9d11f026cebdf8d HTTP/1.0" 202 Accepted 2026-05-05 16:50:21,098 - lava_callback - INFO - Starting async job submit for node 69fa1fa7a9d11f026cebdf8d 2026-05-05 16:50:21,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:21,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa7a9d11f026cebdf8d HTTP/1.1" 200 None 2026-05-05 16:50:21,160 - lava_callback - DEBUG - Processing node 69fa1fa7a9d11f026cebdf8d: baseline-arm 2026-05-05 16:50:21,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:21,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:21,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa7a9d11f026cebdf8d/log.txt.gz 2026-05-05 16:50:21,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:22,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:22,044 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa7a9d11f026cebdf8d/lava-logs.yaml 2026-05-05 16:50:22,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:22,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:22,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa7a9d11f026cebdf8d/lava_callback.json.gz 2026-05-05 16:50:22,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:22,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa7a9d11f026cebdf8d HTTP/1.1" 200 None 2026-05-05 16:50:22,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:22,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:50:22,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:22,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fa7a9d11f026cebdf8d HTTP/1.1" 200 None 2026-05-05 16:50:22,307 - lava_callback - INFO - Completed processing callback for node 69fa1fa7a9d11f026cebdf8d 2026-05-05 16:50:24,514 - lava_callback - INFO - Received callback for node 69fa1fa4a9d11f026cebdf74 INFO: 172.21.0.1:56374 - "POST /node/69fa1fa4a9d11f026cebdf74 HTTP/1.0" 202 Accepted 2026-05-05 16:50:24,564 - lava_callback - INFO - Starting async job submit for node 69fa1fa4a9d11f026cebdf74 2026-05-05 16:50:24,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:24,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa4a9d11f026cebdf74 HTTP/1.1" 200 None 2026-05-05 16:50:24,641 - lava_callback - DEBUG - Processing node 69fa1fa4a9d11f026cebdf74: baseline-arm 2026-05-05 16:50:24,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:25,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:25,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa4a9d11f026cebdf74/log.txt.gz 2026-05-05 16:50:25,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:25,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:25,355 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa4a9d11f026cebdf74/lava-logs.yaml 2026-05-05 16:50:25,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:25,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:25,469 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa4a9d11f026cebdf74/lava_callback.json.gz 2026-05-05 16:50:25,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:25,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa4a9d11f026cebdf74 HTTP/1.1" 200 None 2026-05-05 16:50:25,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:25,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:50:25,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:25,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fa4a9d11f026cebdf74 HTTP/1.1" 200 None 2026-05-05 16:50:25,624 - lava_callback - INFO - Completed processing callback for node 69fa1fa4a9d11f026cebdf74 INFO: 172.21.0.1:56388 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:50:28,592 - lava_callback - INFO - Received callback for node 69fa1f09a9d11f026cebdda6 INFO: 172.21.0.1:56392 - "POST /node/69fa1f09a9d11f026cebdda6 HTTP/1.0" 202 Accepted 2026-05-05 16:50:28,602 - lava_callback - INFO - Starting async job submit for node 69fa1f09a9d11f026cebdda6 2026-05-05 16:50:28,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:28,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f09a9d11f026cebdda6 HTTP/1.1" 200 None 2026-05-05 16:50:28,675 - lava_callback - DEBUG - Processing node 69fa1f09a9d11f026cebdda6: baseline-arm64-broonie 2026-05-05 16:50:29,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:29,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:29,369 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f09a9d11f026cebdda6/log.txt.gz 2026-05-05 16:50:29,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:29,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:29,937 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f09a9d11f026cebdda6/lava-logs.yaml 2026-05-05 16:50:29,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:30,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:30,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f09a9d11f026cebdda6/lava_callback.json.gz 2026-05-05 16:50:30,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:30,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f09a9d11f026cebdda6 HTTP/1.1" 200 None 2026-05-05 16:50:30,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:30,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:50:30,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:30,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f09a9d11f026cebdda6 HTTP/1.1" 200 None 2026-05-05 16:50:30,304 - lava_callback - INFO - Completed processing callback for node 69fa1f09a9d11f026cebdda6 INFO: 172.21.0.1:52522 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:50:41,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:41,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:50:48,198 - lava_callback - INFO - Received callback for node 69fa1fa6a9d11f026cebdf86 INFO: 172.21.0.1:44890 - "POST /node/69fa1fa6a9d11f026cebdf86 HTTP/1.0" 202 Accepted 2026-05-05 16:50:48,204 - lava_callback - INFO - Starting async job submit for node 69fa1fa6a9d11f026cebdf86 2026-05-05 16:50:48,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:48,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa6a9d11f026cebdf86 HTTP/1.1" 200 None 2026-05-05 16:50:48,240 - lava_callback - DEBUG - Processing node 69fa1fa6a9d11f026cebdf86: baseline-arm 2026-05-05 16:50:48,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:48,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:48,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa6a9d11f026cebdf86/log.txt.gz 2026-05-05 16:50:48,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:48,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:48,889 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa6a9d11f026cebdf86/lava-logs.yaml 2026-05-05 16:50:48,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:49,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:49,051 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa6a9d11f026cebdf86/lava_callback.json.gz 2026-05-05 16:50:49,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:49,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa6a9d11f026cebdf86 HTTP/1.1" 200 None 2026-05-05 16:50:49,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:49,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:50:49,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:49,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fa6a9d11f026cebdf86 HTTP/1.1" 200 None 2026-05-05 16:50:49,137 - lava_callback - INFO - Completed processing callback for node 69fa1fa6a9d11f026cebdf86 2026-05-05 16:50:55,217 - lava_callback - INFO - Received callback for node 69fa1fa3a9d11f026cebdf6e INFO: 172.21.0.1:52806 - "POST /node/69fa1fa3a9d11f026cebdf6e HTTP/1.0" 202 Accepted 2026-05-05 16:50:55,223 - lava_callback - INFO - Starting async job submit for node 69fa1fa3a9d11f026cebdf6e 2026-05-05 16:50:55,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:55,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa3a9d11f026cebdf6e HTTP/1.1" 200 None 2026-05-05 16:50:55,305 - lava_callback - DEBUG - Processing node 69fa1fa3a9d11f026cebdf6e: baseline-arm 2026-05-05 16:50:55,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:55,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:55,632 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa3a9d11f026cebdf6e/log.txt.gz 2026-05-05 16:50:55,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:55,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:55,904 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa3a9d11f026cebdf6e/lava-logs.yaml 2026-05-05 16:50:55,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:50:56,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:50:56,005 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa3a9d11f026cebdf6e/lava_callback.json.gz 2026-05-05 16:50:56,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:56,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa3a9d11f026cebdf6e HTTP/1.1" 200 None 2026-05-05 16:50:56,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:56,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:50:56,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:50:56,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fa3a9d11f026cebdf6e HTTP/1.1" 200 None 2026-05-05 16:50:56,130 - lava_callback - INFO - Completed processing callback for node 69fa1fa3a9d11f026cebdf6e INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:51:01,334 - lava_callback - INFO - Received callback for node 69fa1f0ca9d11f026cebddcd INFO: 172.21.0.1:44528 - "POST /node/69fa1f0ca9d11f026cebddcd HTTP/1.0" 202 Accepted 2026-05-05 16:51:01,341 - lava_callback - INFO - Starting async job submit for node 69fa1f0ca9d11f026cebddcd 2026-05-05 16:51:01,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:01,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f0ca9d11f026cebddcd HTTP/1.1" 200 None 2026-05-05 16:51:01,378 - lava_callback - DEBUG - Processing node 69fa1f0ca9d11f026cebddcd: baseline-arm64-broonie 2026-05-05 16:51:01,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:01,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:01,744 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0ca9d11f026cebddcd/log.txt.gz 2026-05-05 16:51:01,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:02,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:02,095 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0ca9d11f026cebddcd/lava-logs.yaml 2026-05-05 16:51:02,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:02,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:02,205 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69fa1f0ca9d11f026cebddcd/lava_callback.json.gz 2026-05-05 16:51:02,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:02,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f0ca9d11f026cebddcd HTTP/1.1" 200 None 2026-05-05 16:51:02,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:02,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:51:02,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:02,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f0ca9d11f026cebddcd HTTP/1.1" 200 None 2026-05-05 16:51:02,279 - lava_callback - INFO - Completed processing callback for node 69fa1f0ca9d11f026cebddcd INFO: 172.21.0.1:44538 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:51:11,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:11,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-05 16:51:12,177 - lava_callback - INFO - Received callback for node 69fa1fcda9d11f026cebe039 INFO: 172.21.0.1:42422 - "POST /node/69fa1fcda9d11f026cebe039 HTTP/1.0" 202 Accepted 2026-05-05 16:51:12,225 - lava_callback - INFO - Starting async job submit for node 69fa1fcda9d11f026cebe039 2026-05-05 16:51:12,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:12,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fcda9d11f026cebe039 HTTP/1.1" 200 None 2026-05-05 16:51:12,259 - lava_callback - DEBUG - Processing node 69fa1fcda9d11f026cebe039: baseline-arm-pengutronix 2026-05-05 16:51:12,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:12,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:12,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fcda9d11f026cebe039/log.txt.gz 2026-05-05 16:51:12,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:12,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:12,631 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fcda9d11f026cebe039/lava-logs.yaml 2026-05-05 16:51:12,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:12,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:12,717 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fcda9d11f026cebe039/lava_callback.json.gz 2026-05-05 16:51:12,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:12,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fcda9d11f026cebe039 HTTP/1.1" 200 None 2026-05-05 16:51:12,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:12,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:51:12,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:12,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fcda9d11f026cebe039 HTTP/1.1" 200 None 2026-05-05 16:51:12,791 - lava_callback - INFO - Completed processing callback for node 69fa1fcda9d11f026cebe039 INFO: 172.21.0.1:42438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:51:17,281 - lava_callback - INFO - Received callback for node 69fa1fc9a9d11f026cebe030 INFO: 172.21.0.1:42444 - "POST /node/69fa1fc9a9d11f026cebe030 HTTP/1.0" 202 Accepted 2026-05-05 16:51:17,287 - lava_callback - INFO - Starting async job submit for node 69fa1fc9a9d11f026cebe030 2026-05-05 16:51:17,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:17,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fc9a9d11f026cebe030 HTTP/1.1" 200 None 2026-05-05 16:51:17,323 - lava_callback - DEBUG - Processing node 69fa1fc9a9d11f026cebe030: baseline-arm-pengutronix 2026-05-05 16:51:17,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:17,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:17,543 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fc9a9d11f026cebe030/log.txt.gz 2026-05-05 16:51:17,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:17,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:17,783 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fc9a9d11f026cebe030/lava-logs.yaml 2026-05-05 16:51:17,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:17,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:17,891 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fc9a9d11f026cebe030/lava_callback.json.gz 2026-05-05 16:51:17,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:17,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fc9a9d11f026cebe030 HTTP/1.1" 200 None 2026-05-05 16:51:17,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:17,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:51:17,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:17,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fc9a9d11f026cebe030 HTTP/1.1" 200 None 2026-05-05 16:51:17,960 - lava_callback - INFO - Completed processing callback for node 69fa1fc9a9d11f026cebe030 2026-05-05 16:51:22,169 - lava_callback - INFO - Received callback for node 69f77cfb096243809b56c3cd INFO: 172.21.0.1:46634 - "POST /node/69f77cfb096243809b56c3cd HTTP/1.0" 202 Accepted 2026-05-05 16:51:22,178 - lava_callback - INFO - Starting async job submit for node 69f77cfb096243809b56c3cd 2026-05-05 16:51:22,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:22,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77cfb096243809b56c3cd HTTP/1.1" 200 None 2026-05-05 16:51:22,207 - lava_callback - DEBUG - Processing node 69f77cfb096243809b56c3cd: baseline-arm-clabbe 2026-05-05 16:51:22,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77cfb096243809b56c3cd 2026-05-05 16:51:22,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:22,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77cfb096243809b56c3cd HTTP/1.1" 200 None 2026-05-05 16:51:22,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:22,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-05 16:51:22,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:22,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77cfb096243809b56c3cd HTTP/1.1" 200 None 2026-05-05 16:51:22,252 - lava_callback - ERROR - Error processing callback for node 69f77cfb096243809b56c3cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:51:22,826 - lava_callback - INFO - Received callback for node 69f77d01096243809b56c3e2 INFO: 172.21.0.1:46644 - "POST /node/69f77d01096243809b56c3e2 HTTP/1.0" 202 Accepted 2026-05-05 16:51:22,831 - lava_callback - INFO - Starting async job submit for node 69f77d01096243809b56c3e2 2026-05-05 16:51:22,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:22,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77d01096243809b56c3e2 HTTP/1.1" 200 None 2026-05-05 16:51:22,846 - lava_callback - DEBUG - Processing node 69f77d01096243809b56c3e2: baseline-arm-clabbe 2026-05-05 16:51:22,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77d01096243809b56c3e2 2026-05-05 16:51:22,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:22,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77d01096243809b56c3e2 HTTP/1.1" 200 None 2026-05-05 16:51:22,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:22,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-05 16:51:22,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:22,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77d01096243809b56c3e2 HTTP/1.1" 200 None 2026-05-05 16:51:22,890 - lava_callback - ERROR - Error processing callback for node 69f77d01096243809b56c3e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:51:23,520 - lava_callback - INFO - Received callback for node 69f77d02096243809b56c3e5 INFO: 172.21.0.1:46652 - "POST /node/69f77d02096243809b56c3e5 HTTP/1.0" 202 Accepted 2026-05-05 16:51:23,526 - lava_callback - INFO - Starting async job submit for node 69f77d02096243809b56c3e5 2026-05-05 16:51:23,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:23,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77d02096243809b56c3e5 HTTP/1.1" 200 None 2026-05-05 16:51:23,541 - lava_callback - DEBUG - Processing node 69f77d02096243809b56c3e5: baseline-arm-clabbe 2026-05-05 16:51:23,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77d02096243809b56c3e5 2026-05-05 16:51:23,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:23,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77d02096243809b56c3e5 HTTP/1.1" 200 None 2026-05-05 16:51:23,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:23,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-05 16:51:23,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:23,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77d02096243809b56c3e5 HTTP/1.1" 200 None 2026-05-05 16:51:23,588 - lava_callback - ERROR - Error processing callback for node 69f77d02096243809b56c3e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:51:24,246 - lava_callback - INFO - Received callback for node 69f77d03096243809b56c3eb INFO: 172.21.0.1:46664 - "POST /node/69f77d03096243809b56c3eb HTTP/1.0" 202 Accepted 2026-05-05 16:51:24,251 - lava_callback - INFO - Starting async job submit for node 69f77d03096243809b56c3eb 2026-05-05 16:51:24,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:24,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77d03096243809b56c3eb HTTP/1.1" 200 None 2026-05-05 16:51:24,267 - lava_callback - DEBUG - Processing node 69f77d03096243809b56c3eb: baseline-arm-clabbe 2026-05-05 16:51:24,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77d03096243809b56c3eb 2026-05-05 16:51:24,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:24,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77d03096243809b56c3eb HTTP/1.1" 200 None 2026-05-05 16:51:24,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:24,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-05 16:51:24,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:24,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77d03096243809b56c3eb HTTP/1.1" 200 None 2026-05-05 16:51:24,317 - lava_callback - ERROR - Error processing callback for node 69f77d03096243809b56c3eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 16:51:24,920 - lava_callback - INFO - Received callback for node 69f77d07096243809b56c42c INFO: 172.21.0.1:46668 - "POST /node/69f77d07096243809b56c42c HTTP/1.0" 202 Accepted 2026-05-05 16:51:24,925 - lava_callback - INFO - Starting async job submit for node 69f77d07096243809b56c42c 2026-05-05 16:51:24,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:24,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77d07096243809b56c42c HTTP/1.1" 200 None 2026-05-05 16:51:24,940 - lava_callback - DEBUG - Processing node 69f77d07096243809b56c42c: baseline-arm-clabbe 2026-05-05 16:51:24,940 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f77d07096243809b56c42c 2026-05-05 16:51:24,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:24,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77d07096243809b56c42c HTTP/1.1" 200 None 2026-05-05 16:51:24,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:24,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-05 16:51:24,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:24,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f77d07096243809b56c42c HTTP/1.1" 200 None 2026-05-05 16:51:24,994 - lava_callback - ERROR - Error processing callback for node 69f77d07096243809b56c42c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:51:28,526 - lava_callback - INFO - Received callback for node 69fa1fb6a9d11f026cebdfb5 INFO: 172.21.0.1:46684 - "POST /node/69fa1fb6a9d11f026cebdfb5 HTTP/1.0" 202 Accepted 2026-05-05 16:51:28,535 - lava_callback - INFO - Starting async job submit for node 69fa1fb6a9d11f026cebdfb5 2026-05-05 16:51:28,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:28,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fb6a9d11f026cebdfb5 HTTP/1.1" 200 None 2026-05-05 16:51:28,590 - lava_callback - DEBUG - Processing node 69fa1fb6a9d11f026cebdfb5: baseline-arm-broonie 2026-05-05 16:51:28,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:29,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:29,139 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb6a9d11f026cebdfb5/log.txt.gz 2026-05-05 16:51:29,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:29,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:29,420 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb6a9d11f026cebdfb5/lava-logs.yaml 2026-05-05 16:51:29,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:29,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:29,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb6a9d11f026cebdfb5/lava_callback.json.gz 2026-05-05 16:51:29,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:29,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fb6a9d11f026cebdfb5 HTTP/1.1" 200 None 2026-05-05 16:51:29,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:29,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:51:29,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:29,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fb6a9d11f026cebdfb5 HTTP/1.1" 200 None 2026-05-05 16:51:29,598 - lava_callback - INFO - Completed processing callback for node 69fa1fb6a9d11f026cebdfb5 INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:51:40,772 - lava_callback - INFO - Received callback for node 69fa1fb3a9d11f026cebdfaf INFO: 172.21.0.1:45430 - "POST /node/69fa1fb3a9d11f026cebdfaf HTTP/1.0" 202 Accepted 2026-05-05 16:51:40,779 - lava_callback - INFO - Starting async job submit for node 69fa1fb3a9d11f026cebdfaf 2026-05-05 16:51:40,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:40,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fb3a9d11f026cebdfaf HTTP/1.1" 200 None 2026-05-05 16:51:40,828 - lava_callback - DEBUG - Processing node 69fa1fb3a9d11f026cebdfaf: baseline-arm-broonie 2026-05-05 16:51:41,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:41,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:41,194 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb3a9d11f026cebdfaf/log.txt.gz 2026-05-05 16:51:41,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:41,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:41,483 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb3a9d11f026cebdfaf/lava-logs.yaml 2026-05-05 16:51:41,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:51:41,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:41,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:51:41,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-05 16:51:41,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb3a9d11f026cebdfaf/lava_callback.json.gz 2026-05-05 16:51:41,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:41,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fb3a9d11f026cebdfaf HTTP/1.1" 200 None 2026-05-05 16:51:41,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:41,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:51:41,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:51:41,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fb3a9d11f026cebdfaf HTTP/1.1" 200 None 2026-05-05 16:51:41,679 - lava_callback - INFO - Completed processing callback for node 69fa1fb3a9d11f026cebdfaf INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:52:00,103 - lava_callback - INFO - Received callback for node 69fa1fc5a9d11f026cebe022 INFO: 172.21.0.1:36886 - "POST /node/69fa1fc5a9d11f026cebe022 HTTP/1.0" 202 Accepted 2026-05-05 16:52:00,108 - lava_callback - INFO - Starting async job submit for node 69fa1fc5a9d11f026cebe022 2026-05-05 16:52:00,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:00,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fc5a9d11f026cebe022 HTTP/1.1" 200 None 2026-05-05 16:52:00,146 - lava_callback - DEBUG - Processing node 69fa1fc5a9d11f026cebe022: baseline-arm-kontron 2026-05-05 16:52:00,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:00,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:00,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fa1fc5a9d11f026cebe022/log.txt.gz 2026-05-05 16:52:00,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:00,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:00,896 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fa1fc5a9d11f026cebe022/lava-logs.yaml 2026-05-05 16:52:00,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:00,925 - lava_callback - INFO - Received callback for node 69fa1fb5a9d11f026cebdfb2 INFO: 172.21.0.1:36890 - "POST /node/69fa1fb5a9d11f026cebdfb2 HTTP/1.0" 202 Accepted 2026-05-05 16:52:00,931 - lava_callback - INFO - Starting async job submit for node 69fa1fb5a9d11f026cebdfb2 2026-05-05 16:52:00,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:00,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fb5a9d11f026cebdfb2 HTTP/1.1" 200 None 2026-05-05 16:52:00,978 - lava_callback - DEBUG - Processing node 69fa1fb5a9d11f026cebdfb2: baseline-arm-broonie 2026-05-05 16:52:01,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:01,101 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fa1fc5a9d11f026cebe022/lava_callback.json.gz 2026-05-05 16:52:01,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:01,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fc5a9d11f026cebe022 HTTP/1.1" 200 None 2026-05-05 16:52:01,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:01,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:01,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:52:01,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:01,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fc5a9d11f026cebe022 HTTP/1.1" 200 None 2026-05-05 16:52:01,292 - lava_callback - INFO - Completed processing callback for node 69fa1fc5a9d11f026cebe022 2026-05-05 16:52:01,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:01,359 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb5a9d11f026cebdfb2/log.txt.gz 2026-05-05 16:52:01,516 - lava_callback - INFO - Received callback for node 69fa1fc6a9d11f026cebe025 INFO: 172.21.0.1:36892 - "POST /node/69fa1fc6a9d11f026cebe025 HTTP/1.0" 202 Accepted 2026-05-05 16:52:01,528 - lava_callback - INFO - Starting async job submit for node 69fa1fc6a9d11f026cebe025 2026-05-05 16:52:01,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:01,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:01,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fc6a9d11f026cebe025 HTTP/1.1" 200 None 2026-05-05 16:52:01,579 - lava_callback - DEBUG - Processing node 69fa1fc6a9d11f026cebe025: baseline-arm-kontron 2026-05-05 16:52:01,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:01,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:01,866 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fa1fc6a9d11f026cebe025/log.txt.gz 2026-05-05 16:52:01,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:01,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb5a9d11f026cebdfb2/lava-logs.yaml 2026-05-05 16:52:01,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:01,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:02,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:02,100 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb5a9d11f026cebdfb2/lava_callback.json.gz 2026-05-05 16:52:02,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:02,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:02,138 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fa1fc6a9d11f026cebe025/lava-logs.yaml 2026-05-05 16:52:02,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:02,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fb5a9d11f026cebdfb2 HTTP/1.1" 200 None 2026-05-05 16:52:02,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:02,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:52:02,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:02,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fb5a9d11f026cebdfb2 HTTP/1.1" 200 None 2026-05-05 16:52:02,192 - lava_callback - INFO - Completed processing callback for node 69fa1fb5a9d11f026cebdfb2 2026-05-05 16:52:02,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:02,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69fa1fc6a9d11f026cebe025/lava_callback.json.gz 2026-05-05 16:52:02,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:02,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fc6a9d11f026cebe025 HTTP/1.1" 200 None 2026-05-05 16:52:02,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:02,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:52:02,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:02,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fc6a9d11f026cebe025 HTTP/1.1" 200 None 2026-05-05 16:52:02,368 - lava_callback - INFO - Completed processing callback for node 69fa1fc6a9d11f026cebe025 INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:52:08,839 - lava_callback - INFO - Received callback for node 69fa1fbca9d11f026cebdfcc INFO: 172.21.0.1:36900 - "POST /node/69fa1fbca9d11f026cebdfcc HTTP/1.0" 202 Accepted 2026-05-05 16:52:08,845 - lava_callback - INFO - Starting async job submit for node 69fa1fbca9d11f026cebdfcc 2026-05-05 16:52:08,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:08,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fbca9d11f026cebdfcc HTTP/1.1" 200 None 2026-05-05 16:52:08,880 - lava_callback - DEBUG - Processing node 69fa1fbca9d11f026cebdfcc: baseline-arm-clabbe 2026-05-05 16:52:09,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:09,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:09,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fa1fbca9d11f026cebdfcc/log.txt.gz 2026-05-05 16:52:09,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:09,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:09,456 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fa1fbca9d11f026cebdfcc/lava-logs.yaml 2026-05-05 16:52:09,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:09,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:09,617 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fa1fbca9d11f026cebdfcc/lava_callback.json.gz 2026-05-05 16:52:09,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:09,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fbca9d11f026cebdfcc HTTP/1.1" 200 None 2026-05-05 16:52:09,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:09,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:52:09,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:09,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fbca9d11f026cebdfcc HTTP/1.1" 200 None 2026-05-05 16:52:09,700 - lava_callback - INFO - Completed processing callback for node 69fa1fbca9d11f026cebdfcc 2026-05-05 16:52:11,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:11,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:40942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:52:16,957 - lava_callback - INFO - Received callback for node 69fa1fcaa9d11f026cebe033 INFO: 172.21.0.1:40946 - "POST /node/69fa1fcaa9d11f026cebe033 HTTP/1.0" 202 Accepted 2026-05-05 16:52:16,963 - lava_callback - INFO - Starting async job submit for node 69fa1fcaa9d11f026cebe033 2026-05-05 16:52:16,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:17,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fcaa9d11f026cebe033 HTTP/1.1" 200 None 2026-05-05 16:52:17,001 - lava_callback - DEBUG - Processing node 69fa1fcaa9d11f026cebe033: baseline-arm-pengutronix 2026-05-05 16:52:17,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:17,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:17,252 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fcaa9d11f026cebe033/log.txt.gz 2026-05-05 16:52:17,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:17,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:17,484 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fcaa9d11f026cebe033/lava-logs.yaml 2026-05-05 16:52:17,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:17,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:17,581 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fcaa9d11f026cebe033/lava_callback.json.gz 2026-05-05 16:52:17,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:17,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fcaa9d11f026cebe033 HTTP/1.1" 200 None 2026-05-05 16:52:17,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:17,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:52:17,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:17,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fcaa9d11f026cebe033 HTTP/1.1" 200 None 2026-05-05 16:52:17,732 - lava_callback - INFO - Completed processing callback for node 69fa1fcaa9d11f026cebe033 2026-05-05 16:52:20,696 - lava_callback - INFO - Received callback for node 69fa1f20a9d11f026cebde0d INFO: 172.21.0.1:54618 - "POST /node/69fa1f20a9d11f026cebde0d HTTP/1.0" 202 Accepted 2026-05-05 16:52:20,705 - lava_callback - INFO - Starting async job submit for node 69fa1f20a9d11f026cebde0d 2026-05-05 16:52:20,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:20,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f20a9d11f026cebde0d HTTP/1.1" 200 None 2026-05-05 16:52:20,767 - lava_callback - DEBUG - Processing node 69fa1f20a9d11f026cebde0d: baseline-arm64-foundriesio 2026-05-05 16:52:21,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:22,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:22,063 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fa1f20a9d11f026cebde0d/log.txt.gz 2026-05-05 16:52:22,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:22,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:22,934 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fa1f20a9d11f026cebde0d/lava-logs.yaml 2026-05-05 16:52:22,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:23,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:23,089 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fa1f20a9d11f026cebde0d/lava_callback.json.gz DEBUG: 69fa1f20a9d11f026cebde0d Transitting job node result: pass -> incomplete 2026-05-05 16:52:23,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:23,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1f20a9d11f026cebde0d HTTP/1.1" 200 None 2026-05-05 16:52:23,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:23,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:52:23,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:23,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1f20a9d11f026cebde0d HTTP/1.1" 200 None 2026-05-05 16:52:23,188 - lava_callback - INFO - Completed processing callback for node 69fa1f20a9d11f026cebde0d 2026-05-05 16:52:26,363 - lava_callback - INFO - Received callback for node 69fa2010a9d11f026cebe0e4 INFO: 172.21.0.1:54630 - "POST /node/69fa2010a9d11f026cebe0e4 HTTP/1.0" 202 Accepted 2026-05-05 16:52:26,374 - lava_callback - INFO - Starting async job submit for node 69fa2010a9d11f026cebe0e4 2026-05-05 16:52:26,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:26,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2010a9d11f026cebe0e4 HTTP/1.1" 200 None 2026-05-05 16:52:26,419 - lava_callback - DEBUG - Processing node 69fa2010a9d11f026cebe0e4: baseline-arm64 INFO: 172.21.0.1:54638 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:52:26,557 - lava_callback - WARNING - Failed to upload log 2026-05-05 16:52:26,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:26,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:26,816 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2010a9d11f026cebe0e4/lava-logs.yaml 2026-05-05 16:52:26,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:26,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:26,899 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2010a9d11f026cebe0e4/lava_callback.json.gz 2026-05-05 16:52:26,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:26,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2010a9d11f026cebe0e4 HTTP/1.1" 200 None 2026-05-05 16:52:26,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:26,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:52:26,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:26,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2010a9d11f026cebe0e4 HTTP/1.1" 200 None 2026-05-05 16:52:27,052 - lava_callback - INFO - Completed processing callback for node 69fa2010a9d11f026cebe0e4 INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:52:41,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:41,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-05 16:52:42,043 - lava_callback - INFO - Received callback for node 69fa1fbda9d11f026cebdfd5 INFO: 172.21.0.1:35980 - "POST /node/69fa1fbda9d11f026cebdfd5 HTTP/1.0" 202 Accepted 2026-05-05 16:52:42,050 - lava_callback - INFO - Starting async job submit for node 69fa1fbda9d11f026cebdfd5 2026-05-05 16:52:42,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:42,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fbda9d11f026cebdfd5 HTTP/1.1" 200 None 2026-05-05 16:52:42,087 - lava_callback - DEBUG - Processing node 69fa1fbda9d11f026cebdfd5: baseline-arm-clabbe 2026-05-05 16:52:42,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:42,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:42,361 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fa1fbda9d11f026cebdfd5/log.txt.gz 2026-05-05 16:52:42,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:42,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:42,644 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fa1fbda9d11f026cebdfd5/lava-logs.yaml 2026-05-05 16:52:42,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:42,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:42,754 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fa1fbda9d11f026cebdfd5/lava_callback.json.gz 2026-05-05 16:52:42,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:42,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fbda9d11f026cebdfd5 HTTP/1.1" 200 None 2026-05-05 16:52:42,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:42,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:52:42,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:42,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fbda9d11f026cebdfd5 HTTP/1.1" 200 None 2026-05-05 16:52:42,831 - lava_callback - INFO - Completed processing callback for node 69fa1fbda9d11f026cebdfd5 INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:52:44,928 - lava_callback - INFO - Received callback for node 69fa1fe5a9d11f026cebe07a INFO: 172.21.0.1:35994 - "POST /node/69fa1fe5a9d11f026cebe07a HTTP/1.0" 202 Accepted 2026-05-05 16:52:44,939 - lava_callback - INFO - Starting async job submit for node 69fa1fe5a9d11f026cebe07a 2026-05-05 16:52:44,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:45,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe5a9d11f026cebe07a HTTP/1.1" 200 None 2026-05-05 16:52:45,011 - lava_callback - DEBUG - Processing node 69fa1fe5a9d11f026cebe07a: ltp-dio 2026-05-05 16:52:45,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:45,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:45,524 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69fa1fe5a9d11f026cebe07a/log.txt.gz 2026-05-05 16:52:45,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:45,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:45,929 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69fa1fe5a9d11f026cebe07a/lava-logs.yaml 2026-05-05 16:52:45,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:52:46,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:52:46,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69fa1fe5a9d11f026cebe07a/lava_callback.json.gz 2026-05-05 16:52:46,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:46,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe5a9d11f026cebe07a HTTP/1.1" 200 None 2026-05-05 16:52:46,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:46,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:52:46,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:52:46,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fe5a9d11f026cebe07a HTTP/1.1" 200 None 2026-05-05 16:52:46,169 - lava_callback - INFO - Completed processing callback for node 69fa1fe5a9d11f026cebe07a INFO: 172.21.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:53:11,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:53:11,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51152 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:53:54,013 - lava_callback - INFO - Received callback for node 69fa205ca9d11f026cebe150 INFO: 172.21.0.1:51892 - "POST /node/69fa205ca9d11f026cebe150 HTTP/1.0" 202 Accepted 2026-05-05 16:53:54,020 - lava_callback - INFO - Starting async job submit for node 69fa205ca9d11f026cebe150 2026-05-05 16:53:54,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:53:54,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa205ca9d11f026cebe150 HTTP/1.1" 200 None 2026-05-05 16:53:54,064 - lava_callback - DEBUG - Processing node 69fa205ca9d11f026cebe150: baseline-arm64 2026-05-05 16:53:54,260 - lava_callback - WARNING - Failed to upload log 2026-05-05 16:53:54,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:53:54,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:53:54,552 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa205ca9d11f026cebe150/lava-logs.yaml 2026-05-05 16:53:54,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:53:54,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:53:54,673 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa205ca9d11f026cebe150/lava_callback.json.gz 2026-05-05 16:53:54,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:53:54,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa205ca9d11f026cebe150 HTTP/1.1" 200 None 2026-05-05 16:53:54,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:53:54,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:53:54,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:53:54,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa205ca9d11f026cebe150 HTTP/1.1" 200 None 2026-05-05 16:53:54,820 - lava_callback - INFO - Completed processing callback for node 69fa205ca9d11f026cebe150 INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:53:57,013 - lava_callback - INFO - Received callback for node 69fa1fc2a9d11f026cebe018 INFO: 172.21.0.1:51904 - "POST /node/69fa1fc2a9d11f026cebe018 HTTP/1.0" 202 Accepted 2026-05-05 16:53:57,019 - lava_callback - INFO - Starting async job submit for node 69fa1fc2a9d11f026cebe018 2026-05-05 16:53:57,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:53:57,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fc2a9d11f026cebe018 HTTP/1.1" 200 None 2026-05-05 16:53:57,059 - lava_callback - DEBUG - Processing node 69fa1fc2a9d11f026cebe018: baseline-arm-clabbe 2026-05-05 16:53:57,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:53:57,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:53:57,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fa1fc2a9d11f026cebe018/log.txt.gz 2026-05-05 16:53:57,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:53:57,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:53:57,639 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fa1fc2a9d11f026cebe018/lava-logs.yaml 2026-05-05 16:53:57,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:53:57,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:53:57,748 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69fa1fc2a9d11f026cebe018/lava_callback.json.gz 2026-05-05 16:53:57,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:53:57,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fc2a9d11f026cebe018 HTTP/1.1" 200 None 2026-05-05 16:53:57,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:53:57,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:53:57,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:53:57,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fc2a9d11f026cebe018 HTTP/1.1" 200 None 2026-05-05 16:53:57,829 - lava_callback - INFO - Completed processing callback for node 69fa1fc2a9d11f026cebe018 INFO: 172.21.0.1:33802 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:54:11,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:11,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:54:21,361 - lava_callback - INFO - Received callback for node 69fa1c23a9d11f026cebdc93 INFO: 172.21.0.1:39330 - "POST /node/69fa1c23a9d11f026cebdc93 HTTP/1.0" 202 Accepted 2026-05-05 16:54:21,367 - lava_callback - INFO - Starting async job submit for node 69fa1c23a9d11f026cebdc93 2026-05-05 16:54:21,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:21,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1c23a9d11f026cebdc93 HTTP/1.1" 200 None 2026-05-05 16:54:21,450 - lava_callback - DEBUG - Processing node 69fa1c23a9d11f026cebdc93: ltp-smoke 2026-05-05 16:54:21,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:22,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:22,009 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa1c23a9d11f026cebdc93/log.txt.gz 2026-05-05 16:54:22,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:22,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:22,457 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa1c23a9d11f026cebdc93/lava-logs.yaml 2026-05-05 16:54:22,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:22,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:22,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa1c23a9d11f026cebdc93/lava_callback.json.gz 2026-05-05 16:54:22,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:22,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1c23a9d11f026cebdc93 HTTP/1.1" 200 None 2026-05-05 16:54:22,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:22,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa186ca9d11f026cebb51e HTTP/1.1" 200 None 2026-05-05 16:54:22,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:22,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1c23a9d11f026cebdc93 HTTP/1.1" 200 None 2026-05-05 16:54:22,881 - lava_callback - INFO - Completed processing callback for node 69fa1c23a9d11f026cebdc93 INFO: 172.21.0.1:39334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:54:39,078 - lava_callback - INFO - Received callback for node 69fa1eeda9d11f026cebdd3f INFO: 172.21.0.1:39090 - "POST /node/69fa1eeda9d11f026cebdd3f HTTP/1.0" 202 Accepted 2026-05-05 16:54:39,087 - lava_callback - INFO - Starting async job submit for node 69fa1eeda9d11f026cebdd3f 2026-05-05 16:54:39,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:39,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eeda9d11f026cebdd3f HTTP/1.1" 200 None 2026-05-05 16:54:39,139 - lava_callback - DEBUG - Processing node 69fa1eeda9d11f026cebdd3f: baseline-arm64 2026-05-05 16:54:39,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:39,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:39,597 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeda9d11f026cebdd3f/log.txt.gz 2026-05-05 16:54:39,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:40,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:40,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeda9d11f026cebdd3f/lava-logs.yaml 2026-05-05 16:54:40,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:40,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:40,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1eeda9d11f026cebdd3f/lava_callback.json.gz DEBUG: Setup failed for 69fa1eeda9d11f026cebdd3f. Transitting job node result: incomplete -> fail 2026-05-05 16:54:40,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:40,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eeda9d11f026cebdd3f HTTP/1.1" 200 None 2026-05-05 16:54:40,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:40,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:54:40,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:40,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1eeda9d11f026cebdd3f HTTP/1.1" 200 None 2026-05-05 16:54:40,350 - lava_callback - INFO - Completed processing callback for node 69fa1eeda9d11f026cebdd3f 2026-05-05 16:54:41,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:41,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:54:48,920 - lava_callback - INFO - Received callback for node 69fa1fe1a9d11f026cebe074 INFO: 172.21.0.1:58842 - "POST /node/69fa1fe1a9d11f026cebe074 HTTP/1.0" 202 Accepted 2026-05-05 16:54:48,927 - lava_callback - INFO - Starting async job submit for node 69fa1fe1a9d11f026cebe074 2026-05-05 16:54:48,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:48,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe1a9d11f026cebe074 HTTP/1.1" 200 None 2026-05-05 16:54:48,966 - lava_callback - DEBUG - Processing node 69fa1fe1a9d11f026cebe074: ltp-controllers 2026-05-05 16:54:49,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:49,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:49,495 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69fa1fe1a9d11f026cebe074/log.txt.gz 2026-05-05 16:54:49,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:49,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:49,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69fa1fe1a9d11f026cebe074/lava-logs.yaml 2026-05-05 16:54:49,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:50,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:50,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69fa1fe1a9d11f026cebe074/lava_callback.json.gz 2026-05-05 16:54:50,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:50,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe1a9d11f026cebe074 HTTP/1.1" 200 None 2026-05-05 16:54:50,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:50,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:54:50,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:50,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fe1a9d11f026cebe074 HTTP/1.1" 200 None 2026-05-05 16:54:50,111 - lava_callback - INFO - Completed processing callback for node 69fa1fe1a9d11f026cebe074 2026-05-05 16:54:50,553 - lava_callback - INFO - Received callback for node 69fa1ff1a9d11f026cebe09d INFO: 172.21.0.1:35288 - "POST /node/69fa1ff1a9d11f026cebe09d HTTP/1.0" 202 Accepted 2026-05-05 16:54:50,560 - lava_callback - INFO - Starting async job submit for node 69fa1ff1a9d11f026cebe09d 2026-05-05 16:54:50,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:50,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ff1a9d11f026cebe09d HTTP/1.1" 200 None 2026-05-05 16:54:50,602 - lava_callback - DEBUG - Processing node 69fa1ff1a9d11f026cebe09d: ltp-syscalls 2026-05-05 16:54:51,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:51,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:51,420 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fa1ff1a9d11f026cebe09d/log.txt.gz 2026-05-05 16:54:51,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:52,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:52,012 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fa1ff1a9d11f026cebe09d/lava-logs.yaml 2026-05-05 16:54:52,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:54:52,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:54:52,155 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69fa1ff1a9d11f026cebe09d/lava_callback.json.gz 2026-05-05 16:54:52,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:52,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ff1a9d11f026cebe09d HTTP/1.1" 200 None 2026-05-05 16:54:52,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:52,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:54:52,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:54:52,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ff1a9d11f026cebe09d HTTP/1.1" 200 None 2026-05-05 16:54:52,248 - lava_callback - INFO - Completed processing callback for node 69fa1ff1a9d11f026cebe09d INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:55:01,139 - lava_callback - INFO - Received callback for node 69fa1fe0a9d11f026cebe068 INFO: 172.21.0.1:53050 - "POST /node/69fa1fe0a9d11f026cebe068 HTTP/1.0" 202 Accepted 2026-05-05 16:55:01,145 - lava_callback - INFO - Starting async job submit for node 69fa1fe0a9d11f026cebe068 2026-05-05 16:55:01,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:01,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe0a9d11f026cebe068 HTTP/1.1" 200 None 2026-05-05 16:55:01,184 - lava_callback - DEBUG - Processing node 69fa1fe0a9d11f026cebe068: ltp-containers 2026-05-05 16:55:01,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:01,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:01,717 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69fa1fe0a9d11f026cebe068/log.txt.gz 2026-05-05 16:55:01,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:02,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:02,397 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69fa1fe0a9d11f026cebe068/lava-logs.yaml 2026-05-05 16:55:02,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:02,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:02,656 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69fa1fe0a9d11f026cebe068/lava_callback.json.gz 2026-05-05 16:55:02,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:02,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe0a9d11f026cebe068 HTTP/1.1" 200 None 2026-05-05 16:55:02,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:02,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:55:02,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:02,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fe0a9d11f026cebe068 HTTP/1.1" 200 None 2026-05-05 16:55:02,745 - lava_callback - INFO - Completed processing callback for node 69fa1fe0a9d11f026cebe068 INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:55:08,956 - lava_callback - INFO - Received callback for node 69fa1fb2a9d11f026cebdfac INFO: 172.21.0.1:53060 - "POST /node/69fa1fb2a9d11f026cebdfac HTTP/1.0" 202 Accepted 2026-05-05 16:55:08,962 - lava_callback - INFO - Starting async job submit for node 69fa1fb2a9d11f026cebdfac 2026-05-05 16:55:08,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:09,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fb2a9d11f026cebdfac HTTP/1.1" 200 None 2026-05-05 16:55:09,009 - lava_callback - DEBUG - Processing node 69fa1fb2a9d11f026cebdfac: baseline-arm-broonie 2026-05-05 16:55:09,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:09,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:09,394 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb2a9d11f026cebdfac/log.txt.gz 2026-05-05 16:55:09,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:09,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:09,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb2a9d11f026cebdfac/lava-logs.yaml 2026-05-05 16:55:09,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:09,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:09,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69fa1fb2a9d11f026cebdfac/lava_callback.json.gz 2026-05-05 16:55:09,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:09,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fb2a9d11f026cebdfac HTTP/1.1" 200 None 2026-05-05 16:55:09,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:09,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:55:09,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:09,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fb2a9d11f026cebdfac HTTP/1.1" 200 None 2026-05-05 16:55:09,936 - lava_callback - INFO - Completed processing callback for node 69fa1fb2a9d11f026cebdfac 2026-05-05 16:55:10,555 - lava_callback - INFO - Received callback for node 69fa1fdea9d11f026cebe065 INFO: 172.21.0.1:52520 - "POST /node/69fa1fdea9d11f026cebe065 HTTP/1.0" 202 Accepted 2026-05-05 16:55:10,562 - lava_callback - INFO - Starting async job submit for node 69fa1fdea9d11f026cebe065 2026-05-05 16:55:10,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:10,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fdea9d11f026cebe065 HTTP/1.1" 200 None 2026-05-05 16:55:10,620 - lava_callback - DEBUG - Processing node 69fa1fdea9d11f026cebe065: ltp-cap_bounds 2026-05-05 16:55:10,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:11,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:11,119 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fa1fdea9d11f026cebe065/log.txt.gz 2026-05-05 16:55:11,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:11,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:11,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fa1fdea9d11f026cebe065/lava-logs.yaml 2026-05-05 16:55:11,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:11,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:11,647 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69fa1fdea9d11f026cebe065/lava_callback.json.gz 2026-05-05 16:55:11,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:11,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fdea9d11f026cebe065 HTTP/1.1" 200 None 2026-05-05 16:55:11,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:11,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:11,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:55:11,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-05 16:55:11,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:11,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fdea9d11f026cebe065 HTTP/1.1" 200 None 2026-05-05 16:55:11,731 - lava_callback - INFO - Completed processing callback for node 69fa1fdea9d11f026cebe065 INFO: 172.21.0.1:52536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:55:41,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:41,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55002 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:55:50,954 - lava_callback - INFO - Received callback for node 69fa20d1a9d11f026cebe1a0 INFO: 172.21.0.1:52244 - "POST /node/69fa20d1a9d11f026cebe1a0 HTTP/1.0" 202 Accepted 2026-05-05 16:55:50,961 - lava_callback - INFO - Starting async job submit for node 69fa20d1a9d11f026cebe1a0 2026-05-05 16:55:50,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:51,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa20d1a9d11f026cebe1a0 HTTP/1.1" 200 None 2026-05-05 16:55:51,015 - lava_callback - DEBUG - Processing node 69fa20d1a9d11f026cebe1a0: baseline-arm64 2026-05-05 16:55:51,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:51,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:51,649 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa20d1a9d11f026cebe1a0/log.txt.gz 2026-05-05 16:55:51,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:52,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:52,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa20d1a9d11f026cebe1a0/lava-logs.yaml 2026-05-05 16:55:52,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:55:52,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:55:52,296 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa20d1a9d11f026cebe1a0/lava_callback.json.gz 2026-05-05 16:55:52,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:52,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa20d1a9d11f026cebe1a0 HTTP/1.1" 200 None 2026-05-05 16:55:52,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:52,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:55:52,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:55:52,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa20d1a9d11f026cebe1a0 HTTP/1.1" 200 None 2026-05-05 16:55:52,451 - lava_callback - INFO - Completed processing callback for node 69fa20d1a9d11f026cebe1a0 INFO: 172.21.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:56:11,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:56:11,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:56:27,996 - lava_callback - INFO - Received callback for node 69fa1ee2a9d11f026cebdd21 INFO: 172.21.0.1:46866 - "POST /node/69fa1ee2a9d11f026cebdd21 HTTP/1.0" 202 Accepted 2026-05-05 16:56:28,002 - lava_callback - INFO - Starting async job submit for node 69fa1ee2a9d11f026cebdd21 2026-05-05 16:56:28,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:56:28,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee2a9d11f026cebdd21 HTTP/1.1" 200 None 2026-05-05 16:56:28,034 - lava_callback - DEBUG - Processing node 69fa1ee2a9d11f026cebdd21: baseline-arm64 2026-05-05 16:56:28,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:56:28,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:56:28,531 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee2a9d11f026cebdd21/log.txt.gz 2026-05-05 16:56:28,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:56:28,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:56:28,900 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee2a9d11f026cebdd21/lava-logs.yaml 2026-05-05 16:56:28,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:56:29,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:56:29,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa1ee2a9d11f026cebdd21/lava_callback.json.gz 2026-05-05 16:56:29,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:56:29,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ee2a9d11f026cebdd21 HTTP/1.1" 200 None 2026-05-05 16:56:29,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:56:29,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:56:29,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:56:29,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ee2a9d11f026cebdd21 HTTP/1.1" 200 None 2026-05-05 16:56:29,188 - lava_callback - INFO - Completed processing callback for node 69fa1ee2a9d11f026cebdd21 INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:56:41,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:56:41,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:57:02,278 - lava_callback - INFO - Received callback for node 69fa2147a9d11f026cebe207 INFO: 172.21.0.1:35308 - "POST /node/69fa2147a9d11f026cebe207 HTTP/1.0" 202 Accepted 2026-05-05 16:57:02,284 - lava_callback - INFO - Starting async job submit for node 69fa2147a9d11f026cebe207 2026-05-05 16:57:02,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:57:02,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2147a9d11f026cebe207 HTTP/1.1" 200 None 2026-05-05 16:57:02,301 - lava_callback - DEBUG - Processing node 69fa2147a9d11f026cebe207: baseline-nfs-arm64 2026-05-05 16:57:02,302 - lava_callback - WARNING - Failed to upload log 2026-05-05 16:57:02,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:57:02,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:57:02,447 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa2147a9d11f026cebe207/lava-logs.yaml 2026-05-05 16:57:02,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:57:02,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:57:02,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa2147a9d11f026cebe207/lava_callback.json.gz 2026-05-05 16:57:02,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:57:02,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2147a9d11f026cebe207 HTTP/1.1" 200 None 2026-05-05 16:57:02,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:57:02,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:57:02,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:57:02,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2147a9d11f026cebe207 HTTP/1.1" 200 None 2026-05-05 16:57:02,792 - lava_callback - INFO - Completed processing callback for node 69fa2147a9d11f026cebe207 INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:57:11,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:57:11,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36980 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:58:49,045 - lava_callback - INFO - Received callback for node 69fa1fe4a9d11f026cebe077 INFO: 172.21.0.1:36992 - "POST /node/69fa1fe4a9d11f026cebe077 HTTP/1.0" 202 Accepted 2026-05-05 16:58:49,052 - lava_callback - INFO - Starting async job submit for node 69fa1fe4a9d11f026cebe077 2026-05-05 16:58:49,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:58:49,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe4a9d11f026cebe077 HTTP/1.1" 200 None 2026-05-05 16:58:49,132 - lava_callback - DEBUG - Processing node 69fa1fe4a9d11f026cebe077: ltp-cve 2026-05-05 16:58:49,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:58:49,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:58:49,723 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69fa1fe4a9d11f026cebe077/log.txt.gz 2026-05-05 16:58:50,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:58:50,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:58:50,231 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69fa1fe4a9d11f026cebe077/lava-logs.yaml 2026-05-05 16:58:50,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:58:50,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:58:50,377 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69fa1fe4a9d11f026cebe077/lava_callback.json.gz 2026-05-05 16:58:50,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:58:50,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe4a9d11f026cebe077 HTTP/1.1" 200 None 2026-05-05 16:58:50,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:58:50,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:58:50,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:58:50,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fe4a9d11f026cebe077 HTTP/1.1" 200 None 2026-05-05 16:58:50,477 - lava_callback - INFO - Completed processing callback for node 69fa1fe4a9d11f026cebe077 INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:59:05,409 - lava_callback - INFO - Received callback for node 69fa1e20a9d11f026cebdcb5 INFO: 172.21.0.1:37116 - "POST /node/69fa1e20a9d11f026cebdcb5 HTTP/1.0" 202 Accepted 2026-05-05 16:59:05,418 - lava_callback - INFO - Starting async job submit for node 69fa1e20a9d11f026cebdcb5 2026-05-05 16:59:05,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:05,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1e20a9d11f026cebdcb5 HTTP/1.1" 200 None 2026-05-05 16:59:05,491 - lava_callback - DEBUG - Processing node 69fa1e20a9d11f026cebdcb5: baseline-x86 2026-05-05 16:59:06,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37126 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:59:06,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:06,565 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e20a9d11f026cebdcb5/log.txt.gz 2026-05-05 16:59:07,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:07,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:07,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e20a9d11f026cebdcb5/lava-logs.yaml 2026-05-05 16:59:07,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:07,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:07,663 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fa1e20a9d11f026cebdcb5/lava_callback.json.gz DEBUG: Setup failed for 69fa1e20a9d11f026cebdcb5. Transitting job node result: incomplete -> fail 2026-05-05 16:59:07,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:07,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1e20a9d11f026cebdcb5 HTTP/1.1" 200 None 2026-05-05 16:59:07,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:07,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa188fa9d11f026cebb545 HTTP/1.1" 200 None 2026-05-05 16:59:07,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:07,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1e20a9d11f026cebdcb5 HTTP/1.1" 200 None 2026-05-05 16:59:07,991 - lava_callback - INFO - Completed processing callback for node 69fa1e20a9d11f026cebdcb5 2026-05-05 16:59:09,218 - lava_callback - INFO - Received callback for node 69fa1feaa9d11f026cebe087 INFO: 172.21.0.1:37130 - "POST /node/69fa1feaa9d11f026cebe087 HTTP/1.0" 202 Accepted 2026-05-05 16:59:09,226 - lava_callback - INFO - Starting async job submit for node 69fa1feaa9d11f026cebe087 2026-05-05 16:59:09,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:09,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1feaa9d11f026cebe087 HTTP/1.1" 200 None 2026-05-05 16:59:09,272 - lava_callback - DEBUG - Processing node 69fa1feaa9d11f026cebe087: ltp-input 2026-05-05 16:59:09,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:09,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:09,882 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69fa1feaa9d11f026cebe087/log.txt.gz 2026-05-05 16:59:10,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:10,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:10,359 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69fa1feaa9d11f026cebe087/lava-logs.yaml 2026-05-05 16:59:10,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:10,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:10,531 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69fa1feaa9d11f026cebe087/lava_callback.json.gz 2026-05-05 16:59:10,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:10,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1feaa9d11f026cebe087 HTTP/1.1" 200 None 2026-05-05 16:59:10,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:10,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:59:10,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:10,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1feaa9d11f026cebe087 HTTP/1.1" 200 None 2026-05-05 16:59:10,647 - lava_callback - INFO - Completed processing callback for node 69fa1feaa9d11f026cebe087 2026-05-05 16:59:11,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:11,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:59:21,272 - lava_callback - INFO - Received callback for node 69fa1fe7a9d11f026cebe07d INFO: 172.21.0.1:36478 - "POST /node/69fa1fe7a9d11f026cebe07d HTTP/1.0" 202 Accepted 2026-05-05 16:59:21,283 - lava_callback - INFO - Starting async job submit for node 69fa1fe7a9d11f026cebe07d 2026-05-05 16:59:21,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:21,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe7a9d11f026cebe07d HTTP/1.1" 200 None 2026-05-05 16:59:21,358 - lava_callback - DEBUG - Processing node 69fa1fe7a9d11f026cebe07d: ltp-fs_bind 2026-05-05 16:59:21,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:21,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:21,977 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fa1fe7a9d11f026cebe07d/log.txt.gz 2026-05-05 16:59:22,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:22,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:22,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fa1fe7a9d11f026cebe07d/lava-logs.yaml 2026-05-05 16:59:22,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:22,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:22,575 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69fa1fe7a9d11f026cebe07d/lava_callback.json.gz 2026-05-05 16:59:22,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:22,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe7a9d11f026cebe07d HTTP/1.1" 200 None 2026-05-05 16:59:22,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:22,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:59:22,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:22,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fe7a9d11f026cebe07d HTTP/1.1" 200 None 2026-05-05 16:59:22,703 - lava_callback - INFO - Completed processing callback for node 69fa1fe7a9d11f026cebe07d INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54744 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:59:41,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:41,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34364 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:59:49,058 - lava_callback - INFO - Received callback for node 69fa1fe8a9d11f026cebe080 INFO: 172.21.0.1:34370 - "POST /node/69fa1fe8a9d11f026cebe080 HTTP/1.0" 202 Accepted 2026-05-05 16:59:49,065 - lava_callback - INFO - Starting async job submit for node 69fa1fe8a9d11f026cebe080 2026-05-05 16:59:49,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:49,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe8a9d11f026cebe080 HTTP/1.1" 200 None 2026-05-05 16:59:49,103 - lava_callback - DEBUG - Processing node 69fa1fe8a9d11f026cebe080: ltp-fsx 2026-05-05 16:59:49,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:49,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:49,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69fa1fe8a9d11f026cebe080/log.txt.gz 2026-05-05 16:59:49,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:50,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:50,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69fa1fe8a9d11f026cebe080/lava-logs.yaml 2026-05-05 16:59:50,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:50,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:50,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69fa1fe8a9d11f026cebe080/lava_callback.json.gz 2026-05-05 16:59:50,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:50,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fe8a9d11f026cebe080 HTTP/1.1" 200 None 2026-05-05 16:59:50,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:50,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 16:59:50,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:50,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fe8a9d11f026cebe080 HTTP/1.1" 200 None 2026-05-05 16:59:50,324 - lava_callback - INFO - Completed processing callback for node 69fa1fe8a9d11f026cebe080 INFO: 172.21.0.1:49536 - "GET / HTTP/1.0" 200 OK 2026-05-05 16:59:57,444 - lava_callback - INFO - Received callback for node 69fa21b9a9d11f026cebe23b INFO: 172.21.0.1:49550 - "POST /node/69fa21b9a9d11f026cebe23b HTTP/1.0" 202 Accepted 2026-05-05 16:59:57,451 - lava_callback - INFO - Starting async job submit for node 69fa21b9a9d11f026cebe23b 2026-05-05 16:59:57,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:57,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa21b9a9d11f026cebe23b HTTP/1.1" 200 None 2026-05-05 16:59:57,501 - lava_callback - DEBUG - Processing node 69fa21b9a9d11f026cebe23b: baseline-nfs-arm64 2026-05-05 16:59:58,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:58,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:58,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa21b9a9d11f026cebe23b/log.txt.gz 2026-05-05 16:59:58,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:58,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:58,778 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa21b9a9d11f026cebe23b/lava-logs.yaml 2026-05-05 16:59:58,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 16:59:58,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 16:59:58,930 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa21b9a9d11f026cebe23b/lava_callback.json.gz 2026-05-05 16:59:58,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:58,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa21b9a9d11f026cebe23b HTTP/1.1" 200 None 2026-05-05 16:59:58,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:58,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 16:59:58,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 16:59:59,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa21b9a9d11f026cebe23b HTTP/1.1" 200 None 2026-05-05 16:59:59,006 - lava_callback - INFO - Completed processing callback for node 69fa21b9a9d11f026cebe23b INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:00:10,776 - lava_callback - INFO - Received callback for node 69fa1eefa9d11f026cebdd62 INFO: 172.21.0.1:45106 - "POST /node/69fa1eefa9d11f026cebdd62 HTTP/1.0" 202 Accepted 2026-05-05 17:00:10,782 - lava_callback - INFO - Starting async job submit for node 69fa1eefa9d11f026cebdd62 2026-05-05 17:00:10,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:00:10,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eefa9d11f026cebdd62 HTTP/1.1" 200 None 2026-05-05 17:00:10,815 - lava_callback - DEBUG - Processing node 69fa1eefa9d11f026cebdd62: baseline-nfs-arm64 2026-05-05 17:00:11,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:00:11,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:00:11,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1eefa9d11f026cebdd62/log.txt.gz 2026-05-05 17:00:11,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:00:11,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:00:11,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-05 17:00:11,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:00:11,868 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1eefa9d11f026cebdd62/lava-logs.yaml 2026-05-05 17:00:11,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:00:12,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:00:12,015 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1eefa9d11f026cebdd62/lava_callback.json.gz 2026-05-05 17:00:12,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:00:12,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1eefa9d11f026cebdd62 HTTP/1.1" 200 None 2026-05-05 17:00:12,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:00:12,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:00:12,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:00:12,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1eefa9d11f026cebdd62 HTTP/1.1" 200 None 2026-05-05 17:00:12,086 - lava_callback - INFO - Completed processing callback for node 69fa1eefa9d11f026cebdd62 INFO: 172.21.0.1:45112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:00:41,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:00:41,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:02:49,172 - lava_callback - INFO - Received callback for node 69fa1feba9d11f026cebe08a INFO: 172.21.0.1:55206 - "POST /node/69fa1feba9d11f026cebe08a HTTP/1.0" 202 Accepted 2026-05-05 17:02:49,178 - lava_callback - INFO - Starting async job submit for node 69fa1feba9d11f026cebe08a 2026-05-05 17:02:49,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:02:49,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1feba9d11f026cebe08a HTTP/1.1" 200 None 2026-05-05 17:02:49,222 - lava_callback - DEBUG - Processing node 69fa1feba9d11f026cebe08a: ltp-ipc 2026-05-05 17:02:49,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:02:49,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:02:49,874 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69fa1feba9d11f026cebe08a/log.txt.gz 2026-05-05 17:02:50,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:02:50,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:02:50,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69fa1feba9d11f026cebe08a/lava-logs.yaml 2026-05-05 17:02:50,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:02:50,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:02:50,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69fa1feba9d11f026cebe08a/lava_callback.json.gz 2026-05-05 17:02:50,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:02:50,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1feba9d11f026cebe08a HTTP/1.1" 200 None 2026-05-05 17:02:50,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:02:50,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:02:50,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:02:50,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1feba9d11f026cebe08a HTTP/1.1" 200 None 2026-05-05 17:02:50,520 - lava_callback - INFO - Completed processing callback for node 69fa1feba9d11f026cebe08a INFO: 172.21.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36292 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:03:09,359 - lava_callback - INFO - Received callback for node 69fa1feda9d11f026cebe08d INFO: 172.21.0.1:36298 - "POST /node/69fa1feda9d11f026cebe08d HTTP/1.0" 202 Accepted 2026-05-05 17:03:09,366 - lava_callback - INFO - Starting async job submit for node 69fa1feda9d11f026cebe08d 2026-05-05 17:03:09,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:03:09,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1feda9d11f026cebe08d HTTP/1.1" 200 None 2026-05-05 17:03:09,419 - lava_callback - DEBUG - Processing node 69fa1feda9d11f026cebe08d: ltp-pty 2026-05-05 17:03:09,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:03:10,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:03:10,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69fa1feda9d11f026cebe08d/log.txt.gz 2026-05-05 17:03:10,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:03:10,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:03:10,520 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69fa1feda9d11f026cebe08d/lava-logs.yaml 2026-05-05 17:03:10,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:03:10,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:03:10,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69fa1feda9d11f026cebe08d/lava_callback.json.gz 2026-05-05 17:03:10,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:03:10,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1feda9d11f026cebe08d HTTP/1.1" 200 None 2026-05-05 17:03:10,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:03:10,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:03:10,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:03:10,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1feda9d11f026cebe08d HTTP/1.1" 200 None 2026-05-05 17:03:10,765 - lava_callback - INFO - Completed processing callback for node 69fa1feda9d11f026cebe08d 2026-05-05 17:03:11,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:03:11,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:04:01,475 - lava_callback - INFO - Received callback for node 69fa1feea9d11f026cebe090 INFO: 172.21.0.1:54150 - "POST /node/69fa1feea9d11f026cebe090 HTTP/1.0" 202 Accepted 2026-05-05 17:04:01,482 - lava_callback - INFO - Starting async job submit for node 69fa1feea9d11f026cebe090 2026-05-05 17:04:01,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:01,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1feea9d11f026cebe090 HTTP/1.1" 200 None 2026-05-05 17:04:01,549 - lava_callback - DEBUG - Processing node 69fa1feea9d11f026cebe090: ltp-sched 2026-05-05 17:04:01,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:04:02,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:04:02,062 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69fa1feea9d11f026cebe090/log.txt.gz 2026-05-05 17:04:02,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:04:02,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:04:02,494 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69fa1feea9d11f026cebe090/lava-logs.yaml 2026-05-05 17:04:02,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:04:02,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:04:02,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69fa1feea9d11f026cebe090/lava_callback.json.gz 2026-05-05 17:04:02,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:02,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1feea9d11f026cebe090 HTTP/1.1" 200 None 2026-05-05 17:04:02,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:02,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:04:02,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:02,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1feea9d11f026cebe090 HTTP/1.1" 200 None 2026-05-05 17:04:02,738 - lava_callback - INFO - Completed processing callback for node 69fa1feea9d11f026cebe090 INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:04:11,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:11,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34448 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:04:29,299 - lava_callback - INFO - Received callback for node 69fa1ff0a9d11f026cebe095 INFO: 172.21.0.1:34456 - "POST /node/69fa1ff0a9d11f026cebe095 HTTP/1.0" 202 Accepted 2026-05-05 17:04:29,306 - lava_callback - INFO - Starting async job submit for node 69fa1ff0a9d11f026cebe095 2026-05-05 17:04:29,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:29,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ff0a9d11f026cebe095 HTTP/1.1" 200 None 2026-05-05 17:04:29,384 - lava_callback - DEBUG - Processing node 69fa1ff0a9d11f026cebe095: ltp-smoke 2026-05-05 17:04:29,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:04:30,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:04:30,064 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa1ff0a9d11f026cebe095/log.txt.gz 2026-05-05 17:04:30,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:04:30,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:04:30,479 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa1ff0a9d11f026cebe095/lava-logs.yaml 2026-05-05 17:04:30,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:04:30,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:04:30,623 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa1ff0a9d11f026cebe095/lava_callback.json.gz 2026-05-05 17:04:30,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:30,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ff0a9d11f026cebe095 HTTP/1.1" 200 None 2026-05-05 17:04:30,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:30,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:04:30,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:30,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ff0a9d11f026cebe095 HTTP/1.1" 200 None 2026-05-05 17:04:30,747 - lava_callback - INFO - Completed processing callback for node 69fa1ff0a9d11f026cebe095 2026-05-05 17:04:32,148 - lava_callback - INFO - Received callback for node 69fa230ca9d11f026cebe32f INFO: 172.21.0.1:42584 - "POST /node/69fa230ca9d11f026cebe32f HTTP/1.0" 202 Accepted 2026-05-05 17:04:32,155 - lava_callback - INFO - Starting async job submit for node 69fa230ca9d11f026cebe32f 2026-05-05 17:04:32,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:32,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa230ca9d11f026cebe32f HTTP/1.1" 200 None 2026-05-05 17:04:32,175 - lava_callback - DEBUG - Processing node 69fa230ca9d11f026cebe32f: baseline-arm 2026-05-05 17:04:32,181 - lava_callback - WARNING - Failed to upload log 2026-05-05 17:04:32,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:04:32,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:04:32,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa230ca9d11f026cebe32f/lava-logs.yaml 2026-05-05 17:04:32,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:04:32,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:04:32,413 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa230ca9d11f026cebe32f/lava_callback.json.gz 2026-05-05 17:04:32,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:32,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa230ca9d11f026cebe32f HTTP/1.1" 200 None 2026-05-05 17:04:32,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:32,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:04:32,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:32,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa230ca9d11f026cebe32f HTTP/1.1" 200 None 2026-05-05 17:04:32,493 - lava_callback - INFO - Completed processing callback for node 69fa230ca9d11f026cebe32f INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:04:41,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:04:41,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45032 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:05:59,144 - lava_callback - INFO - Received callback for node 69f7806a096243809b56c7e3 INFO: 172.21.0.1:45034 - "POST /node/69f7806a096243809b56c7e3 HTTP/1.0" 202 Accepted 2026-05-05 17:05:59,149 - lava_callback - INFO - Starting async job submit for node 69f7806a096243809b56c7e3 2026-05-05 17:05:59,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:05:59,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7806a096243809b56c7e3 HTTP/1.1" 200 None 2026-05-05 17:05:59,174 - lava_callback - DEBUG - Processing node 69f7806a096243809b56c7e3: baseline-arm64-baylibre 2026-05-05 17:05:59,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7806a096243809b56c7e3 2026-05-05 17:05:59,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:05:59,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7806a096243809b56c7e3 HTTP/1.1" 200 None 2026-05-05 17:05:59,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:05:59,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 17:05:59,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:05:59,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7806a096243809b56c7e3 HTTP/1.1" 200 None 2026-05-05 17:05:59,222 - lava_callback - ERROR - Error processing callback for node 69f7806a096243809b56c7e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:06:46,092 - lava_callback - INFO - Received callback for node 69fa1fa5a9d11f026cebdf81 INFO: 172.21.0.1:48540 - "POST /node/69fa1fa5a9d11f026cebdf81 HTTP/1.0" 202 Accepted 2026-05-05 17:06:46,099 - lava_callback - INFO - Starting async job submit for node 69fa1fa5a9d11f026cebdf81 2026-05-05 17:06:46,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:46,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa5a9d11f026cebdf81 HTTP/1.1" 200 None 2026-05-05 17:06:46,169 - lava_callback - DEBUG - Processing node 69fa1fa5a9d11f026cebdf81: baseline-arm INFO: 172.21.0.1:48548 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:06:46,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:06:46,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:06:46,996 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa5a9d11f026cebdf81/log.txt.gz 2026-05-05 17:06:47,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:06:47,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:06:47,544 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa5a9d11f026cebdf81/lava-logs.yaml 2026-05-05 17:06:47,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:06:47,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:06:47,701 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa1fa5a9d11f026cebdf81/lava_callback.json.gz DEBUG: Setup failed for 69fa1fa5a9d11f026cebdf81. Transitting job node result: incomplete -> fail 2026-05-05 17:06:47,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:47,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fa5a9d11f026cebdf81 HTTP/1.1" 200 None 2026-05-05 17:06:47,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:47,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:06:47,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:47,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fa5a9d11f026cebdf81 HTTP/1.1" 200 None 2026-05-05 17:06:47,985 - lava_callback - INFO - Completed processing callback for node 69fa1fa5a9d11f026cebdf81 2026-05-05 17:06:48,583 - lava_callback - INFO - Received callback for node 69fa1ef2a9d11f026cebdd68 INFO: 172.21.0.1:48554 - "POST /node/69fa1ef2a9d11f026cebdd68 HTTP/1.0" 202 Accepted 2026-05-05 17:06:48,593 - lava_callback - INFO - Starting async job submit for node 69fa1ef2a9d11f026cebdd68 2026-05-05 17:06:48,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:48,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef2a9d11f026cebdd68 HTTP/1.1" 200 None 2026-05-05 17:06:48,675 - lava_callback - DEBUG - Processing node 69fa1ef2a9d11f026cebdd68: baseline-nfs-arm64 2026-05-05 17:06:49,443 - lava_callback - INFO - Received callback for node 69fa1ff2a9d11f026cebe0a0 INFO: 172.21.0.1:48556 - "POST /node/69fa1ff2a9d11f026cebe0a0 HTTP/1.0" 202 Accepted 2026-05-05 17:06:49,461 - lava_callback - INFO - Starting async job submit for node 69fa1ff2a9d11f026cebe0a0 2026-05-05 17:06:49,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:49,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ff2a9d11f026cebe0a0 HTTP/1.1" 200 None 2026-05-05 17:06:49,638 - lava_callback - DEBUG - Processing node 69fa1ff2a9d11f026cebe0a0: ltp-syscalls-ipc 2026-05-05 17:06:50,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:06:50,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:06:50,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:06:50,529 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fa1ff2a9d11f026cebe0a0/log.txt.gz 2026-05-05 17:06:50,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:06:50,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:06:50,781 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef2a9d11f026cebdd68/log.txt.gz 2026-05-05 17:06:51,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:06:51,062 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fa1ff2a9d11f026cebe0a0/lava-logs.yaml 2026-05-05 17:06:51,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:06:51,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:06:51,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69fa1ff2a9d11f026cebe0a0/lava_callback.json.gz 2026-05-05 17:06:51,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:51,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ff2a9d11f026cebe0a0 HTTP/1.1" 200 None 2026-05-05 17:06:51,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:51,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:06:51,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:06:51,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:51,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ff2a9d11f026cebe0a0 HTTP/1.1" 200 None 2026-05-05 17:06:51,634 - lava_callback - INFO - Completed processing callback for node 69fa1ff2a9d11f026cebe0a0 2026-05-05 17:06:51,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:06:51,845 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef2a9d11f026cebdd68/lava-logs.yaml 2026-05-05 17:06:51,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:06:52,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:06:52,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa1ef2a9d11f026cebdd68/lava_callback.json.gz DEBUG: Setup failed for 69fa1ef2a9d11f026cebdd68. Transitting job node result: incomplete -> fail 2026-05-05 17:06:52,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:52,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ef2a9d11f026cebdd68 HTTP/1.1" 200 None 2026-05-05 17:06:52,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:52,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:06:52,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:06:52,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ef2a9d11f026cebdd68 HTTP/1.1" 200 None 2026-05-05 17:06:52,251 - lava_callback - INFO - Completed processing callback for node 69fa1ef2a9d11f026cebdd68 INFO: 172.21.0.1:59270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55088 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:07:09,388 - lava_callback - INFO - Received callback for node 69fa1ff4a9d11f026cebe0a3 INFO: 172.21.0.1:55100 - "POST /node/69fa1ff4a9d11f026cebe0a3 HTTP/1.0" 202 Accepted 2026-05-05 17:07:09,395 - lava_callback - INFO - Starting async job submit for node 69fa1ff4a9d11f026cebe0a3 2026-05-05 17:07:09,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:07:09,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ff4a9d11f026cebe0a3 HTTP/1.1" 200 None 2026-05-05 17:07:09,442 - lava_callback - DEBUG - Processing node 69fa1ff4a9d11f026cebe0a3: ltp-timers 2026-05-05 17:07:09,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:07:10,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:07:10,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69fa1ff4a9d11f026cebe0a3/log.txt.gz 2026-05-05 17:07:10,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:07:10,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:07:10,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69fa1ff4a9d11f026cebe0a3/lava-logs.yaml 2026-05-05 17:07:10,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:07:10,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:07:10,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69fa1ff4a9d11f026cebe0a3/lava_callback.json.gz 2026-05-05 17:07:10,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:07:10,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ff4a9d11f026cebe0a3 HTTP/1.1" 200 None 2026-05-05 17:07:10,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:07:10,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:07:10,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:07:10,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ff4a9d11f026cebe0a3 HTTP/1.1" 200 None 2026-05-05 17:07:10,585 - lava_callback - INFO - Completed processing callback for node 69fa1ff4a9d11f026cebe0a3 2026-05-05 17:07:11,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:07:11,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:41636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44348 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:44356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44360 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:08:19,161 - lava_callback - INFO - Received callback for node 69f780ff096243809b56c843 INFO: 172.21.0.1:44366 - "POST /node/69f780ff096243809b56c843 HTTP/1.0" 202 Accepted 2026-05-05 17:08:19,172 - lava_callback - INFO - Starting async job submit for node 69f780ff096243809b56c843 2026-05-05 17:08:19,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:08:19,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f780ff096243809b56c843 HTTP/1.1" 200 None 2026-05-05 17:08:19,209 - lava_callback - DEBUG - Processing node 69f780ff096243809b56c843: baseline-arm64-baylibre 2026-05-05 17:08:19,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f780ff096243809b56c843 2026-05-05 17:08:19,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:08:19,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f780ff096243809b56c843 HTTP/1.1" 200 None 2026-05-05 17:08:19,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:08:19,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 17:08:19,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:08:19,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f780ff096243809b56c843 HTTP/1.1" 200 None 2026-05-05 17:08:19,305 - lava_callback - ERROR - Error processing callback for node 69f780ff096243809b56c843: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 17:08:21,612 - lava_callback - INFO - Received callback for node 69fa1ff5a9d11f026cebe0a6 INFO: 172.21.0.1:50900 - "POST /node/69fa1ff5a9d11f026cebe0a6 HTTP/1.0" 202 Accepted 2026-05-05 17:08:21,624 - lava_callback - INFO - Starting async job submit for node 69fa1ff5a9d11f026cebe0a6 2026-05-05 17:08:21,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:08:21,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ff5a9d11f026cebe0a6 HTTP/1.1" 200 None 2026-05-05 17:08:21,694 - lava_callback - DEBUG - Processing node 69fa1ff5a9d11f026cebe0a6: ltp-watchqueue 2026-05-05 17:08:22,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:08:22,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:08:22,673 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fa1ff5a9d11f026cebe0a6/log.txt.gz 2026-05-05 17:08:22,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:08:23,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:08:23,308 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fa1ff5a9d11f026cebe0a6/lava-logs.yaml 2026-05-05 17:08:23,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:08:23,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:08:23,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69fa1ff5a9d11f026cebe0a6/lava_callback.json.gz 2026-05-05 17:08:23,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:08:23,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1ff5a9d11f026cebe0a6 HTTP/1.1" 200 None 2026-05-05 17:08:23,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:08:23,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:08:23,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:08:23,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1ff5a9d11f026cebe0a6 HTTP/1.1" 200 None 2026-05-05 17:08:23,688 - lava_callback - INFO - Completed processing callback for node 69fa1ff5a9d11f026cebe0a6 INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:08:41,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:08:42,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:09:42,113 - lava_callback - INFO - Received callback for node 69fa1fcca9d11f026cebe036 INFO: 172.21.0.1:56336 - "POST /node/69fa1fcca9d11f026cebe036 HTTP/1.0" 202 Accepted 2026-05-05 17:09:42,162 - lava_callback - INFO - Starting async job submit for node 69fa1fcca9d11f026cebe036 2026-05-05 17:09:42,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:09:42,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fcca9d11f026cebe036 HTTP/1.1" 200 None 2026-05-05 17:09:42,214 - lava_callback - DEBUG - Processing node 69fa1fcca9d11f026cebe036: baseline-arm-pengutronix 2026-05-05 17:09:42,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:09:42,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:09:42,475 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fcca9d11f026cebe036/log.txt.gz 2026-05-05 17:09:42,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:09:42,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:09:42,651 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fcca9d11f026cebe036/lava-logs.yaml 2026-05-05 17:09:42,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:09:42,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:09:42,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa1fcca9d11f026cebe036/lava_callback.json.gz DEBUG: Setup failed for 69fa1fcca9d11f026cebe036. Transitting job node result: incomplete -> fail 2026-05-05 17:09:42,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:09:42,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1fcca9d11f026cebe036 HTTP/1.1" 200 None 2026-05-05 17:09:42,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:09:42,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:09:42,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:09:42,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa1fcca9d11f026cebe036 HTTP/1.1" 200 None 2026-05-05 17:09:42,962 - lava_callback - INFO - Completed processing callback for node 69fa1fcca9d11f026cebe036 INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:10:12,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:10:12,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:11:19,275 - lava_callback - INFO - Received callback for node 69f781b3096243809b56c8af INFO: 172.21.0.1:46786 - "POST /node/69f781b3096243809b56c8af HTTP/1.0" 202 Accepted 2026-05-05 17:11:19,281 - lava_callback - INFO - Starting async job submit for node 69f781b3096243809b56c8af 2026-05-05 17:11:19,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:11:19,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f781b3096243809b56c8af HTTP/1.1" 200 None 2026-05-05 17:11:19,296 - lava_callback - DEBUG - Processing node 69f781b3096243809b56c8af: baseline-arm64-baylibre 2026-05-05 17:11:19,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f781b3096243809b56c8af 2026-05-05 17:11:19,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:11:19,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f781b3096243809b56c8af HTTP/1.1" 200 None 2026-05-05 17:11:19,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:11:19,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 17:11:19,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:11:19,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f781b3096243809b56c8af HTTP/1.1" 200 None 2026-05-05 17:11:19,355 - lava_callback - ERROR - Error processing callback for node 69f781b3096243809b56c8af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:14:19,446 - lava_callback - INFO - Received callback for node 69f78268096243809b56c915 INFO: 172.21.0.1:37710 - "POST /node/69f78268096243809b56c915 HTTP/1.0" 202 Accepted 2026-05-05 17:14:19,452 - lava_callback - INFO - Starting async job submit for node 69f78268096243809b56c915 2026-05-05 17:14:19,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:14:19,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78268096243809b56c915 HTTP/1.1" 200 None 2026-05-05 17:14:19,466 - lava_callback - DEBUG - Processing node 69f78268096243809b56c915: baseline-arm64-baylibre 2026-05-05 17:14:19,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78268096243809b56c915 2026-05-05 17:14:19,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:14:19,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78268096243809b56c915 HTTP/1.1" 200 None 2026-05-05 17:14:19,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:14:19,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 17:14:19,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:14:19,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78268096243809b56c915 HTTP/1.1" 200 None 2026-05-05 17:14:19,520 - lava_callback - ERROR - Error processing callback for node 69f78268096243809b56c915: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:16:19,513 - lava_callback - INFO - Received callback for node 69f782d4096243809b56c94f INFO: 172.21.0.1:42312 - "POST /node/69f782d4096243809b56c94f HTTP/1.0" 202 Accepted 2026-05-05 17:16:19,520 - lava_callback - INFO - Starting async job submit for node 69f782d4096243809b56c94f 2026-05-05 17:16:19,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:16:19,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f782d4096243809b56c94f HTTP/1.1" 200 None 2026-05-05 17:16:19,588 - lava_callback - DEBUG - Processing node 69f782d4096243809b56c94f: baseline-arm64-baylibre 2026-05-05 17:16:19,588 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f782d4096243809b56c94f 2026-05-05 17:16:19,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:16:19,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f782d4096243809b56c94f HTTP/1.1" 200 None 2026-05-05 17:16:19,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:16:19,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 17:16:19,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:16:19,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f782d4096243809b56c94f HTTP/1.1" 200 None 2026-05-05 17:16:19,669 - lava_callback - ERROR - Error processing callback for node 69f782d4096243809b56c94f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42720 - "GET /node/69943c6e5ae459b9df3d5fbb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55610 - "GET /node/6992d25331166481c8dd2c46%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55622 - "GET /node/69efafa08305534e9723bf78%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55202 - "GET /node/6992d25231166481c8dd2c42%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-05 17:21:13,099 - lava_callback - INFO - Received callback for node 69fa269da9d11f026cebe4eb INFO: 172.21.0.1:55210 - "POST /node/69fa269da9d11f026cebe4eb HTTP/1.0" 202 Accepted 2026-05-05 17:21:13,107 - lava_callback - INFO - Starting async job submit for node 69fa269da9d11f026cebe4eb 2026-05-05 17:21:13,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:13,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa269da9d11f026cebe4eb HTTP/1.1" 200 None 2026-05-05 17:21:13,162 - lava_callback - DEBUG - Processing node 69fa269da9d11f026cebe4eb: baseline-arm-pengutronix 2026-05-05 17:21:13,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:21:13,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:21:13,493 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa269da9d11f026cebe4eb/log.txt.gz 2026-05-05 17:21:13,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:21:13,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:21:13,809 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa269da9d11f026cebe4eb/lava-logs.yaml 2026-05-05 17:21:13,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:21:13,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:21:13,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa269da9d11f026cebe4eb/lava_callback.json.gz 2026-05-05 17:21:14,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:14,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa269da9d11f026cebe4eb HTTP/1.1" 200 None 2026-05-05 17:21:14,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:14,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:21:14,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:14,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa269da9d11f026cebe4eb HTTP/1.1" 200 None 2026-05-05 17:21:14,135 - lava_callback - INFO - Completed processing callback for node 69fa269da9d11f026cebe4eb INFO: 172.21.0.1:55214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46928 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:21:29,276 - lava_callback - INFO - Received callback for node 69fa26cda9d11f026cebe507 INFO: 172.21.0.1:46938 - "POST /node/69fa26cda9d11f026cebe507 HTTP/1.0" 202 Accepted 2026-05-05 17:21:29,287 - lava_callback - INFO - Starting async job submit for node 69fa26cda9d11f026cebe507 2026-05-05 17:21:29,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:29,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa26cda9d11f026cebe507 HTTP/1.1" 200 None 2026-05-05 17:21:29,352 - lava_callback - DEBUG - Processing node 69fa26cda9d11f026cebe507: baseline-arm64-foundriesio 2026-05-05 17:21:29,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:21:29,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:21:29,924 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fa26cda9d11f026cebe507/log.txt.gz 2026-05-05 17:21:30,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:21:30,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:21:30,336 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fa26cda9d11f026cebe507/lava-logs.yaml 2026-05-05 17:21:30,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:21:30,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:21:30,467 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69fa26cda9d11f026cebe507/lava_callback.json.gz 2026-05-05 17:21:30,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:30,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa26cda9d11f026cebe507 HTTP/1.1" 200 None 2026-05-05 17:21:30,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:30,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:21:30,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:30,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa26cda9d11f026cebe507 HTTP/1.1" 200 None 2026-05-05 17:21:30,548 - lava_callback - INFO - Completed processing callback for node 69fa26cda9d11f026cebe507 INFO: 172.21.0.1:56516 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:21:39,794 - lava_callback - INFO - Received callback for node 69f7841b096243809b56ca34 INFO: 172.21.0.1:47246 - "POST /node/69f7841b096243809b56ca34 HTTP/1.0" 202 Accepted 2026-05-05 17:21:39,800 - lava_callback - INFO - Starting async job submit for node 69f7841b096243809b56ca34 2026-05-05 17:21:39,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:39,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7841b096243809b56ca34 HTTP/1.1" 200 None 2026-05-05 17:21:39,815 - lava_callback - DEBUG - Processing node 69f7841b096243809b56ca34: baseline-arm64-baylibre 2026-05-05 17:21:39,816 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7841b096243809b56ca34 2026-05-05 17:21:39,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:39,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7841b096243809b56ca34 HTTP/1.1" 200 None 2026-05-05 17:21:39,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:39,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 17:21:39,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:39,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7841b096243809b56ca34 HTTP/1.1" 200 None 2026-05-05 17:21:39,864 - lava_callback - ERROR - Error processing callback for node 69f7841b096243809b56ca34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 17:21:42,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:21:42,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:22:07,416 - lava_callback - INFO - Received callback for node 69fa2700a9d11f026cebe520 INFO: 172.21.0.1:37470 - "POST /node/69fa2700a9d11f026cebe520 HTTP/1.0" 202 Accepted 2026-05-05 17:22:07,424 - lava_callback - INFO - Starting async job submit for node 69fa2700a9d11f026cebe520 2026-05-05 17:22:07,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:22:07,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2700a9d11f026cebe520 HTTP/1.1" 200 None 2026-05-05 17:22:07,474 - lava_callback - DEBUG - Processing node 69fa2700a9d11f026cebe520: baseline-arm64 2026-05-05 17:22:07,609 - lava_callback - WARNING - Failed to upload log 2026-05-05 17:22:07,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:22:07,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:22:07,800 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2700a9d11f026cebe520/lava-logs.yaml 2026-05-05 17:22:07,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:22:07,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:22:07,889 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2700a9d11f026cebe520/lava_callback.json.gz 2026-05-05 17:22:07,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:22:07,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2700a9d11f026cebe520 HTTP/1.1" 200 None 2026-05-05 17:22:07,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:22:07,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:22:07,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:22:07,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2700a9d11f026cebe520 HTTP/1.1" 200 None 2026-05-05 17:22:08,077 - lava_callback - INFO - Completed processing callback for node 69fa2700a9d11f026cebe520 2026-05-05 17:22:12,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:22:12,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET /node/69411c1f459ff5fc64d2a919%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:23:50,727 - lava_callback - INFO - Received callback for node 69fa274ca9d11f026cebe562 INFO: 172.21.0.1:42434 - "POST /node/69fa274ca9d11f026cebe562 HTTP/1.0" 202 Accepted 2026-05-05 17:23:50,734 - lava_callback - INFO - Starting async job submit for node 69fa274ca9d11f026cebe562 2026-05-05 17:23:50,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:23:50,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa274ca9d11f026cebe562 HTTP/1.1" 200 None 2026-05-05 17:23:50,787 - lava_callback - DEBUG - Processing node 69fa274ca9d11f026cebe562: baseline-arm64 2026-05-05 17:23:51,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:23:51,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:23:51,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa274ca9d11f026cebe562/log.txt.gz 2026-05-05 17:23:51,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:23:51,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:23:51,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa274ca9d11f026cebe562/lava-logs.yaml 2026-05-05 17:23:51,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:23:51,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:23:51,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa274ca9d11f026cebe562/lava_callback.json.gz 2026-05-05 17:23:51,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:23:51,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa274ca9d11f026cebe562 HTTP/1.1" 200 None 2026-05-05 17:23:51,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:23:51,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:23:51,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:23:51,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa274ca9d11f026cebe562 HTTP/1.1" 200 None 2026-05-05 17:23:51,604 - lava_callback - INFO - Completed processing callback for node 69fa274ca9d11f026cebe562 INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET /node/693e2307407f32424eb57a2e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52942 - "GET /node/69934b1b523507f3806a554a%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-05 17:24:12,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:24:12,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:26:22,221 - lava_callback - INFO - Received callback for node 69fa27e9a9d11f026cebe5b0 INFO: 172.21.0.1:59456 - "POST /node/69fa27e9a9d11f026cebe5b0 HTTP/1.0" 202 Accepted 2026-05-05 17:26:22,229 - lava_callback - INFO - Starting async job submit for node 69fa27e9a9d11f026cebe5b0 2026-05-05 17:26:22,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:26:22,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa27e9a9d11f026cebe5b0 HTTP/1.1" 200 None 2026-05-05 17:26:22,274 - lava_callback - DEBUG - Processing node 69fa27e9a9d11f026cebe5b0: baseline-arm64 2026-05-05 17:26:22,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:26:22,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:26:22,943 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa27e9a9d11f026cebe5b0/log.txt.gz 2026-05-05 17:26:23,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:26:23,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:26:23,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa27e9a9d11f026cebe5b0/lava-logs.yaml 2026-05-05 17:26:23,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:26:23,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:26:23,590 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa27e9a9d11f026cebe5b0/lava_callback.json.gz 2026-05-05 17:26:23,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:26:23,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa27e9a9d11f026cebe5b0 HTTP/1.1" 200 None 2026-05-05 17:26:23,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:26:23,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:26:23,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:26:23,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa27e9a9d11f026cebe5b0 HTTP/1.1" 200 None 2026-05-05 17:26:23,759 - lava_callback - INFO - Completed processing callback for node 69fa27e9a9d11f026cebe5b0 INFO: 172.21.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:26:42,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:26:42,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56998 - "GET /node/6993512e523507f3806a6e37%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59692 - "GET /node/69ef6b4c8305534e97239d70%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59702 - "GET /node/6992fda031166481c8ddf035%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:27:57,449 - lava_callback - INFO - Received callback for node 69fa2886a9d11f026cebe600 INFO: 172.21.0.1:59716 - "POST /node/69fa2886a9d11f026cebe600 HTTP/1.0" 202 Accepted 2026-05-05 17:27:57,459 - lava_callback - INFO - Starting async job submit for node 69fa2886a9d11f026cebe600 2026-05-05 17:27:57,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:27:57,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2886a9d11f026cebe600 HTTP/1.1" 200 None 2026-05-05 17:27:57,481 - lava_callback - DEBUG - Processing node 69fa2886a9d11f026cebe600: baseline-nfs-arm64 2026-05-05 17:27:57,484 - lava_callback - WARNING - Failed to upload log 2026-05-05 17:27:57,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:27:57,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:27:57,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa2886a9d11f026cebe600/lava-logs.yaml 2026-05-05 17:27:57,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:27:57,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:27:57,701 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa2886a9d11f026cebe600/lava_callback.json.gz 2026-05-05 17:27:57,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:27:57,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2886a9d11f026cebe600 HTTP/1.1" 200 None 2026-05-05 17:27:57,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:27:57,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:27:57,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:27:57,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2886a9d11f026cebe600 HTTP/1.1" 200 None 2026-05-05 17:27:57,796 - lava_callback - INFO - Completed processing callback for node 69fa2886a9d11f026cebe600 INFO: 172.21.0.1:54352 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:28:12,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:28:12,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET /node/69ef692a8305534e972399b1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET /node/69943abf5ae459b9df3d55de%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57216 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:29:22,175 - lava_callback - INFO - Received callback for node 69fa2833a9d11f026cebe5db INFO: 172.21.0.1:35128 - "POST /node/69fa2833a9d11f026cebe5db HTTP/1.0" 202 Accepted 2026-05-05 17:29:22,181 - lava_callback - INFO - Starting async job submit for node 69fa2833a9d11f026cebe5db 2026-05-05 17:29:22,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:29:22,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2833a9d11f026cebe5db HTTP/1.1" 200 None 2026-05-05 17:29:22,213 - lava_callback - DEBUG - Processing node 69fa2833a9d11f026cebe5db: baseline-arm64 2026-05-05 17:29:22,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:29:22,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:29:22,648 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2833a9d11f026cebe5db/log.txt.gz 2026-05-05 17:29:22,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:29:23,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:29:23,020 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2833a9d11f026cebe5db/lava-logs.yaml 2026-05-05 17:29:23,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:29:23,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:29:23,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2833a9d11f026cebe5db/lava_callback.json.gz 2026-05-05 17:29:23,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:29:23,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2833a9d11f026cebe5db HTTP/1.1" 200 None 2026-05-05 17:29:23,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:29:23,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:29:23,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:29:23,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2833a9d11f026cebe5db HTTP/1.1" 200 None 2026-05-05 17:29:23,308 - lava_callback - INFO - Completed processing callback for node 69fa2833a9d11f026cebe5db INFO: 172.21.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:29:42,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:29:42,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48952 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:30:07,991 - lava_callback - INFO - Received callback for node 69fa2909a9d11f026cebe642 INFO: 172.21.0.1:48954 - "POST /node/69fa2909a9d11f026cebe642 HTTP/1.0" 202 Accepted 2026-05-05 17:30:07,998 - lava_callback - INFO - Starting async job submit for node 69fa2909a9d11f026cebe642 2026-05-05 17:30:08,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:30:08,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2909a9d11f026cebe642 HTTP/1.1" 200 None 2026-05-05 17:30:08,017 - lava_callback - DEBUG - Processing node 69fa2909a9d11f026cebe642: baseline-arm 2026-05-05 17:30:08,023 - lava_callback - WARNING - Failed to upload log 2026-05-05 17:30:08,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:30:08,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:30:08,133 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa2909a9d11f026cebe642/lava-logs.yaml 2026-05-05 17:30:08,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:30:08,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:30:08,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa2909a9d11f026cebe642/lava_callback.json.gz 2026-05-05 17:30:08,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:30:08,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2909a9d11f026cebe642 HTTP/1.1" 200 None 2026-05-05 17:30:08,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:30:08,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:30:08,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:30:08,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2909a9d11f026cebe642 HTTP/1.1" 200 None 2026-05-05 17:30:08,318 - lava_callback - INFO - Completed processing callback for node 69fa2909a9d11f026cebe642 2026-05-05 17:30:12,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:30:12,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47600 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:31:08,623 - lava_callback - INFO - Received callback for node 69fa279fa9d11f026cebe590 INFO: 172.21.0.1:47612 - "POST /node/69fa279fa9d11f026cebe590 HTTP/1.0" 202 Accepted 2026-05-05 17:31:08,630 - lava_callback - INFO - Starting async job submit for node 69fa279fa9d11f026cebe590 2026-05-05 17:31:08,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:31:08,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa279fa9d11f026cebe590 HTTP/1.1" 200 None 2026-05-05 17:31:08,679 - lava_callback - DEBUG - Processing node 69fa279fa9d11f026cebe590: baseline-arm64 2026-05-05 17:31:09,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:31:09,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:31:09,179 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa279fa9d11f026cebe590/log.txt.gz 2026-05-05 17:31:09,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:31:09,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:31:09,598 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa279fa9d11f026cebe590/lava-logs.yaml 2026-05-05 17:31:09,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:31:09,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:31:09,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa279fa9d11f026cebe590/lava_callback.json.gz DEBUG: Setup failed for 69fa279fa9d11f026cebe590. Transitting job node result: incomplete -> fail 2026-05-05 17:31:09,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:31:09,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa279fa9d11f026cebe590 HTTP/1.1" 200 None 2026-05-05 17:31:09,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:31:09,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:31:09,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:31:09,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa279fa9d11f026cebe590 HTTP/1.1" 200 None 2026-05-05 17:31:10,038 - lava_callback - INFO - Completed processing callback for node 69fa279fa9d11f026cebe590 2026-05-05 17:31:12,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:31:12,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34472 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:31:29,556 - lava_callback - INFO - Received callback for node 69fa2906a9d11f026cebe63c INFO: 172.21.0.1:34486 - "POST /node/69fa2906a9d11f026cebe63c HTTP/1.0" 202 Accepted 2026-05-05 17:31:29,561 - lava_callback - INFO - Starting async job submit for node 69fa2906a9d11f026cebe63c 2026-05-05 17:31:29,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:31:29,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2906a9d11f026cebe63c HTTP/1.1" 200 None 2026-05-05 17:31:29,594 - lava_callback - DEBUG - Processing node 69fa2906a9d11f026cebe63c: baseline-x86 2026-05-05 17:31:29,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:31:29,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:31:29,938 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69fa2906a9d11f026cebe63c/log.txt.gz 2026-05-05 17:31:30,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:31:30,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:31:30,266 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69fa2906a9d11f026cebe63c/lava-logs.yaml 2026-05-05 17:31:30,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:31:30,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:31:30,372 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69fa2906a9d11f026cebe63c/lava_callback.json.gz 2026-05-05 17:31:30,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:31:30,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2906a9d11f026cebe63c HTTP/1.1" 200 None 2026-05-05 17:31:30,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:31:30,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa188fa9d11f026cebb545 HTTP/1.1" 200 None 2026-05-05 17:31:30,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:31:30,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2906a9d11f026cebe63c HTTP/1.1" 200 None 2026-05-05 17:31:30,458 - lava_callback - INFO - Completed processing callback for node 69fa2906a9d11f026cebe63c INFO: 172.21.0.1:49726 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:31:42,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:31:42,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52486 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:38:04,355 - lava_callback - INFO - Received callback for node 69f787ea096243809b56cc78 INFO: 172.21.0.1:55464 - "POST /node/69f787ea096243809b56cc78 HTTP/1.0" 202 Accepted 2026-05-05 17:38:04,361 - lava_callback - INFO - Starting async job submit for node 69f787ea096243809b56cc78 2026-05-05 17:38:04,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:38:04,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f787ea096243809b56cc78 HTTP/1.1" 200 None 2026-05-05 17:38:04,376 - lava_callback - DEBUG - Processing node 69f787ea096243809b56cc78: baseline-arm-clabbe 2026-05-05 17:38:04,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f787ea096243809b56cc78 2026-05-05 17:38:04,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:38:04,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f787ea096243809b56cc78 HTTP/1.1" 200 None 2026-05-05 17:38:04,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:38:04,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 17:38:04,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:38:04,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f787ea096243809b56cc78 HTTP/1.1" 200 None 2026-05-05 17:38:04,432 - lava_callback - ERROR - Error processing callback for node 69f787ea096243809b56cc78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET /node/69934e1e523507f3806a6140%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:38:44,271 - lava_callback - INFO - Received callback for node 69f78812096243809b56cc92 INFO: 172.21.0.1:36470 - "POST /node/69f78812096243809b56cc92 HTTP/1.0" 202 Accepted 2026-05-05 17:38:44,280 - lava_callback - INFO - Starting async job submit for node 69f78812096243809b56cc92 2026-05-05 17:38:44,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:38:44,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78812096243809b56cc92 HTTP/1.1" 200 None 2026-05-05 17:38:44,296 - lava_callback - DEBUG - Processing node 69f78812096243809b56cc92: baseline-arm-clabbe 2026-05-05 17:38:44,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78812096243809b56cc92 2026-05-05 17:38:44,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:38:44,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78812096243809b56cc92 HTTP/1.1" 200 None 2026-05-05 17:38:44,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:38:44,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 17:38:44,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:38:44,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78812096243809b56cc92 HTTP/1.1" 200 None 2026-05-05 17:38:44,346 - lava_callback - ERROR - Error processing callback for node 69f78812096243809b56cc92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET /node/69ef76018305534e9723a4e0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:41:04,341 - lava_callback - INFO - Received callback for node 69f788a2096243809b56cce7 INFO: 172.21.0.1:48730 - "POST /node/69f788a2096243809b56cce7 HTTP/1.0" 202 Accepted 2026-05-05 17:41:04,346 - lava_callback - INFO - Starting async job submit for node 69f788a2096243809b56cce7 2026-05-05 17:41:04,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:04,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f788a2096243809b56cce7 HTTP/1.1" 200 None 2026-05-05 17:41:04,362 - lava_callback - DEBUG - Processing node 69f788a2096243809b56cce7: baseline-arm-clabbe 2026-05-05 17:41:04,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f788a2096243809b56cce7 2026-05-05 17:41:04,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:04,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f788a2096243809b56cce7 HTTP/1.1" 200 None 2026-05-05 17:41:04,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:04,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 17:41:04,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:04,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f788a2096243809b56cce7 HTTP/1.1" 200 None 2026-05-05 17:41:04,409 - lava_callback - ERROR - Error processing callback for node 69f788a2096243809b56cce7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:41:23,211 - lava_callback - INFO - Received callback for node 69fa2798a9d11f026cebe584 INFO: 172.21.0.1:41300 - "POST /node/69fa2798a9d11f026cebe584 HTTP/1.0" 202 Accepted 2026-05-05 17:41:23,218 - lava_callback - INFO - Starting async job submit for node 69fa2798a9d11f026cebe584 2026-05-05 17:41:23,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:23,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2798a9d11f026cebe584 HTTP/1.1" 200 None 2026-05-05 17:41:23,291 - lava_callback - DEBUG - Processing node 69fa2798a9d11f026cebe584: ltp-smoke 2026-05-05 17:41:23,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:41:23,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:41:23,878 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa2798a9d11f026cebe584/log.txt.gz 2026-05-05 17:41:24,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:41:24,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:41:24,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa2798a9d11f026cebe584/lava-logs.yaml 2026-05-05 17:41:24,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:41:24,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:41:24,496 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa2798a9d11f026cebe584/lava_callback.json.gz 2026-05-05 17:41:24,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:24,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2798a9d11f026cebe584 HTTP/1.1" 200 None 2026-05-05 17:41:24,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:24,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa186ca9d11f026cebb51e HTTP/1.1" 200 None 2026-05-05 17:41:24,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:24,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2798a9d11f026cebe584 HTTP/1.1" 200 None 2026-05-05 17:41:24,835 - lava_callback - INFO - Completed processing callback for node 69fa2798a9d11f026cebe584 INFO: 172.21.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50856 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:41:42,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:42,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:41:44,359 - lava_callback - INFO - Received callback for node 69f788c6096243809b56ccf3 INFO: 172.21.0.1:41096 - "POST /node/69f788c6096243809b56ccf3 HTTP/1.0" 202 Accepted 2026-05-05 17:41:44,366 - lava_callback - INFO - Starting async job submit for node 69f788c6096243809b56ccf3 2026-05-05 17:41:44,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:44,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f788c6096243809b56ccf3 HTTP/1.1" 200 None 2026-05-05 17:41:44,382 - lava_callback - DEBUG - Processing node 69f788c6096243809b56ccf3: baseline-arm-clabbe 2026-05-05 17:41:44,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f788c6096243809b56ccf3 2026-05-05 17:41:44,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:44,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f788c6096243809b56ccf3 HTTP/1.1" 200 None 2026-05-05 17:41:44,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:44,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 17:41:44,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:41:44,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f788c6096243809b56ccf3 HTTP/1.1" 200 None 2026-05-05 17:41:44,437 - lava_callback - ERROR - Error processing callback for node 69f788c6096243809b56ccf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43464 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:42:24,442 - lava_callback - INFO - Received callback for node 69f788eb096243809b56cd04 INFO: 172.21.0.1:50854 - "POST /node/69f788eb096243809b56cd04 HTTP/1.0" 202 Accepted 2026-05-05 17:42:24,451 - lava_callback - INFO - Starting async job submit for node 69f788eb096243809b56cd04 2026-05-05 17:42:24,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:42:24,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f788eb096243809b56cd04 HTTP/1.1" 200 None 2026-05-05 17:42:24,467 - lava_callback - DEBUG - Processing node 69f788eb096243809b56cd04: baseline-arm-clabbe 2026-05-05 17:42:24,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f788eb096243809b56cd04 2026-05-05 17:42:24,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:42:24,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f788eb096243809b56cd04 HTTP/1.1" 200 None 2026-05-05 17:42:24,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:42:24,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 17:42:24,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:42:24,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f788eb096243809b56cd04 HTTP/1.1" 200 None 2026-05-05 17:42:24,574 - lava_callback - ERROR - Error processing callback for node 69f788eb096243809b56cd04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60724 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:42:44,412 - lava_callback - INFO - Received callback for node 69f7890f096243809b56cd1c INFO: 172.21.0.1:60728 - "POST /node/69f7890f096243809b56cd1c HTTP/1.0" 202 Accepted 2026-05-05 17:42:44,417 - lava_callback - INFO - Starting async job submit for node 69f7890f096243809b56cd1c 2026-05-05 17:42:44,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:42:44,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7890f096243809b56cd1c HTTP/1.1" 200 None 2026-05-05 17:42:44,433 - lava_callback - DEBUG - Processing node 69f7890f096243809b56cd1c: baseline-arm-clabbe 2026-05-05 17:42:44,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7890f096243809b56cd1c 2026-05-05 17:42:44,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:42:44,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7890f096243809b56cd1c HTTP/1.1" 200 None 2026-05-05 17:42:44,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:42:44,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 17:42:44,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:42:44,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7890f096243809b56cd1c HTTP/1.1" 200 None 2026-05-05 17:42:44,480 - lava_callback - ERROR - Error processing callback for node 69f7890f096243809b56cd1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:44:04,416 - lava_callback - INFO - Received callback for node 69f78955096243809b56cd4f INFO: 172.21.0.1:34664 - "POST /node/69f78955096243809b56cd4f HTTP/1.0" 202 Accepted 2026-05-05 17:44:04,422 - lava_callback - INFO - Starting async job submit for node 69f78955096243809b56cd4f 2026-05-05 17:44:04,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:44:04,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78955096243809b56cd4f HTTP/1.1" 200 None 2026-05-05 17:44:04,440 - lava_callback - DEBUG - Processing node 69f78955096243809b56cd4f: baseline-arm-clabbe 2026-05-05 17:44:04,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78955096243809b56cd4f 2026-05-05 17:44:04,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:44:04,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78955096243809b56cd4f HTTP/1.1" 200 None 2026-05-05 17:44:04,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:44:04,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 17:44:04,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:44:04,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78955096243809b56cd4f HTTP/1.1" 200 None 2026-05-05 17:44:04,494 - lava_callback - ERROR - Error processing callback for node 69f78955096243809b56cd4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:45:04,798 - lava_callback - INFO - Received callback for node 69f7899c096243809b56cd7a INFO: 172.21.0.1:50462 - "POST /node/69f7899c096243809b56cd7a HTTP/1.0" 202 Accepted 2026-05-05 17:45:04,804 - lava_callback - INFO - Starting async job submit for node 69f7899c096243809b56cd7a 2026-05-05 17:45:04,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:45:04,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7899c096243809b56cd7a HTTP/1.1" 200 None 2026-05-05 17:45:04,819 - lava_callback - DEBUG - Processing node 69f7899c096243809b56cd7a: baseline-arm-clabbe 2026-05-05 17:45:04,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7899c096243809b56cd7a 2026-05-05 17:45:04,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:45:04,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7899c096243809b56cd7a HTTP/1.1" 200 None 2026-05-05 17:45:04,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:45:04,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 17:45:04,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:45:04,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7899c096243809b56cd7a HTTP/1.1" 200 None 2026-05-05 17:45:04,864 - lava_callback - ERROR - Error processing callback for node 69f7899c096243809b56cd7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:45:44,474 - lava_callback - INFO - Received callback for node 69f789c1096243809b56cd8b INFO: 172.21.0.1:56976 - "POST /node/69f789c1096243809b56cd8b HTTP/1.0" 202 Accepted 2026-05-05 17:45:44,479 - lava_callback - INFO - Starting async job submit for node 69f789c1096243809b56cd8b 2026-05-05 17:45:44,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:45:44,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f789c1096243809b56cd8b HTTP/1.1" 200 None 2026-05-05 17:45:44,495 - lava_callback - DEBUG - Processing node 69f789c1096243809b56cd8b: baseline-arm-clabbe 2026-05-05 17:45:44,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f789c1096243809b56cd8b 2026-05-05 17:45:44,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:45:44,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f789c1096243809b56cd8b HTTP/1.1" 200 None 2026-05-05 17:45:44,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:45:44,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 17:45:44,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:45:44,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f789c1096243809b56cd8b HTTP/1.1" 200 None 2026-05-05 17:45:44,542 - lava_callback - ERROR - Error processing callback for node 69f789c1096243809b56cd8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37164 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:47:04,573 - lava_callback - INFO - Received callback for node 69f78a07096243809b56cdbd INFO: 172.21.0.1:53908 - "POST /node/69f78a07096243809b56cdbd HTTP/1.0" 202 Accepted 2026-05-05 17:47:04,579 - lava_callback - INFO - Starting async job submit for node 69f78a07096243809b56cdbd 2026-05-05 17:47:04,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:47:04,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78a07096243809b56cdbd HTTP/1.1" 200 None 2026-05-05 17:47:04,594 - lava_callback - DEBUG - Processing node 69f78a07096243809b56cdbd: baseline-arm-clabbe 2026-05-05 17:47:04,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78a07096243809b56cdbd 2026-05-05 17:47:04,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:47:04,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78a07096243809b56cdbd HTTP/1.1" 200 None 2026-05-05 17:47:04,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:47:04,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 17:47:04,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:47:04,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78a07096243809b56cdbd HTTP/1.1" 200 None 2026-05-05 17:47:04,641 - lava_callback - ERROR - Error processing callback for node 69f78a07096243809b56cdbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:47:41,292 - lava_callback - INFO - Received callback for node 69f78a33096243809b56cdcc INFO: 172.21.0.1:36052 - "POST /node/69f78a33096243809b56cdcc HTTP/1.0" 202 Accepted 2026-05-05 17:47:41,298 - lava_callback - INFO - Starting async job submit for node 69f78a33096243809b56cdcc 2026-05-05 17:47:41,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:47:41,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78a33096243809b56cdcc HTTP/1.1" 200 None 2026-05-05 17:47:41,313 - lava_callback - DEBUG - Processing node 69f78a33096243809b56cdcc: baseline-arm64-baylibre 2026-05-05 17:47:41,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78a33096243809b56cdcc 2026-05-05 17:47:41,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:47:41,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78a33096243809b56cdcc HTTP/1.1" 200 None 2026-05-05 17:47:41,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:47:41,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 17:47:41,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:47:41,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78a33096243809b56cdcc HTTP/1.1" 200 None 2026-05-05 17:47:41,363 - lava_callback - ERROR - Error processing callback for node 69f78a33096243809b56cdcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:50:05,043 - lava_callback - INFO - Received callback for node 69f78ac9096243809b56ce27 INFO: 172.21.0.1:57958 - "POST /node/69f78ac9096243809b56ce27 HTTP/1.0" 202 Accepted 2026-05-05 17:50:05,049 - lava_callback - INFO - Starting async job submit for node 69f78ac9096243809b56ce27 2026-05-05 17:50:05,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:05,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78ac9096243809b56ce27 HTTP/1.1" 200 None 2026-05-05 17:50:05,064 - lava_callback - DEBUG - Processing node 69f78ac9096243809b56ce27: baseline-arm64-clabbe 2026-05-05 17:50:05,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78ac9096243809b56ce27 2026-05-05 17:50:05,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:05,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78ac9096243809b56ce27 HTTP/1.1" 200 None 2026-05-05 17:50:05,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:05,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 17:50:05,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:05,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78ac9096243809b56ce27 HTTP/1.1" 200 None 2026-05-05 17:50:05,110 - lava_callback - ERROR - Error processing callback for node 69f78ac9096243809b56ce27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:50:33,204 - lava_callback - INFO - Received callback for node 69fa29c2a9d11f026cebe69f INFO: 172.21.0.1:46834 - "POST /node/69fa29c2a9d11f026cebe69f HTTP/1.0" 202 Accepted 2026-05-05 17:50:33,211 - lava_callback - INFO - Starting async job submit for node 69fa29c2a9d11f026cebe69f 2026-05-05 17:50:33,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:33,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa29c2a9d11f026cebe69f HTTP/1.1" 200 None 2026-05-05 17:50:33,280 - lava_callback - DEBUG - Processing node 69fa29c2a9d11f026cebe69f: baseline-arm 2026-05-05 17:50:34,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:50:34,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:50:34,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fa29c2a9d11f026cebe69f/log.txt.gz 2026-05-05 17:50:34,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:50:34,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:50:34,812 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa29c2a9d11f026cebe69f/lava-logs.yaml 2026-05-05 17:50:34,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:50:34,857 - lava_callback - INFO - Received callback for node 69fa2d71a9d11f026cebe827 INFO: 172.21.0.1:46838 - "POST /node/69fa2d71a9d11f026cebe827 HTTP/1.0" 202 Accepted 2026-05-05 17:50:34,864 - lava_callback - INFO - Starting async job submit for node 69fa2d71a9d11f026cebe827 2026-05-05 17:50:34,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:34,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2d71a9d11f026cebe827 HTTP/1.1" 200 None 2026-05-05 17:50:34,903 - lava_callback - DEBUG - Processing node 69fa2d71a9d11f026cebe827: baseline-arm-pengutronix 2026-05-05 17:50:34,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:50:34,999 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa29c2a9d11f026cebe69f/lava_callback.json.gz DEBUG: Setup failed for 69fa29c2a9d11f026cebe69f. Transitting job node result: incomplete -> fail 2026-05-05 17:50:35,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:35,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:50:35,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa29c2a9d11f026cebe69f HTTP/1.1" 200 None 2026-05-05 17:50:35,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:35,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:50:35,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:35,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa29c2a9d11f026cebe69f HTTP/1.1" 200 None 2026-05-05 17:50:35,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:50:35,290 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa2d71a9d11f026cebe827/log.txt.gz 2026-05-05 17:50:35,427 - lava_callback - INFO - Completed processing callback for node 69fa29c2a9d11f026cebe69f 2026-05-05 17:50:35,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:50:35,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:50:35,586 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa2d71a9d11f026cebe827/lava-logs.yaml 2026-05-05 17:50:35,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:50:35,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:50:35,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa2d71a9d11f026cebe827/lava_callback.json.gz 2026-05-05 17:50:35,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:35,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2d71a9d11f026cebe827 HTTP/1.1" 200 None 2026-05-05 17:50:35,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:35,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:50:35,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:35,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2d71a9d11f026cebe827 HTTP/1.1" 200 None 2026-05-05 17:50:35,825 - lava_callback - INFO - Completed processing callback for node 69fa2d71a9d11f026cebe827 INFO: 172.21.0.1:46842 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:50:42,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:50:42,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40292 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:52:28,789 - lava_callback - INFO - Received callback for node 69fa2e26a9d11f026cebe87f INFO: 172.21.0.1:40294 - "POST /node/69fa2e26a9d11f026cebe87f HTTP/1.0" 202 Accepted 2026-05-05 17:52:28,796 - lava_callback - INFO - Starting async job submit for node 69fa2e26a9d11f026cebe87f 2026-05-05 17:52:28,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:52:28,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2e26a9d11f026cebe87f HTTP/1.1" 200 None 2026-05-05 17:52:28,845 - lava_callback - DEBUG - Processing node 69fa2e26a9d11f026cebe87f: baseline-arm64 2026-05-05 17:52:28,984 - lava_callback - WARNING - Failed to upload log 2026-05-05 17:52:29,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:52:29,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:52:29,190 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2e26a9d11f026cebe87f/lava-logs.yaml 2026-05-05 17:52:29,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:52:29,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:52:29,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2e26a9d11f026cebe87f/lava_callback.json.gz 2026-05-05 17:52:29,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:52:29,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2e26a9d11f026cebe87f HTTP/1.1" 200 None 2026-05-05 17:52:29,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:52:29,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:52:29,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:52:29,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2e26a9d11f026cebe87f HTTP/1.1" 200 None 2026-05-05 17:52:29,434 - lava_callback - INFO - Completed processing callback for node 69fa2e26a9d11f026cebe87f INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:52:42,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:52:42,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60970 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:52:44,803 - lava_callback - INFO - Received callback for node 69f78b5a096243809b56ce7a INFO: 172.21.0.1:60986 - "POST /node/69f78b5a096243809b56ce7a HTTP/1.0" 202 Accepted 2026-05-05 17:52:44,808 - lava_callback - INFO - Starting async job submit for node 69f78b5a096243809b56ce7a 2026-05-05 17:52:44,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:52:44,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78b5a096243809b56ce7a HTTP/1.1" 200 None 2026-05-05 17:52:44,823 - lava_callback - DEBUG - Processing node 69f78b5a096243809b56ce7a: baseline-arm64-clabbe 2026-05-05 17:52:44,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78b5a096243809b56ce7a 2026-05-05 17:52:44,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:52:44,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78b5a096243809b56ce7a HTTP/1.1" 200 None 2026-05-05 17:52:44,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:52:44,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 17:52:44,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:52:44,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78b5a096243809b56ce7a HTTP/1.1" 200 None 2026-05-05 17:52:44,877 - lava_callback - ERROR - Error processing callback for node 69f78b5a096243809b56ce7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:53:10,521 - lava_callback - INFO - Received callback for node 69fa29eda9d11f026cebe6af INFO: 172.21.0.1:55902 - "POST /node/69fa29eda9d11f026cebe6af HTTP/1.0" 202 Accepted 2026-05-05 17:53:10,529 - lava_callback - INFO - Starting async job submit for node 69fa29eda9d11f026cebe6af 2026-05-05 17:53:10,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:53:10,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa29eda9d11f026cebe6af HTTP/1.1" 200 None 2026-05-05 17:53:10,587 - lava_callback - DEBUG - Processing node 69fa29eda9d11f026cebe6af: baseline-nfs-arm64 2026-05-05 17:53:11,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:53:11,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:53:11,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa29eda9d11f026cebe6af/log.txt.gz 2026-05-05 17:53:12,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:53:12,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:53:12,828 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa29eda9d11f026cebe6af/lava-logs.yaml 2026-05-05 17:53:12,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:53:12,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:53:12,967 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa29eda9d11f026cebe6af/lava_callback.json.gz DEBUG: Setup failed for 69fa29eda9d11f026cebe6af. Transitting job node result: incomplete -> fail 2026-05-05 17:53:13,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:53:13,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa29eda9d11f026cebe6af HTTP/1.1" 200 None 2026-05-05 17:53:13,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:53:13,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:53:13,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:53:13,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa29eda9d11f026cebe6af HTTP/1.1" 200 None 2026-05-05 17:53:13,182 - lava_callback - INFO - Completed processing callback for node 69fa29eda9d11f026cebe6af INFO: 172.21.0.1:55912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:53:42,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:53:42,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51750 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:54:26,320 - lava_callback - INFO - Received callback for node 69fa2e71a9d11f026cebe8a5 INFO: 172.21.0.1:47220 - "POST /node/69fa2e71a9d11f026cebe8a5 HTTP/1.0" 202 Accepted 2026-05-05 17:54:26,327 - lava_callback - INFO - Starting async job submit for node 69fa2e71a9d11f026cebe8a5 2026-05-05 17:54:26,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:54:26,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2e71a9d11f026cebe8a5 HTTP/1.1" 200 None 2026-05-05 17:54:26,381 - lava_callback - DEBUG - Processing node 69fa2e71a9d11f026cebe8a5: baseline-arm64 INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:54:26,657 - lava_callback - WARNING - Failed to upload log 2026-05-05 17:54:26,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:54:26,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:54:26,927 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2e71a9d11f026cebe8a5/lava-logs.yaml 2026-05-05 17:54:26,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:54:27,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:54:27,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2e71a9d11f026cebe8a5/lava_callback.json.gz 2026-05-05 17:54:27,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:54:27,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2e71a9d11f026cebe8a5 HTTP/1.1" 200 None 2026-05-05 17:54:27,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:54:27,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:54:27,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:54:27,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2e71a9d11f026cebe8a5 HTTP/1.1" 200 None 2026-05-05 17:54:27,163 - lava_callback - INFO - Completed processing callback for node 69fa2e71a9d11f026cebe8a5 INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:54:42,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:54:42,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37634 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:55:05,024 - lava_callback - INFO - Received callback for node 69f78beb096243809b56cee6 INFO: 172.21.0.1:53492 - "POST /node/69f78beb096243809b56cee6 HTTP/1.0" 202 Accepted 2026-05-05 17:55:05,030 - lava_callback - INFO - Starting async job submit for node 69f78beb096243809b56cee6 2026-05-05 17:55:05,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:05,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78beb096243809b56cee6 HTTP/1.1" 200 None 2026-05-05 17:55:05,049 - lava_callback - DEBUG - Processing node 69f78beb096243809b56cee6: baseline-arm64-clabbe 2026-05-05 17:55:05,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78beb096243809b56cee6 2026-05-05 17:55:05,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:05,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78beb096243809b56cee6 HTTP/1.1" 200 None 2026-05-05 17:55:05,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:05,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 17:55:05,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:05,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78beb096243809b56cee6 HTTP/1.1" 200 None 2026-05-05 17:55:05,115 - lava_callback - ERROR - Error processing callback for node 69f78beb096243809b56cee6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:55:16,870 - lava_callback - INFO - Received callback for node 69fa2ebda9d11f026cebe8cf INFO: 172.21.0.1:59878 - "POST /node/69fa2ebda9d11f026cebe8cf HTTP/1.0" 202 Accepted 2026-05-05 17:55:16,880 - lava_callback - INFO - Starting async job submit for node 69fa2ebda9d11f026cebe8cf 2026-05-05 17:55:16,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:16,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2ebda9d11f026cebe8cf HTTP/1.1" 200 None 2026-05-05 17:55:16,929 - lava_callback - DEBUG - Processing node 69fa2ebda9d11f026cebe8cf: baseline-arm64 2026-05-05 17:55:17,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:55:17,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:55:17,500 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2ebda9d11f026cebe8cf/log.txt.gz 2026-05-05 17:55:17,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:55:18,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:55:18,015 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2ebda9d11f026cebe8cf/lava-logs.yaml 2026-05-05 17:55:18,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:55:18,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:55:18,160 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2ebda9d11f026cebe8cf/lava_callback.json.gz 2026-05-05 17:55:18,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:18,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2ebda9d11f026cebe8cf HTTP/1.1" 200 None 2026-05-05 17:55:18,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:18,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:55:18,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:18,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2ebda9d11f026cebe8cf HTTP/1.1" 200 None 2026-05-05 17:55:18,237 - lava_callback - INFO - Completed processing callback for node 69fa2ebda9d11f026cebe8cf INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41144 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:55:42,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:42,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53314 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:55:56,612 - lava_callback - INFO - Received callback for node 69fa2aaca9d11f026cebe709 INFO: 172.21.0.1:53320 - "POST /node/69fa2aaca9d11f026cebe709 HTTP/1.0" 202 Accepted 2026-05-05 17:55:56,657 - lava_callback - INFO - Starting async job submit for node 69fa2aaca9d11f026cebe709 2026-05-05 17:55:56,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:56,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2aaca9d11f026cebe709 HTTP/1.1" 200 None 2026-05-05 17:55:56,696 - lava_callback - DEBUG - Processing node 69fa2aaca9d11f026cebe709: baseline-arm-pengutronix 2026-05-05 17:55:56,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:55:56,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:55:56,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa2aaca9d11f026cebe709/log.txt.gz 2026-05-05 17:55:56,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:55:57,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:55:57,086 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa2aaca9d11f026cebe709/lava-logs.yaml 2026-05-05 17:55:57,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:55:57,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:55:57,179 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa2aaca9d11f026cebe709/lava_callback.json.gz DEBUG: Setup failed for 69fa2aaca9d11f026cebe709. Transitting job node result: incomplete -> fail 2026-05-05 17:55:57,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:57,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2aaca9d11f026cebe709 HTTP/1.1" 200 None 2026-05-05 17:55:57,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:57,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:55:57,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:55:57,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2aaca9d11f026cebe709 HTTP/1.1" 200 None 2026-05-05 17:55:57,333 - lava_callback - INFO - Completed processing callback for node 69fa2aaca9d11f026cebe709 INFO: 172.21.0.1:53324 - "GET /node/69d997da7e2a38af1be8912e%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-05 17:56:01,895 - lava_callback - INFO - Received callback for node 69f78c2f096243809b56cf06 INFO: 172.21.0.1:47190 - "POST /node/69f78c2f096243809b56cf06 HTTP/1.0" 202 Accepted 2026-05-05 17:56:01,901 - lava_callback - INFO - Starting async job submit for node 69f78c2f096243809b56cf06 2026-05-05 17:56:01,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:56:01,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78c2f096243809b56cf06 HTTP/1.1" 200 None 2026-05-05 17:56:01,922 - lava_callback - DEBUG - Processing node 69f78c2f096243809b56cf06: baseline-arm64-baylibre 2026-05-05 17:56:01,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78c2f096243809b56cf06 2026-05-05 17:56:01,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:56:01,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78c2f096243809b56cf06 HTTP/1.1" 200 None 2026-05-05 17:56:01,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:56:01,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-05 17:56:01,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:56:01,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78c2f096243809b56cf06 HTTP/1.1" 200 None 2026-05-05 17:56:01,978 - lava_callback - ERROR - Error processing callback for node 69f78c2f096243809b56cf06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47200 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:56:12,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:56:12,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59870 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:57:24,994 - lava_callback - INFO - Received callback for node 69f78c7c096243809b56cf26 INFO: 172.21.0.1:59534 - "POST /node/69f78c7c096243809b56cf26 HTTP/1.0" 202 Accepted 2026-05-05 17:57:24,999 - lava_callback - INFO - Starting async job submit for node 69f78c7c096243809b56cf26 2026-05-05 17:57:25,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:57:25,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78c7c096243809b56cf26 HTTP/1.1" 200 None 2026-05-05 17:57:25,015 - lava_callback - DEBUG - Processing node 69f78c7c096243809b56cf26: baseline-arm64-clabbe 2026-05-05 17:57:25,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78c7c096243809b56cf26 2026-05-05 17:57:25,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:57:25,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78c7c096243809b56cf26 HTTP/1.1" 200 None 2026-05-05 17:57:25,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:57:25,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-05 17:57:25,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:57:25,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78c7c096243809b56cf26 HTTP/1.1" 200 None 2026-05-05 17:57:25,071 - lava_callback - ERROR - Error processing callback for node 69f78c7c096243809b56cf26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47974 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:58:45,069 - lava_callback - INFO - Received callback for node 69f78cc6096243809b56cf53 INFO: 172.21.0.1:47984 - "POST /node/69f78cc6096243809b56cf53 HTTP/1.0" 202 Accepted 2026-05-05 17:58:45,077 - lava_callback - INFO - Starting async job submit for node 69f78cc6096243809b56cf53 2026-05-05 17:58:45,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:58:45,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78cc6096243809b56cf53 HTTP/1.1" 200 None 2026-05-05 17:58:45,096 - lava_callback - DEBUG - Processing node 69f78cc6096243809b56cf53: baseline-arm64-clabbe 2026-05-05 17:58:45,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78cc6096243809b56cf53 2026-05-05 17:58:45,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:58:45,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78cc6096243809b56cf53 HTTP/1.1" 200 None 2026-05-05 17:58:45,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:58:45,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-05 17:58:45,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:58:45,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78cc6096243809b56cf53 HTTP/1.1" 200 None 2026-05-05 17:58:45,165 - lava_callback - ERROR - Error processing callback for node 69f78cc6096243809b56cf53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET /node/69f0ed4894b553ffc69067fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40976 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:59:14,923 - lava_callback - INFO - Received callback for node 69fa2fe7a9d11f026cebe97b INFO: 172.21.0.1:45600 - "POST /node/69fa2fe7a9d11f026cebe97b HTTP/1.0" 202 Accepted 2026-05-05 17:59:14,929 - lava_callback - INFO - Starting async job submit for node 69fa2fe7a9d11f026cebe97b 2026-05-05 17:59:14,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:59:14,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2fe7a9d11f026cebe97b HTTP/1.1" 200 None 2026-05-05 17:59:14,951 - lava_callback - DEBUG - Processing node 69fa2fe7a9d11f026cebe97b: baseline-arm 2026-05-05 17:59:14,958 - lava_callback - WARNING - Failed to upload log 2026-05-05 17:59:14,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:59:15,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:59:15,055 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa2fe7a9d11f026cebe97b/lava-logs.yaml 2026-05-05 17:59:15,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:59:15,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:59:15,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa2fe7a9d11f026cebe97b/lava_callback.json.gz 2026-05-05 17:59:15,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:45610 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-05 17:59:15,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2fe7a9d11f026cebe97b HTTP/1.1" 200 None 2026-05-05 17:59:15,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:59:15,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 17:59:15,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:59:15,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2fe7a9d11f026cebe97b HTTP/1.1" 200 None 2026-05-05 17:59:15,204 - lava_callback - INFO - Completed processing callback for node 69fa2fe7a9d11f026cebe97b INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54696 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:59:42,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:59:42,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45012 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:59:46,063 - lava_callback - INFO - Received callback for node 69fa2f52a9d11f026cebe92c INFO: 172.21.0.1:45014 - "POST /node/69fa2f52a9d11f026cebe92c HTTP/1.0" 202 Accepted 2026-05-05 17:59:46,069 - lava_callback - INFO - Starting async job submit for node 69fa2f52a9d11f026cebe92c 2026-05-05 17:59:46,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:59:46,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2f52a9d11f026cebe92c HTTP/1.1" 200 None 2026-05-05 17:59:46,100 - lava_callback - DEBUG - Processing node 69fa2f52a9d11f026cebe92c: baseline-arm64 2026-05-05 17:59:46,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK 2026-05-05 17:59:46,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:59:46,524 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2f52a9d11f026cebe92c/log.txt.gz 2026-05-05 17:59:46,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:59:46,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:59:46,933 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2f52a9d11f026cebe92c/lava-logs.yaml 2026-05-05 17:59:46,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 17:59:47,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 17:59:47,071 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa2f52a9d11f026cebe92c/lava_callback.json.gz 2026-05-05 17:59:47,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:59:47,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa2f52a9d11f026cebe92c HTTP/1.1" 200 None 2026-05-05 17:59:47,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:59:47,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 17:59:47,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 17:59:47,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa2f52a9d11f026cebe92c HTTP/1.1" 200 None 2026-05-05 17:59:47,249 - lava_callback - INFO - Completed processing callback for node 69fa2f52a9d11f026cebe92c INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:00:05,597 - lava_callback - INFO - Received callback for node 69f78d0f096243809b56cf7e INFO: 172.21.0.1:35818 - "POST /node/69f78d0f096243809b56cf7e HTTP/1.0" 202 Accepted 2026-05-05 18:00:05,603 - lava_callback - INFO - Starting async job submit for node 69f78d0f096243809b56cf7e 2026-05-05 18:00:05,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:00:05,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78d0f096243809b56cf7e HTTP/1.1" 200 None 2026-05-05 18:00:05,631 - lava_callback - DEBUG - Processing node 69f78d0f096243809b56cf7e: baseline-arm64-clabbe 2026-05-05 18:00:05,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78d0f096243809b56cf7e 2026-05-05 18:00:05,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:00:05,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78d0f096243809b56cf7e HTTP/1.1" 200 None 2026-05-05 18:00:05,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:00:05,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-05 18:00:05,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:00:05,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78d0f096243809b56cf7e HTTP/1.1" 200 None 2026-05-05 18:00:05,697 - lava_callback - ERROR - Error processing callback for node 69f78d0f096243809b56cf7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET /node/699ec04d8c247a4d4f2821b1%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-05 18:00:12,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:00:12,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45300 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:01:05,185 - lava_callback - INFO - Received callback for node 69f78d5a096243809b56cfa6 INFO: 172.21.0.1:39170 - "POST /node/69f78d5a096243809b56cfa6 HTTP/1.0" 202 Accepted 2026-05-05 18:01:05,191 - lava_callback - INFO - Starting async job submit for node 69f78d5a096243809b56cfa6 2026-05-05 18:01:05,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:01:05,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78d5a096243809b56cfa6 HTTP/1.1" 200 None 2026-05-05 18:01:05,206 - lava_callback - DEBUG - Processing node 69f78d5a096243809b56cfa6: baseline-arm64-clabbe 2026-05-05 18:01:05,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78d5a096243809b56cfa6 2026-05-05 18:01:05,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:01:05,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78d5a096243809b56cfa6 HTTP/1.1" 200 None 2026-05-05 18:01:05,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:01:05,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-05 18:01:05,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:01:05,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78d5a096243809b56cfa6 HTTP/1.1" 200 None 2026-05-05 18:01:05,255 - lava_callback - ERROR - Error processing callback for node 69f78d5a096243809b56cfa6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET /node/69934e2e523507f3806a6183%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42068 - "GET /node/69f5b80e8cb8354ccaa5f02a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42086 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:02:25,164 - lava_callback - INFO - Received callback for node 69f78da5096243809b56cfcd INFO: 172.21.0.1:45156 - "POST /node/69f78da5096243809b56cfcd HTTP/1.0" 202 Accepted 2026-05-05 18:02:25,170 - lava_callback - INFO - Starting async job submit for node 69f78da5096243809b56cfcd 2026-05-05 18:02:25,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:02:25,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78da5096243809b56cfcd HTTP/1.1" 200 None 2026-05-05 18:02:25,193 - lava_callback - DEBUG - Processing node 69f78da5096243809b56cfcd: baseline-arm64-clabbe 2026-05-05 18:02:25,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78da5096243809b56cfcd 2026-05-05 18:02:25,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:02:25,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78da5096243809b56cfcd HTTP/1.1" 200 None 2026-05-05 18:02:25,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:02:25,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-05 18:02:25,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:02:25,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78da5096243809b56cfcd HTTP/1.1" 200 None 2026-05-05 18:02:25,238 - lava_callback - ERROR - Error processing callback for node 69f78da5096243809b56cfcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET /node/69f4d8bd46dc69a3a70b7cb0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:03:45,232 - lava_callback - INFO - Received callback for node 69f78def096243809b56cff4 INFO: 172.21.0.1:36696 - "POST /node/69f78def096243809b56cff4 HTTP/1.0" 202 Accepted 2026-05-05 18:03:45,238 - lava_callback - INFO - Starting async job submit for node 69f78def096243809b56cff4 2026-05-05 18:03:45,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:03:45,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78def096243809b56cff4 HTTP/1.1" 200 None 2026-05-05 18:03:45,261 - lava_callback - DEBUG - Processing node 69f78def096243809b56cff4: baseline-arm64-clabbe 2026-05-05 18:03:45,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78def096243809b56cff4 2026-05-05 18:03:45,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:03:45,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78def096243809b56cff4 HTTP/1.1" 200 None 2026-05-05 18:03:45,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:03:45,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-05 18:03:45,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:03:45,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78def096243809b56cff4 HTTP/1.1" 200 None 2026-05-05 18:03:45,311 - lava_callback - ERROR - Error processing callback for node 69f78def096243809b56cff4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET /node/69e6c58e60f5826562c157cd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55492 - "GET /node/6951441855ab4e5dcfcc08c5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:04:45,248 - lava_callback - INFO - Received callback for node 69f78e38096243809b56d015 INFO: 172.21.0.1:57700 - "POST /node/69f78e38096243809b56d015 HTTP/1.0" 202 Accepted 2026-05-05 18:04:45,253 - lava_callback - INFO - Starting async job submit for node 69f78e38096243809b56d015 2026-05-05 18:04:45,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:04:45,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78e38096243809b56d015 HTTP/1.1" 200 None 2026-05-05 18:04:45,269 - lava_callback - DEBUG - Processing node 69f78e38096243809b56d015: baseline-arm64-clabbe 2026-05-05 18:04:45,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78e38096243809b56d015 2026-05-05 18:04:45,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:04:45,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78e38096243809b56d015 HTTP/1.1" 200 None 2026-05-05 18:04:45,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:04:45,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 18:04:45,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:04:45,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78e38096243809b56d015 HTTP/1.1" 200 None 2026-05-05 18:04:45,318 - lava_callback - ERROR - Error processing callback for node 69f78e38096243809b56d015: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41148 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:06:05,412 - lava_callback - INFO - Received callback for node 69f78e82096243809b56d042 INFO: 172.21.0.1:51698 - "POST /node/69f78e82096243809b56d042 HTTP/1.0" 202 Accepted 2026-05-05 18:06:05,418 - lava_callback - INFO - Starting async job submit for node 69f78e82096243809b56d042 2026-05-05 18:06:05,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:06:05,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78e82096243809b56d042 HTTP/1.1" 200 None 2026-05-05 18:06:05,466 - lava_callback - DEBUG - Processing node 69f78e82096243809b56d042: baseline-arm64-clabbe 2026-05-05 18:06:05,466 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78e82096243809b56d042 2026-05-05 18:06:05,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:06:05,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78e82096243809b56d042 HTTP/1.1" 200 None 2026-05-05 18:06:05,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:06:05,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 18:06:05,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:06:05,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78e82096243809b56d042 HTTP/1.1" 200 None 2026-05-05 18:06:05,576 - lava_callback - ERROR - Error processing callback for node 69f78e82096243809b56d042: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36928 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:07:22,690 - lava_callback - INFO - Received callback for node 69f78ec7096243809b56d05c INFO: 172.21.0.1:51188 - "POST /node/69f78ec7096243809b56d05c HTTP/1.0" 202 Accepted 2026-05-05 18:07:22,697 - lava_callback - INFO - Starting async job submit for node 69f78ec7096243809b56d05c 2026-05-05 18:07:22,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:07:22,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78ec7096243809b56d05c HTTP/1.1" 200 None 2026-05-05 18:07:22,715 - lava_callback - DEBUG - Processing node 69f78ec7096243809b56d05c: baseline-arm64-baylibre 2026-05-05 18:07:22,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78ec7096243809b56d05c 2026-05-05 18:07:22,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:07:22,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78ec7096243809b56d05c HTTP/1.1" 200 None 2026-05-05 18:07:22,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:07:22,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 18:07:22,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:07:22,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78ec7096243809b56d05c HTTP/1.1" 200 None 2026-05-05 18:07:22,786 - lava_callback - ERROR - Error processing callback for node 69f78ec7096243809b56d05c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60940 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:08:33,410 - lava_callback - INFO - Received callback for node 69fa3058a9d11f026cebe9ab INFO: 172.21.0.1:50010 - "POST /node/69fa3058a9d11f026cebe9ab HTTP/1.0" 202 Accepted 2026-05-05 18:08:33,418 - lava_callback - INFO - Starting async job submit for node 69fa3058a9d11f026cebe9ab 2026-05-05 18:08:33,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:08:33,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3058a9d11f026cebe9ab HTTP/1.1" 200 None 2026-05-05 18:08:33,482 - lava_callback - DEBUG - Processing node 69fa3058a9d11f026cebe9ab: baseline-arm64 2026-05-05 18:08:33,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:08:34,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:08:34,065 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa3058a9d11f026cebe9ab/log.txt.gz 2026-05-05 18:08:34,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:08:34,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:08:34,446 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa3058a9d11f026cebe9ab/lava-logs.yaml 2026-05-05 18:08:34,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:08:34,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:08:34,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa3058a9d11f026cebe9ab/lava_callback.json.gz DEBUG: Setup failed for 69fa3058a9d11f026cebe9ab. Transitting job node result: incomplete -> fail 2026-05-05 18:08:34,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:08:34,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3058a9d11f026cebe9ab HTTP/1.1" 200 None 2026-05-05 18:08:34,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:08:34,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 18:08:34,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:08:34,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa3058a9d11f026cebe9ab HTTP/1.1" 200 None 2026-05-05 18:08:34,775 - lava_callback - INFO - Completed processing callback for node 69fa3058a9d11f026cebe9ab INFO: 172.21.0.1:50024 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:08:42,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:08:42,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51894 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:08:45,595 - lava_callback - INFO - Received callback for node 69f78f18096243809b56d08a INFO: 172.21.0.1:51902 - "POST /node/69f78f18096243809b56d08a HTTP/1.0" 202 Accepted 2026-05-05 18:08:45,601 - lava_callback - INFO - Starting async job submit for node 69f78f18096243809b56d08a 2026-05-05 18:08:45,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:08:45,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78f18096243809b56d08a HTTP/1.1" 200 None 2026-05-05 18:08:45,615 - lava_callback - DEBUG - Processing node 69f78f18096243809b56d08a: baseline-arm64-clabbe 2026-05-05 18:08:45,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78f18096243809b56d08a 2026-05-05 18:08:45,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:08:45,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78f18096243809b56d08a HTTP/1.1" 200 None 2026-05-05 18:08:45,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:08:45,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 18:08:45,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:08:45,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78f18096243809b56d08a HTTP/1.1" 200 None 2026-05-05 18:08:45,659 - lava_callback - ERROR - Error processing callback for node 69f78f18096243809b56d08a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39210 - "GET /node/69934e1e523507f3806a6142%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41116 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:09:45,439 - lava_callback - INFO - Received callback for node 69f78f62096243809b56d0a3 INFO: 172.21.0.1:41118 - "POST /node/69f78f62096243809b56d0a3 HTTP/1.0" 202 Accepted 2026-05-05 18:09:45,445 - lava_callback - INFO - Starting async job submit for node 69f78f62096243809b56d0a3 2026-05-05 18:09:45,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:09:45,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78f62096243809b56d0a3 HTTP/1.1" 200 None 2026-05-05 18:09:45,473 - lava_callback - DEBUG - Processing node 69f78f62096243809b56d0a3: baseline-arm64-clabbe 2026-05-05 18:09:45,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78f62096243809b56d0a3 2026-05-05 18:09:45,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:09:45,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78f62096243809b56d0a3 HTTP/1.1" 200 None 2026-05-05 18:09:45,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:09:45,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 18:09:45,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:09:45,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78f62096243809b56d0a3 HTTP/1.1" 200 None 2026-05-05 18:09:45,536 - lava_callback - ERROR - Error processing callback for node 69f78f62096243809b56d0a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:11:05,564 - lava_callback - INFO - Received callback for node 69f78fae096243809b56d0d1 INFO: 172.21.0.1:51268 - "POST /node/69f78fae096243809b56d0d1 HTTP/1.0" 202 Accepted 2026-05-05 18:11:05,570 - lava_callback - INFO - Starting async job submit for node 69f78fae096243809b56d0d1 2026-05-05 18:11:05,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:11:05,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78fae096243809b56d0d1 HTTP/1.1" 200 None 2026-05-05 18:11:05,587 - lava_callback - DEBUG - Processing node 69f78fae096243809b56d0d1: baseline-arm64-clabbe 2026-05-05 18:11:05,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78fae096243809b56d0d1 2026-05-05 18:11:05,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:11:05,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78fae096243809b56d0d1 HTTP/1.1" 200 None 2026-05-05 18:11:05,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:11:05,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 18:11:05,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:11:05,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78fae096243809b56d0d1 HTTP/1.1" 200 None 2026-05-05 18:11:05,654 - lava_callback - ERROR - Error processing callback for node 69f78fae096243809b56d0d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET /node/6992de1031166481c8dd58d6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59802 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:12:25,655 - lava_callback - INFO - Received callback for node 69f78ff8096243809b56d0ea INFO: 172.21.0.1:50158 - "POST /node/69f78ff8096243809b56d0ea HTTP/1.0" 202 Accepted 2026-05-05 18:12:25,660 - lava_callback - INFO - Starting async job submit for node 69f78ff8096243809b56d0ea 2026-05-05 18:12:25,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:12:25,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78ff8096243809b56d0ea HTTP/1.1" 200 None 2026-05-05 18:12:25,676 - lava_callback - DEBUG - Processing node 69f78ff8096243809b56d0ea: baseline-arm64-clabbe 2026-05-05 18:12:25,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f78ff8096243809b56d0ea 2026-05-05 18:12:25,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:12:25,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f78ff8096243809b56d0ea HTTP/1.1" 200 None 2026-05-05 18:12:25,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:12:25,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 18:12:25,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:12:25,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f78ff8096243809b56d0ea HTTP/1.1" 200 None 2026-05-05 18:12:25,720 - lava_callback - ERROR - Error processing callback for node 69f78ff8096243809b56d0ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:13:25,666 - lava_callback - INFO - Received callback for node 69f79042096243809b56d118 INFO: 172.21.0.1:52562 - "POST /node/69f79042096243809b56d118 HTTP/1.0" 202 Accepted 2026-05-05 18:13:25,672 - lava_callback - INFO - Starting async job submit for node 69f79042096243809b56d118 2026-05-05 18:13:25,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:13:25,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79042096243809b56d118 HTTP/1.1" 200 None 2026-05-05 18:13:25,690 - lava_callback - DEBUG - Processing node 69f79042096243809b56d118: baseline-arm64-clabbe 2026-05-05 18:13:25,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79042096243809b56d118 2026-05-05 18:13:25,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:13:25,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79042096243809b56d118 HTTP/1.1" 200 None 2026-05-05 18:13:25,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:13:25,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 18:13:25,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:13:25,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79042096243809b56d118 HTTP/1.1" 200 None 2026-05-05 18:13:25,749 - lava_callback - ERROR - Error processing callback for node 69f79042096243809b56d118: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:14:45,671 - lava_callback - INFO - Received callback for node 69f7908f096243809b56d130 INFO: 172.21.0.1:34870 - "POST /node/69f7908f096243809b56d130 HTTP/1.0" 202 Accepted 2026-05-05 18:14:45,681 - lava_callback - INFO - Starting async job submit for node 69f7908f096243809b56d130 2026-05-05 18:14:45,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:14:45,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7908f096243809b56d130 HTTP/1.1" 200 None 2026-05-05 18:14:45,701 - lava_callback - DEBUG - Processing node 69f7908f096243809b56d130: baseline-arm64-clabbe 2026-05-05 18:14:45,702 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7908f096243809b56d130 2026-05-05 18:14:45,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:14:45,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7908f096243809b56d130 HTTP/1.1" 200 None 2026-05-05 18:14:45,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:14:45,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 18:14:45,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:14:45,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7908f096243809b56d130 HTTP/1.1" 200 None 2026-05-05 18:14:45,753 - lava_callback - ERROR - Error processing callback for node 69f7908f096243809b56d130: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET /node/68eacc6f4c8d16b93607911e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36896 - "GET /node/69f1f44499260e7077310f26%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:16:45,726 - lava_callback - INFO - Received callback for node 69f790fd096243809b56d162 INFO: 172.21.0.1:46366 - "POST /node/69f790fd096243809b56d162 HTTP/1.0" 202 Accepted 2026-05-05 18:16:45,733 - lava_callback - INFO - Starting async job submit for node 69f790fd096243809b56d162 2026-05-05 18:16:45,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:16:45,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f790fd096243809b56d162 HTTP/1.1" 200 None 2026-05-05 18:16:45,747 - lava_callback - DEBUG - Processing node 69f790fd096243809b56d162: baseline-arm64-clabbe 2026-05-05 18:16:45,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f790fd096243809b56d162 2026-05-05 18:16:45,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:16:45,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f790fd096243809b56d162 HTTP/1.1" 200 None 2026-05-05 18:16:45,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:16:45,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 18:16:45,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:16:45,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f790fd096243809b56d162 HTTP/1.1" 200 None 2026-05-05 18:16:45,803 - lava_callback - ERROR - Error processing callback for node 69f790fd096243809b56d162: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET /node/6992d25331166481c8dd2c44%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-05 18:20:02,947 - lava_callback - INFO - Received callback for node 69f791cc096243809b56d1ce INFO: 172.21.0.1:38684 - "POST /node/69f791cc096243809b56d1ce HTTP/1.0" 202 Accepted 2026-05-05 18:20:02,953 - lava_callback - INFO - Starting async job submit for node 69f791cc096243809b56d1ce 2026-05-05 18:20:02,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:20:02,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f791cc096243809b56d1ce HTTP/1.1" 200 None 2026-05-05 18:20:02,969 - lava_callback - DEBUG - Processing node 69f791cc096243809b56d1ce: baseline-arm-baylibre 2026-05-05 18:20:02,969 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f791cc096243809b56d1ce 2026-05-05 18:20:02,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:20:02,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f791cc096243809b56d1ce HTTP/1.1" 200 None 2026-05-05 18:20:02,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:20:02,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-05 18:20:03,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:20:03,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f791cc096243809b56d1ce HTTP/1.1" 200 None 2026-05-05 18:20:03,018 - lava_callback - ERROR - Error processing callback for node 69f791cc096243809b56d1ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:20:42,936 - lava_callback - INFO - Received callback for node 69f791f0096243809b56d1d9 INFO: 172.21.0.1:39450 - "POST /node/69f791f0096243809b56d1d9 HTTP/1.0" 202 Accepted 2026-05-05 18:20:42,942 - lava_callback - INFO - Starting async job submit for node 69f791f0096243809b56d1d9 2026-05-05 18:20:42,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:20:42,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f791f0096243809b56d1d9 HTTP/1.1" 200 None 2026-05-05 18:20:42,957 - lava_callback - DEBUG - Processing node 69f791f0096243809b56d1d9: baseline-arm-baylibre 2026-05-05 18:20:42,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f791f0096243809b56d1d9 2026-05-05 18:20:42,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:20:42,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f791f0096243809b56d1d9 HTTP/1.1" 200 None 2026-05-05 18:20:42,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:20:42,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-05 18:20:42,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:20:43,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f791f0096243809b56d1d9 HTTP/1.1" 200 None 2026-05-05 18:20:43,030 - lava_callback - ERROR - Error processing callback for node 69f791f0096243809b56d1d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:21:23,046 - lava_callback - INFO - Received callback for node 69f79214096243809b56d1e7 INFO: 172.21.0.1:57916 - "POST /node/69f79214096243809b56d1e7 HTTP/1.0" 202 Accepted 2026-05-05 18:21:23,052 - lava_callback - INFO - Starting async job submit for node 69f79214096243809b56d1e7 2026-05-05 18:21:23,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:21:23,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79214096243809b56d1e7 HTTP/1.1" 200 None 2026-05-05 18:21:23,069 - lava_callback - DEBUG - Processing node 69f79214096243809b56d1e7: baseline-arm-baylibre 2026-05-05 18:21:23,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79214096243809b56d1e7 2026-05-05 18:21:23,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:21:23,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79214096243809b56d1e7 HTTP/1.1" 200 None 2026-05-05 18:21:23,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:21:23,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-05 18:21:23,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:21:23,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79214096243809b56d1e7 HTTP/1.1" 200 None 2026-05-05 18:21:23,123 - lava_callback - ERROR - Error processing callback for node 69f79214096243809b56d1e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:21:36,071 - lava_callback - INFO - Received callback for node 69fa34f7a9d11f026cebeb82 INFO: 172.21.0.1:36554 - "POST /node/69fa34f7a9d11f026cebeb82 HTTP/1.0" 202 Accepted 2026-05-05 18:21:36,077 - lava_callback - INFO - Starting async job submit for node 69fa34f7a9d11f026cebeb82 2026-05-05 18:21:36,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:21:36,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa34f7a9d11f026cebeb82 HTTP/1.1" 200 None 2026-05-05 18:21:36,111 - lava_callback - DEBUG - Processing node 69fa34f7a9d11f026cebeb82: baseline-arm-pengutronix 2026-05-05 18:21:36,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:21:36,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:21:36,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa34f7a9d11f026cebeb82/log.txt.gz 2026-05-05 18:21:36,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:21:36,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:21:36,641 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa34f7a9d11f026cebeb82/lava-logs.yaml 2026-05-05 18:21:36,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:21:36,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:21:36,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa34f7a9d11f026cebeb82/lava_callback.json.gz 2026-05-05 18:21:36,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:21:36,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa34f7a9d11f026cebeb82 HTTP/1.1" 200 None 2026-05-05 18:21:36,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:21:36,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 18:21:36,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:21:36,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa34f7a9d11f026cebeb82 HTTP/1.1" 200 None 2026-05-05 18:21:36,862 - lava_callback - INFO - Completed processing callback for node 69fa34f7a9d11f026cebeb82 2026-05-05 18:21:42,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:21:42,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58352 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:22:03,094 - lava_callback - INFO - Received callback for node 69f79239096243809b56d1f7 INFO: 172.21.0.1:46972 - "POST /node/69f79239096243809b56d1f7 HTTP/1.0" 202 Accepted 2026-05-05 18:22:03,099 - lava_callback - INFO - Starting async job submit for node 69f79239096243809b56d1f7 2026-05-05 18:22:03,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:22:03,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79239096243809b56d1f7 HTTP/1.1" 200 None 2026-05-05 18:22:03,114 - lava_callback - DEBUG - Processing node 69f79239096243809b56d1f7: baseline-arm-baylibre 2026-05-05 18:22:03,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79239096243809b56d1f7 2026-05-05 18:22:03,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:22:03,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79239096243809b56d1f7 HTTP/1.1" 200 None 2026-05-05 18:22:03,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:22:03,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-05 18:22:03,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:22:03,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79239096243809b56d1f7 HTTP/1.1" 200 None 2026-05-05 18:22:03,158 - lava_callback - ERROR - Error processing callback for node 69f79239096243809b56d1f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56534 - "GET /node/69ef893b8305534e9723ad63%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36080 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:22:43,088 - lava_callback - INFO - Received callback for node 69f79260096243809b56d20c INFO: 172.21.0.1:55150 - "POST /node/69f79260096243809b56d20c HTTP/1.0" 202 Accepted 2026-05-05 18:22:43,094 - lava_callback - INFO - Starting async job submit for node 69f79260096243809b56d20c 2026-05-05 18:22:43,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:22:43,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79260096243809b56d20c HTTP/1.1" 200 None 2026-05-05 18:22:43,114 - lava_callback - DEBUG - Processing node 69f79260096243809b56d20c: baseline-arm-baylibre 2026-05-05 18:22:43,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79260096243809b56d20c 2026-05-05 18:22:43,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:22:43,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79260096243809b56d20c HTTP/1.1" 200 None 2026-05-05 18:22:43,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:22:43,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-05 18:22:43,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:22:43,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79260096243809b56d20c HTTP/1.1" 200 None 2026-05-05 18:22:43,171 - lava_callback - ERROR - Error processing callback for node 69f79260096243809b56d20c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:23:03,056 - lava_callback - INFO - Received callback for node 69f79281096243809b56d21d INFO: 172.21.0.1:41360 - "POST /node/69f79281096243809b56d21d HTTP/1.0" 202 Accepted 2026-05-05 18:23:03,062 - lava_callback - INFO - Starting async job submit for node 69f79281096243809b56d21d 2026-05-05 18:23:03,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:23:03,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79281096243809b56d21d HTTP/1.1" 200 None 2026-05-05 18:23:03,085 - lava_callback - DEBUG - Processing node 69f79281096243809b56d21d: baseline-arm-baylibre 2026-05-05 18:23:03,085 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79281096243809b56d21d 2026-05-05 18:23:03,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:23:03,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79281096243809b56d21d HTTP/1.1" 200 None 2026-05-05 18:23:03,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:23:03,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-05 18:23:03,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:23:03,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79281096243809b56d21d HTTP/1.1" 200 None 2026-05-05 18:23:03,147 - lava_callback - ERROR - Error processing callback for node 69f79281096243809b56d21d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58504 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:26:26,151 - lava_callback - INFO - Received callback for node 69f7933d096243809b56d27d INFO: 172.21.0.1:45440 - "POST /node/69f7933d096243809b56d27d HTTP/1.0" 202 Accepted 2026-05-05 18:26:26,156 - lava_callback - INFO - Starting async job submit for node 69f7933d096243809b56d27d 2026-05-05 18:26:26,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:26:26,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7933d096243809b56d27d HTTP/1.1" 200 None 2026-05-05 18:26:26,178 - lava_callback - DEBUG - Processing node 69f7933d096243809b56d27d: baseline-arm-clabbe 2026-05-05 18:26:26,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7933d096243809b56d27d 2026-05-05 18:26:26,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:26:26,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7933d096243809b56d27d HTTP/1.1" 200 None 2026-05-05 18:26:26,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:26:26,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f31f5ce4820821ef7eb HTTP/1.1" 200 None 2026-05-05 18:26:26,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:26:26,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7933d096243809b56d27d HTTP/1.1" 200 None 2026-05-05 18:26:26,229 - lava_callback - ERROR - Error processing callback for node 69f7933d096243809b56d27d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:29:23,442 - lava_callback - INFO - Received callback for node 69f793fc096243809b56d2d6 INFO: 172.21.0.1:52324 - "POST /node/69f793fc096243809b56d2d6 HTTP/1.0" 202 Accepted 2026-05-05 18:29:23,448 - lava_callback - INFO - Starting async job submit for node 69f793fc096243809b56d2d6 2026-05-05 18:29:23,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:29:23,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f793fc096243809b56d2d6 HTTP/1.1" 200 None 2026-05-05 18:29:23,466 - lava_callback - DEBUG - Processing node 69f793fc096243809b56d2d6: baseline-arm64-baylibre 2026-05-05 18:29:23,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f793fc096243809b56d2d6 2026-05-05 18:29:23,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:29:23,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f793fc096243809b56d2d6 HTTP/1.1" 200 None 2026-05-05 18:29:23,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:29:23,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:29:23,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:29:23,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f793fc096243809b56d2d6 HTTP/1.1" 200 None 2026-05-05 18:29:23,537 - lava_callback - ERROR - Error processing callback for node 69f793fc096243809b56d2d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:30:04,718 - lava_callback - INFO - Received callback for node 69fa3300a9d11f026cebeada INFO: 172.21.0.1:49770 - "POST /node/69fa3300a9d11f026cebeada HTTP/1.0" 202 Accepted 2026-05-05 18:30:04,725 - lava_callback - INFO - Starting async job submit for node 69fa3300a9d11f026cebeada 2026-05-05 18:30:04,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:30:04,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3300a9d11f026cebeada HTTP/1.1" 200 None 2026-05-05 18:30:04,840 - lava_callback - DEBUG - Processing node 69fa3300a9d11f026cebeada: ltp-smoke 2026-05-05 18:30:05,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:30:05,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:30:05,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa3300a9d11f026cebeada/log.txt.gz 2026-05-05 18:30:05,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:30:06,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:30:06,035 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa3300a9d11f026cebeada/lava-logs.yaml 2026-05-05 18:30:06,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:30:06,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:30:06,193 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa3300a9d11f026cebeada/lava_callback.json.gz 2026-05-05 18:30:06,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:30:06,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3300a9d11f026cebeada HTTP/1.1" 200 None 2026-05-05 18:30:06,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:30:06,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa186ca9d11f026cebb51e HTTP/1.1" 200 None 2026-05-05 18:30:06,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:30:06,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa3300a9d11f026cebeada HTTP/1.1" 200 None 2026-05-05 18:30:06,478 - lava_callback - INFO - Completed processing callback for node 69fa3300a9d11f026cebeada INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:30:12,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:30:12,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:30:43,544 - lava_callback - INFO - Received callback for node 69f79445096243809b56d2ff INFO: 172.21.0.1:43404 - "POST /node/69f79445096243809b56d2ff HTTP/1.0" 202 Accepted 2026-05-05 18:30:43,554 - lava_callback - INFO - Starting async job submit for node 69f79445096243809b56d2ff 2026-05-05 18:30:43,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:30:43,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79445096243809b56d2ff HTTP/1.1" 200 None 2026-05-05 18:30:43,577 - lava_callback - DEBUG - Processing node 69f79445096243809b56d2ff: baseline-arm64-baylibre 2026-05-05 18:30:43,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79445096243809b56d2ff 2026-05-05 18:30:43,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:30:43,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79445096243809b56d2ff HTTP/1.1" 200 None 2026-05-05 18:30:43,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:30:43,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:30:43,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:30:43,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79445096243809b56d2ff HTTP/1.1" 200 None 2026-05-05 18:30:43,632 - lava_callback - ERROR - Error processing callback for node 69f79445096243809b56d2ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:32:46,022 - lava_callback - INFO - Received callback for node 69fa370aa9d11f026cebec6a INFO: 172.21.0.1:57424 - "POST /node/69fa370aa9d11f026cebec6a HTTP/1.0" 202 Accepted 2026-05-05 18:32:46,028 - lava_callback - INFO - Starting async job submit for node 69fa370aa9d11f026cebec6a 2026-05-05 18:32:46,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:32:46,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa370aa9d11f026cebec6a HTTP/1.1" 200 None 2026-05-05 18:32:46,069 - lava_callback - DEBUG - Processing node 69fa370aa9d11f026cebec6a: baseline-arm64 INFO: 172.21.0.1:57428 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:32:46,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:32:46,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:32:46,655 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa370aa9d11f026cebec6a/log.txt.gz 2026-05-05 18:32:46,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:32:47,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:32:47,086 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa370aa9d11f026cebec6a/lava-logs.yaml 2026-05-05 18:32:47,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:32:47,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:32:47,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa370aa9d11f026cebec6a/lava_callback.json.gz 2026-05-05 18:32:47,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:32:47,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa370aa9d11f026cebec6a HTTP/1.1" 200 None 2026-05-05 18:32:47,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:32:47,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 18:32:47,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:32:47,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa370aa9d11f026cebec6a HTTP/1.1" 200 None 2026-05-05 18:32:47,362 - lava_callback - INFO - Completed processing callback for node 69fa370aa9d11f026cebec6a INFO: 172.21.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:33:12,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:33:12,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:35:46,588 - lava_callback - INFO - Received callback for node 69f79573096243809b56d39a INFO: 172.21.0.1:47428 - "POST /node/69f79573096243809b56d39a HTTP/1.0" 202 Accepted 2026-05-05 18:35:46,594 - lava_callback - INFO - Starting async job submit for node 69f79573096243809b56d39a 2026-05-05 18:35:46,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:35:46,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79573096243809b56d39a HTTP/1.1" 200 None 2026-05-05 18:35:46,610 - lava_callback - DEBUG - Processing node 69f79573096243809b56d39a: baseline-arm64-clabbe 2026-05-05 18:35:46,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79573096243809b56d39a 2026-05-05 18:35:46,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:35:46,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79573096243809b56d39a HTTP/1.1" 200 None 2026-05-05 18:35:46,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:35:46,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:35:46,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:35:46,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79573096243809b56d39a HTTP/1.1" 200 None 2026-05-05 18:35:46,664 - lava_callback - ERROR - Error processing callback for node 69f79573096243809b56d39a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:36:58,262 - lava_callback - INFO - Received callback for node 69fa34c9a9d11f026cebeb74 INFO: 172.21.0.1:50270 - "POST /node/69fa34c9a9d11f026cebeb74 HTTP/1.0" 202 Accepted 2026-05-05 18:36:58,269 - lava_callback - INFO - Starting async job submit for node 69fa34c9a9d11f026cebeb74 2026-05-05 18:36:58,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:36:58,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa34c9a9d11f026cebeb74 HTTP/1.1" 200 None 2026-05-05 18:36:58,337 - lava_callback - DEBUG - Processing node 69fa34c9a9d11f026cebeb74: baseline-arm 2026-05-05 18:36:59,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:36:59,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:36:59,206 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fa34c9a9d11f026cebeb74/log.txt.gz 2026-05-05 18:36:59,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:36:59,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:36:59,846 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa34c9a9d11f026cebeb74/lava-logs.yaml 2026-05-05 18:36:59,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:36:59,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:36:59,994 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa34c9a9d11f026cebeb74/lava_callback.json.gz DEBUG: Setup failed for 69fa34c9a9d11f026cebeb74. Transitting job node result: incomplete -> fail 2026-05-05 18:37:00,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:37:00,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa34c9a9d11f026cebeb74 HTTP/1.1" 200 None 2026-05-05 18:37:00,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:37:00,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 18:37:00,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:37:00,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa34c9a9d11f026cebeb74 HTTP/1.1" 200 None 2026-05-05 18:37:00,260 - lava_callback - INFO - Completed processing callback for node 69fa34c9a9d11f026cebeb74 INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:37:06,543 - lava_callback - INFO - Received callback for node 69f795c0096243809b56d3b8 INFO: 172.21.0.1:39208 - "POST /node/69f795c0096243809b56d3b8 HTTP/1.0" 202 Accepted 2026-05-05 18:37:06,549 - lava_callback - INFO - Starting async job submit for node 69f795c0096243809b56d3b8 2026-05-05 18:37:06,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:37:06,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f795c0096243809b56d3b8 HTTP/1.1" 200 None 2026-05-05 18:37:06,564 - lava_callback - DEBUG - Processing node 69f795c0096243809b56d3b8: baseline-arm64-clabbe 2026-05-05 18:37:06,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f795c0096243809b56d3b8 2026-05-05 18:37:06,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:37:06,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f795c0096243809b56d3b8 HTTP/1.1" 200 None 2026-05-05 18:37:06,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:37:06,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:37:06,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:37:06,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f795c0096243809b56d3b8 HTTP/1.1" 200 None 2026-05-05 18:37:06,614 - lava_callback - ERROR - Error processing callback for node 69f795c0096243809b56d3b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 18:37:12,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:37:12,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:38:26,796 - lava_callback - INFO - Received callback for node 69f7960f096243809b56d3df INFO: 172.21.0.1:36478 - "POST /node/69f7960f096243809b56d3df HTTP/1.0" 202 Accepted 2026-05-05 18:38:26,802 - lava_callback - INFO - Starting async job submit for node 69f7960f096243809b56d3df 2026-05-05 18:38:26,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:38:26,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7960f096243809b56d3df HTTP/1.1" 200 None 2026-05-05 18:38:26,818 - lava_callback - DEBUG - Processing node 69f7960f096243809b56d3df: baseline-arm64-clabbe 2026-05-05 18:38:26,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7960f096243809b56d3df 2026-05-05 18:38:26,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:38:26,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7960f096243809b56d3df HTTP/1.1" 200 None 2026-05-05 18:38:26,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:38:26,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:38:26,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:38:26,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7960f096243809b56d3df HTTP/1.1" 200 None 2026-05-05 18:38:26,865 - lava_callback - ERROR - Error processing callback for node 69f7960f096243809b56d3df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42218 - "GET /node/69f56134ed4ed40b0224134d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42230 - "GET /node/69934b18523507f3806a54c8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET /node/6992e0ef31166481c8dd642b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:39:46,689 - lava_callback - INFO - Received callback for node 69f7965d096243809b56d414 INFO: 172.21.0.1:37898 - "POST /node/69f7965d096243809b56d414 HTTP/1.0" 202 Accepted 2026-05-05 18:39:46,695 - lava_callback - INFO - Starting async job submit for node 69f7965d096243809b56d414 2026-05-05 18:39:46,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:39:46,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7965d096243809b56d414 HTTP/1.1" 200 None 2026-05-05 18:39:46,711 - lava_callback - DEBUG - Processing node 69f7965d096243809b56d414: baseline-arm64-clabbe 2026-05-05 18:39:46,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7965d096243809b56d414 2026-05-05 18:39:46,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:39:46,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7965d096243809b56d414 HTTP/1.1" 200 None 2026-05-05 18:39:46,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:39:46,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:39:46,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:39:46,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7965d096243809b56d414 HTTP/1.1" 200 None 2026-05-05 18:39:46,756 - lava_callback - ERROR - Error processing callback for node 69f7965d096243809b56d414: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56228 - "GET /node/693af6cefee8383e92b6bd49%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56234 - "GET /node/69e985be8137cb226ce202d7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:40:46,732 - lava_callback - INFO - Received callback for node 69f796aa096243809b56d434 INFO: 172.21.0.1:44056 - "POST /node/69f796aa096243809b56d434 HTTP/1.0" 202 Accepted 2026-05-05 18:40:46,738 - lava_callback - INFO - Starting async job submit for node 69f796aa096243809b56d434 2026-05-05 18:40:46,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:40:46,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f796aa096243809b56d434 HTTP/1.1" 200 None 2026-05-05 18:40:46,755 - lava_callback - DEBUG - Processing node 69f796aa096243809b56d434: baseline-arm64-clabbe 2026-05-05 18:40:46,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f796aa096243809b56d434 2026-05-05 18:40:46,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:40:46,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f796aa096243809b56d434 HTTP/1.1" 200 None 2026-05-05 18:40:46,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:40:46,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:40:46,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:40:46,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f796aa096243809b56d434 HTTP/1.1" 200 None 2026-05-05 18:40:46,836 - lava_callback - ERROR - Error processing callback for node 69f796aa096243809b56d434: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59148 - "GET /node/68f87cf81f469265150765d4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57902 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:42:06,730 - lava_callback - INFO - Received callback for node 69f796f9096243809b56d45c INFO: 172.21.0.1:57914 - "POST /node/69f796f9096243809b56d45c HTTP/1.0" 202 Accepted 2026-05-05 18:42:06,736 - lava_callback - INFO - Starting async job submit for node 69f796f9096243809b56d45c 2026-05-05 18:42:06,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:42:06,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f796f9096243809b56d45c HTTP/1.1" 200 None 2026-05-05 18:42:06,750 - lava_callback - DEBUG - Processing node 69f796f9096243809b56d45c: baseline-arm64-clabbe 2026-05-05 18:42:06,751 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f796f9096243809b56d45c 2026-05-05 18:42:06,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:42:06,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f796f9096243809b56d45c HTTP/1.1" 200 None 2026-05-05 18:42:06,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:42:06,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:42:06,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:42:06,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f796f9096243809b56d45c HTTP/1.1" 200 None 2026-05-05 18:42:06,797 - lava_callback - ERROR - Error processing callback for node 69f796f9096243809b56d45c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:42:23,314 - lava_callback - INFO - Received callback for node 69fa3566a9d11f026cebebb8 INFO: 172.21.0.1:37884 - "POST /node/69fa3566a9d11f026cebebb8 HTTP/1.0" 202 Accepted 2026-05-05 18:42:23,326 - lava_callback - INFO - Starting async job submit for node 69fa3566a9d11f026cebebb8 2026-05-05 18:42:23,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:42:23,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3566a9d11f026cebebb8 HTTP/1.1" 200 None 2026-05-05 18:42:23,394 - lava_callback - DEBUG - Processing node 69fa3566a9d11f026cebebb8: baseline-nfs-arm64 2026-05-05 18:42:24,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:42:24,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:42:24,649 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa3566a9d11f026cebebb8/log.txt.gz 2026-05-05 18:42:25,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:42:25,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:42:25,571 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa3566a9d11f026cebebb8/lava-logs.yaml 2026-05-05 18:42:25,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:42:25,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:42:25,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa3566a9d11f026cebebb8/lava_callback.json.gz DEBUG: Setup failed for 69fa3566a9d11f026cebebb8. Transitting job node result: incomplete -> fail 2026-05-05 18:42:25,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:42:25,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3566a9d11f026cebebb8 HTTP/1.1" 200 None 2026-05-05 18:42:25,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:42:25,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 18:42:25,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:42:25,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa3566a9d11f026cebebb8 HTTP/1.1" 200 None 2026-05-05 18:42:26,010 - lava_callback - INFO - Completed processing callback for node 69fa3566a9d11f026cebebb8 INFO: 172.21.0.1:37896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32840 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:42:42,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:42:42,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33040 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:43:26,779 - lava_callback - INFO - Received callback for node 69f79749096243809b56d48a INFO: 172.21.0.1:33050 - "POST /node/69f79749096243809b56d48a HTTP/1.0" 202 Accepted 2026-05-05 18:43:26,784 - lava_callback - INFO - Starting async job submit for node 69f79749096243809b56d48a 2026-05-05 18:43:26,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:43:26,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79749096243809b56d48a HTTP/1.1" 200 None 2026-05-05 18:43:26,806 - lava_callback - DEBUG - Processing node 69f79749096243809b56d48a: baseline-arm64-clabbe 2026-05-05 18:43:26,807 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79749096243809b56d48a 2026-05-05 18:43:26,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:43:26,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79749096243809b56d48a HTTP/1.1" 200 None 2026-05-05 18:43:26,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:43:26,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:43:26,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:43:26,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79749096243809b56d48a HTTP/1.1" 200 None 2026-05-05 18:43:26,863 - lava_callback - ERROR - Error processing callback for node 69f79749096243809b56d48a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:44:19,010 - lava_callback - INFO - Received callback for node 69fa3605a9d11f026cebebfe INFO: 172.21.0.1:41908 - "POST /node/69fa3605a9d11f026cebebfe HTTP/1.0" 202 Accepted 2026-05-05 18:44:19,058 - lava_callback - INFO - Starting async job submit for node 69fa3605a9d11f026cebebfe 2026-05-05 18:44:19,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:44:19,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3605a9d11f026cebebfe HTTP/1.1" 200 None 2026-05-05 18:44:19,108 - lava_callback - DEBUG - Processing node 69fa3605a9d11f026cebebfe: baseline-arm-pengutronix 2026-05-05 18:44:19,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:44:19,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:44:19,368 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa3605a9d11f026cebebfe/log.txt.gz 2026-05-05 18:44:19,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:44:19,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:44:19,593 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa3605a9d11f026cebebfe/lava-logs.yaml 2026-05-05 18:44:19,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:44:19,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:44:19,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa3605a9d11f026cebebfe/lava_callback.json.gz DEBUG: Setup failed for 69fa3605a9d11f026cebebfe. Transitting job node result: incomplete -> fail 2026-05-05 18:44:19,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:44:19,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3605a9d11f026cebebfe HTTP/1.1" 200 None 2026-05-05 18:44:19,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:44:19,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 18:44:19,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:44:19,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa3605a9d11f026cebebfe HTTP/1.1" 200 None 2026-05-05 18:44:19,860 - lava_callback - INFO - Completed processing callback for node 69fa3605a9d11f026cebebfe INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:44:42,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:44:42,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57466 - "GET /node/68f0b03a63a1669d46b3fd14%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:45:26,908 - lava_callback - INFO - Received callback for node 69f797bd096243809b56d4b6 INFO: 172.21.0.1:37328 - "POST /node/69f797bd096243809b56d4b6 HTTP/1.0" 202 Accepted 2026-05-05 18:45:26,919 - lava_callback - INFO - Starting async job submit for node 69f797bd096243809b56d4b6 2026-05-05 18:45:26,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:45:26,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f797bd096243809b56d4b6 HTTP/1.1" 200 None 2026-05-05 18:45:26,964 - lava_callback - DEBUG - Processing node 69f797bd096243809b56d4b6: baseline-arm64-clabbe 2026-05-05 18:45:26,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f797bd096243809b56d4b6 2026-05-05 18:45:26,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:45:26,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f797bd096243809b56d4b6 HTTP/1.1" 200 None 2026-05-05 18:45:26,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:45:26,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:45:27,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:45:27,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f797bd096243809b56d4b6 HTTP/1.1" 200 None 2026-05-05 18:45:27,022 - lava_callback - ERROR - Error processing callback for node 69f797bd096243809b56d4b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 18:45:33,509 - lava_callback - INFO - Received callback for node 69fa3983a9d11f026cebed7f INFO: 172.21.0.1:55946 - "POST /node/69fa3983a9d11f026cebed7f HTTP/1.0" 202 Accepted 2026-05-05 18:45:33,516 - lava_callback - INFO - Starting async job submit for node 69fa3983a9d11f026cebed7f 2026-05-05 18:45:33,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:45:33,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3983a9d11f026cebed7f HTTP/1.1" 200 None 2026-05-05 18:45:33,595 - lava_callback - DEBUG - Processing node 69fa3983a9d11f026cebed7f: baseline-arm64 2026-05-05 18:45:34,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:45:34,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:45:34,201 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa3983a9d11f026cebed7f/log.txt.gz 2026-05-05 18:45:34,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:45:34,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:45:34,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa3983a9d11f026cebed7f/lava-logs.yaml 2026-05-05 18:45:34,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 18:45:34,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 18:45:34,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa3983a9d11f026cebed7f/lava_callback.json.gz DEBUG: Setup failed for 69fa3983a9d11f026cebed7f. Transitting job node result: incomplete -> fail 2026-05-05 18:45:34,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:45:34,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3983a9d11f026cebed7f HTTP/1.1" 200 None 2026-05-05 18:45:34,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:45:34,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 18:45:34,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:45:34,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa3983a9d11f026cebed7f HTTP/1.1" 200 None 2026-05-05 18:45:34,973 - lava_callback - INFO - Completed processing callback for node 69fa3983a9d11f026cebed7f INFO: 172.21.0.1:55952 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:45:42,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:45:42,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50988 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:46:46,905 - lava_callback - INFO - Received callback for node 69f7980e096243809b56d4de INFO: 172.21.0.1:50996 - "POST /node/69f7980e096243809b56d4de HTTP/1.0" 202 Accepted 2026-05-05 18:46:46,911 - lava_callback - INFO - Starting async job submit for node 69f7980e096243809b56d4de 2026-05-05 18:46:46,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:46:46,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7980e096243809b56d4de HTTP/1.1" 200 None 2026-05-05 18:46:46,925 - lava_callback - DEBUG - Processing node 69f7980e096243809b56d4de: baseline-arm64-clabbe 2026-05-05 18:46:46,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7980e096243809b56d4de 2026-05-05 18:46:46,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:46:46,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7980e096243809b56d4de HTTP/1.1" 200 None 2026-05-05 18:46:46,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:46:46,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:46:46,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:46:46,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7980e096243809b56d4de HTTP/1.1" 200 None 2026-05-05 18:46:46,984 - lava_callback - ERROR - Error processing callback for node 69f7980e096243809b56d4de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:48:06,970 - lava_callback - INFO - Received callback for node 69f7985f096243809b56d508 INFO: 172.21.0.1:38748 - "POST /node/69f7985f096243809b56d508 HTTP/1.0" 202 Accepted 2026-05-05 18:48:06,975 - lava_callback - INFO - Starting async job submit for node 69f7985f096243809b56d508 2026-05-05 18:48:06,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:48:06,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7985f096243809b56d508 HTTP/1.1" 200 None 2026-05-05 18:48:06,990 - lava_callback - DEBUG - Processing node 69f7985f096243809b56d508: baseline-arm64-clabbe 2026-05-05 18:48:06,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7985f096243809b56d508 2026-05-05 18:48:06,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:48:07,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7985f096243809b56d508 HTTP/1.1" 200 None 2026-05-05 18:48:07,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:48:07,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:48:07,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:48:07,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7985f096243809b56d508 HTTP/1.1" 200 None 2026-05-05 18:48:07,036 - lava_callback - ERROR - Error processing callback for node 69f7985f096243809b56d508: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET /node/6992da7131166481c8dd45fb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42772 - "GET /node/69e516309a34686dd62ebc9d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:50:47,083 - lava_callback - INFO - Received callback for node 69f798f6096243809b56d580 INFO: 172.21.0.1:35444 - "POST /node/69f798f6096243809b56d580 HTTP/1.0" 202 Accepted 2026-05-05 18:50:47,089 - lava_callback - INFO - Starting async job submit for node 69f798f6096243809b56d580 2026-05-05 18:50:47,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:50:47,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f798f6096243809b56d580 HTTP/1.1" 200 None 2026-05-05 18:50:47,109 - lava_callback - DEBUG - Processing node 69f798f6096243809b56d580: baseline-arm64-clabbe 2026-05-05 18:50:47,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f798f6096243809b56d580 2026-05-05 18:50:47,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:50:47,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f798f6096243809b56d580 HTTP/1.1" 200 None 2026-05-05 18:50:47,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:50:47,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:50:47,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:50:47,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f798f6096243809b56d580 HTTP/1.1" 200 None 2026-05-05 18:50:47,170 - lava_callback - ERROR - Error processing callback for node 69f798f6096243809b56d580: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:52:07,068 - lava_callback - INFO - Received callback for node 69f79947096243809b56d5a9 INFO: 172.21.0.1:59312 - "POST /node/69f79947096243809b56d5a9 HTTP/1.0" 202 Accepted 2026-05-05 18:52:07,077 - lava_callback - INFO - Starting async job submit for node 69f79947096243809b56d5a9 2026-05-05 18:52:07,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:52:07,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79947096243809b56d5a9 HTTP/1.1" 200 None 2026-05-05 18:52:07,095 - lava_callback - DEBUG - Processing node 69f79947096243809b56d5a9: baseline-arm64-clabbe 2026-05-05 18:52:07,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79947096243809b56d5a9 2026-05-05 18:52:07,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:52:07,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79947096243809b56d5a9 HTTP/1.1" 200 None 2026-05-05 18:52:07,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:52:07,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:52:07,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:52:07,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79947096243809b56d5a9 HTTP/1.1" 200 None 2026-05-05 18:52:07,148 - lava_callback - ERROR - Error processing callback for node 69f79947096243809b56d5a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET /node/6992fda131166481c8ddf038%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57846 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:53:24,808 - lava_callback - INFO - Received callback for node 69f79990096243809b56d5c0 INFO: 172.21.0.1:34546 - "POST /node/69f79990096243809b56d5c0 HTTP/1.0" 202 Accepted 2026-05-05 18:53:24,814 - lava_callback - INFO - Starting async job submit for node 69f79990096243809b56d5c0 2026-05-05 18:53:24,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:53:24,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79990096243809b56d5c0 HTTP/1.1" 200 None 2026-05-05 18:53:24,833 - lava_callback - DEBUG - Processing node 69f79990096243809b56d5c0: baseline-arm64-baylibre 2026-05-05 18:53:24,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79990096243809b56d5c0 2026-05-05 18:53:24,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:53:24,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79990096243809b56d5c0 HTTP/1.1" 200 None 2026-05-05 18:53:24,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:53:24,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:53:24,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:53:24,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79990096243809b56d5c0 HTTP/1.1" 200 None 2026-05-05 18:53:24,880 - lava_callback - ERROR - Error processing callback for node 69f79990096243809b56d5c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:55:24,825 - lava_callback - INFO - Received callback for node 69f79a0b096243809b56d5f9 INFO: 172.21.0.1:49978 - "POST /node/69f79a0b096243809b56d5f9 HTTP/1.0" 202 Accepted 2026-05-05 18:55:24,831 - lava_callback - INFO - Starting async job submit for node 69f79a0b096243809b56d5f9 2026-05-05 18:55:24,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:55:24,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79a0b096243809b56d5f9 HTTP/1.1" 200 None 2026-05-05 18:55:24,849 - lava_callback - DEBUG - Processing node 69f79a0b096243809b56d5f9: baseline-arm64-baylibre 2026-05-05 18:55:24,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79a0b096243809b56d5f9 2026-05-05 18:55:24,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:55:24,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79a0b096243809b56d5f9 HTTP/1.1" 200 None 2026-05-05 18:55:24,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:55:24,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:55:24,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:55:24,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79a0b096243809b56d5f9 HTTP/1.1" 200 None 2026-05-05 18:55:24,913 - lava_callback - ERROR - Error processing callback for node 69f79a0b096243809b56d5f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:57:04,940 - lava_callback - INFO - Received callback for node 69f79a7f096243809b56d62c INFO: 172.21.0.1:47218 - "POST /node/69f79a7f096243809b56d62c HTTP/1.0" 202 Accepted 2026-05-05 18:57:04,946 - lava_callback - INFO - Starting async job submit for node 69f79a7f096243809b56d62c 2026-05-05 18:57:04,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:57:04,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79a7f096243809b56d62c HTTP/1.1" 200 None 2026-05-05 18:57:04,961 - lava_callback - DEBUG - Processing node 69f79a7f096243809b56d62c: baseline-arm64-baylibre 2026-05-05 18:57:04,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79a7f096243809b56d62c 2026-05-05 18:57:04,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:57:04,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79a7f096243809b56d62c HTTP/1.1" 200 None 2026-05-05 18:57:04,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:57:04,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:57:04,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:57:05,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79a7f096243809b56d62c HTTP/1.1" 200 None 2026-05-05 18:57:05,017 - lava_callback - ERROR - Error processing callback for node 69f79a7f096243809b56d62c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET / HTTP/1.0" 200 OK 2026-05-05 18:59:45,078 - lava_callback - INFO - Received callback for node 69f79b13096243809b56d684 INFO: 172.21.0.1:58482 - "POST /node/69f79b13096243809b56d684 HTTP/1.0" 202 Accepted 2026-05-05 18:59:45,083 - lava_callback - INFO - Starting async job submit for node 69f79b13096243809b56d684 2026-05-05 18:59:45,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:59:45,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79b13096243809b56d684 HTTP/1.1" 200 None 2026-05-05 18:59:45,108 - lava_callback - DEBUG - Processing node 69f79b13096243809b56d684: baseline-arm64-baylibre 2026-05-05 18:59:45,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79b13096243809b56d684 2026-05-05 18:59:45,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:59:45,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79b13096243809b56d684 HTTP/1.1" 200 None 2026-05-05 18:59:45,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:59:45,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 18:59:45,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 18:59:45,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79b13096243809b56d684 HTTP/1.1" 200 None 2026-05-05 18:59:45,153 - lava_callback - ERROR - Error processing callback for node 69f79b13096243809b56d684: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET /node/69ef76048305534e9723a4e6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53532 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:01:07,426 - lava_callback - INFO - Received callback for node 69f79b5d096243809b56d6a7 INFO: 172.21.0.1:53542 - "POST /node/69f79b5d096243809b56d6a7 HTTP/1.0" 202 Accepted 2026-05-05 19:01:07,433 - lava_callback - INFO - Starting async job submit for node 69f79b5d096243809b56d6a7 2026-05-05 19:01:07,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:01:07,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79b5d096243809b56d6a7 HTTP/1.1" 200 None 2026-05-05 19:01:07,453 - lava_callback - DEBUG - Processing node 69f79b5d096243809b56d6a7: baseline-arm-clabbe 2026-05-05 19:01:07,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79b5d096243809b56d6a7 2026-05-05 19:01:07,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:01:07,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79b5d096243809b56d6a7 HTTP/1.1" 200 None 2026-05-05 19:01:07,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:01:07,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-05 19:01:07,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:01:07,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79b5d096243809b56d6a7 HTTP/1.1" 200 None 2026-05-05 19:01:07,511 - lava_callback - ERROR - Error processing callback for node 69f79b5d096243809b56d6a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55750 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:01:45,157 - lava_callback - INFO - Received callback for node 69f79b8a096243809b56d6c5 INFO: 172.21.0.1:45646 - "POST /node/69f79b8a096243809b56d6c5 HTTP/1.0" 202 Accepted 2026-05-05 19:01:45,162 - lava_callback - INFO - Starting async job submit for node 69f79b8a096243809b56d6c5 2026-05-05 19:01:45,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:01:45,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79b8a096243809b56d6c5 HTTP/1.1" 200 None 2026-05-05 19:01:45,177 - lava_callback - DEBUG - Processing node 69f79b8a096243809b56d6c5: baseline-arm64-baylibre 2026-05-05 19:01:45,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79b8a096243809b56d6c5 2026-05-05 19:01:45,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:01:45,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79b8a096243809b56d6c5 HTTP/1.1" 200 None 2026-05-05 19:01:45,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:01:45,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 19:01:45,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:01:45,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79b8a096243809b56d6c5 HTTP/1.1" 200 None 2026-05-05 19:01:45,224 - lava_callback - ERROR - Error processing callback for node 69f79b8a096243809b56d6c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:02:47,539 - lava_callback - INFO - Received callback for node 69f79bd2096243809b56d6e7 INFO: 172.21.0.1:45942 - "POST /node/69f79bd2096243809b56d6e7 HTTP/1.0" 202 Accepted 2026-05-05 19:02:47,547 - lava_callback - INFO - Starting async job submit for node 69f79bd2096243809b56d6e7 2026-05-05 19:02:47,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:02:47,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79bd2096243809b56d6e7 HTTP/1.1" 200 None 2026-05-05 19:02:47,564 - lava_callback - DEBUG - Processing node 69f79bd2096243809b56d6e7: baseline-arm-clabbe 2026-05-05 19:02:47,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79bd2096243809b56d6e7 2026-05-05 19:02:47,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:02:47,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79bd2096243809b56d6e7 HTTP/1.1" 200 None 2026-05-05 19:02:47,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:02:47,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-05 19:02:47,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:02:47,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79bd2096243809b56d6e7 HTTP/1.1" 200 None 2026-05-05 19:02:47,611 - lava_callback - ERROR - Error processing callback for node 69f79bd2096243809b56d6e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33336 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:03:27,486 - lava_callback - INFO - Received callback for node 69f79bf9096243809b56d703 INFO: 172.21.0.1:33338 - "POST /node/69f79bf9096243809b56d703 HTTP/1.0" 202 Accepted 2026-05-05 19:03:27,491 - lava_callback - INFO - Starting async job submit for node 69f79bf9096243809b56d703 2026-05-05 19:03:27,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:03:27,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79bf9096243809b56d703 HTTP/1.1" 200 None 2026-05-05 19:03:27,507 - lava_callback - DEBUG - Processing node 69f79bf9096243809b56d703: baseline-arm-clabbe 2026-05-05 19:03:27,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79bf9096243809b56d703 2026-05-05 19:03:27,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:03:27,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79bf9096243809b56d703 HTTP/1.1" 200 None 2026-05-05 19:03:27,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:03:27,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-05 19:03:27,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:03:27,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79bf9096243809b56d703 HTTP/1.1" 200 None 2026-05-05 19:03:27,563 - lava_callback - ERROR - Error processing callback for node 69f79bf9096243809b56d703: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:04:25,361 - lava_callback - INFO - Received callback for node 69f79c26096243809b56d710 INFO: 172.21.0.1:55618 - "POST /node/69f79c26096243809b56d710 HTTP/1.0" 202 Accepted 2026-05-05 19:04:25,368 - lava_callback - INFO - Starting async job submit for node 69f79c26096243809b56d710 2026-05-05 19:04:25,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:04:25,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79c26096243809b56d710 HTTP/1.1" 200 None 2026-05-05 19:04:25,389 - lava_callback - DEBUG - Processing node 69f79c26096243809b56d710: baseline-arm64-baylibre 2026-05-05 19:04:25,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79c26096243809b56d710 2026-05-05 19:04:25,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:04:25,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79c26096243809b56d710 HTTP/1.1" 200 None 2026-05-05 19:04:25,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:04:25,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 19:04:25,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:04:25,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79c26096243809b56d710 HTTP/1.1" 200 None 2026-05-05 19:04:25,484 - lava_callback - ERROR - Error processing callback for node 69f79c26096243809b56d710: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:05:27,625 - lava_callback - INFO - Received callback for node 69f79c6f096243809b56d739 INFO: 172.21.0.1:39100 - "POST /node/69f79c6f096243809b56d739 HTTP/1.0" 202 Accepted 2026-05-05 19:05:27,630 - lava_callback - INFO - Starting async job submit for node 69f79c6f096243809b56d739 2026-05-05 19:05:27,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:05:27,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79c6f096243809b56d739 HTTP/1.1" 200 None 2026-05-05 19:05:27,646 - lava_callback - DEBUG - Processing node 69f79c6f096243809b56d739: baseline-arm-clabbe 2026-05-05 19:05:27,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79c6f096243809b56d739 2026-05-05 19:05:27,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:05:27,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79c6f096243809b56d739 HTTP/1.1" 200 None 2026-05-05 19:05:27,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:05:27,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-05 19:05:27,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:05:27,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79c6f096243809b56d739 HTTP/1.1" 200 None 2026-05-05 19:05:27,691 - lava_callback - ERROR - Error processing callback for node 69f79c6f096243809b56d739: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48590 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:06:27,655 - lava_callback - INFO - Received callback for node 69f79ca1096243809b56d74f INFO: 172.21.0.1:48600 - "POST /node/69f79ca1096243809b56d74f HTTP/1.0" 202 Accepted 2026-05-05 19:06:27,661 - lava_callback - INFO - Starting async job submit for node 69f79ca1096243809b56d74f 2026-05-05 19:06:27,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:06:27,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79ca1096243809b56d74f HTTP/1.1" 200 None 2026-05-05 19:06:27,676 - lava_callback - DEBUG - Processing node 69f79ca1096243809b56d74f: baseline-arm64-clabbe 2026-05-05 19:06:27,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79ca1096243809b56d74f 2026-05-05 19:06:27,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:06:27,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79ca1096243809b56d74f HTTP/1.1" 200 None 2026-05-05 19:06:27,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:06:27,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 19:06:27,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:06:27,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79ca1096243809b56d74f HTTP/1.1" 200 None 2026-05-05 19:06:27,727 - lava_callback - ERROR - Error processing callback for node 69f79ca1096243809b56d74f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:07:27,735 - lava_callback - INFO - Received callback for node 69f79ce5096243809b56d774 INFO: 172.21.0.1:35784 - "POST /node/69f79ce5096243809b56d774 HTTP/1.0" 202 Accepted 2026-05-05 19:07:27,740 - lava_callback - INFO - Starting async job submit for node 69f79ce5096243809b56d774 2026-05-05 19:07:27,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:07:27,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79ce5096243809b56d774 HTTP/1.1" 200 None 2026-05-05 19:07:27,756 - lava_callback - DEBUG - Processing node 69f79ce5096243809b56d774: baseline-arm-clabbe 2026-05-05 19:07:27,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79ce5096243809b56d774 2026-05-05 19:07:27,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:07:27,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79ce5096243809b56d774 HTTP/1.1" 200 None 2026-05-05 19:07:27,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:07:27,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6942d1f903fec0b0dbc77 HTTP/1.1" 200 None 2026-05-05 19:07:27,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:07:27,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79ce5096243809b56d774 HTTP/1.1" 200 None 2026-05-05 19:07:27,803 - lava_callback - ERROR - Error processing callback for node 69f79ce5096243809b56d774: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:09:27,814 - lava_callback - INFO - Received callback for node 69f79d55096243809b56d795 INFO: 172.21.0.1:45232 - "POST /node/69f79d55096243809b56d795 HTTP/1.0" 202 Accepted 2026-05-05 19:09:27,820 - lava_callback - INFO - Starting async job submit for node 69f79d55096243809b56d795 2026-05-05 19:09:27,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:09:27,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79d55096243809b56d795 HTTP/1.1" 200 None 2026-05-05 19:09:27,836 - lava_callback - DEBUG - Processing node 69f79d55096243809b56d795: baseline-arm64-clabbe 2026-05-05 19:09:27,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79d55096243809b56d795 2026-05-05 19:09:27,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:09:27,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79d55096243809b56d795 HTTP/1.1" 200 None 2026-05-05 19:09:27,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:09:27,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 19:09:27,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:09:27,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79d55096243809b56d795 HTTP/1.1" 200 None 2026-05-05 19:09:27,897 - lava_callback - ERROR - Error processing callback for node 69f79d55096243809b56d795: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51766 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:10:47,884 - lava_callback - INFO - Received callback for node 69f79da6096243809b56d7be INFO: 172.21.0.1:51778 - "POST /node/69f79da6096243809b56d7be HTTP/1.0" 202 Accepted 2026-05-05 19:10:47,890 - lava_callback - INFO - Starting async job submit for node 69f79da6096243809b56d7be 2026-05-05 19:10:47,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:10:47,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79da6096243809b56d7be HTTP/1.1" 200 None 2026-05-05 19:10:47,905 - lava_callback - DEBUG - Processing node 69f79da6096243809b56d7be: baseline-arm64-clabbe 2026-05-05 19:10:47,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79da6096243809b56d7be 2026-05-05 19:10:47,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:10:47,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79da6096243809b56d7be HTTP/1.1" 200 None 2026-05-05 19:10:47,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:10:47,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 19:10:47,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:10:47,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79da6096243809b56d7be HTTP/1.1" 200 None 2026-05-05 19:10:47,954 - lava_callback - ERROR - Error processing callback for node 69f79da6096243809b56d7be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55402 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:11:46,615 - lava_callback - INFO - Received callback for node 69fa3cbea9d11f026cebeee9 INFO: 172.21.0.1:55406 - "POST /node/69fa3cbea9d11f026cebeee9 HTTP/1.0" 202 Accepted 2026-05-05 19:11:46,622 - lava_callback - INFO - Starting async job submit for node 69fa3cbea9d11f026cebeee9 2026-05-05 19:11:46,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:11:46,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3cbea9d11f026cebeee9 HTTP/1.1" 200 None 2026-05-05 19:11:46,695 - lava_callback - DEBUG - Processing node 69fa3cbea9d11f026cebeee9: ltp-smoke 2026-05-05 19:11:47,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:11:47,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:11:47,305 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa3cbea9d11f026cebeee9/log.txt.gz 2026-05-05 19:11:47,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:11:47,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:11:47,823 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa3cbea9d11f026cebeee9/lava-logs.yaml 2026-05-05 19:11:47,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:11:47,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:11:47,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69fa3cbea9d11f026cebeee9/lava_callback.json.gz 2026-05-05 19:11:48,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:11:48,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3cbea9d11f026cebeee9 HTTP/1.1" 200 None 2026-05-05 19:11:48,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:11:48,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa186ca9d11f026cebb51e HTTP/1.1" 200 None 2026-05-05 19:11:48,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:11:48,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa3cbea9d11f026cebeee9 HTTP/1.1" 200 None 2026-05-05 19:11:48,299 - lava_callback - INFO - Completed processing callback for node 69fa3cbea9d11f026cebeee9 INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:12:07,862 - lava_callback - INFO - Received callback for node 69f79df8096243809b56d7f1 INFO: 172.21.0.1:44512 - "POST /node/69f79df8096243809b56d7f1 HTTP/1.0" 202 Accepted 2026-05-05 19:12:07,868 - lava_callback - INFO - Starting async job submit for node 69f79df8096243809b56d7f1 2026-05-05 19:12:07,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:12:07,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79df8096243809b56d7f1 HTTP/1.1" 200 None 2026-05-05 19:12:07,883 - lava_callback - DEBUG - Processing node 69f79df8096243809b56d7f1: baseline-arm64-clabbe 2026-05-05 19:12:07,884 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79df8096243809b56d7f1 2026-05-05 19:12:07,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:12:07,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79df8096243809b56d7f1 HTTP/1.1" 200 None 2026-05-05 19:12:07,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:12:07,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 19:12:07,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:12:07,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79df8096243809b56d7f1 HTTP/1.1" 200 None 2026-05-05 19:12:07,935 - lava_callback - ERROR - Error processing callback for node 69f79df8096243809b56d7f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 19:12:12,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:12:12,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42976 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:12:56,850 - lava_callback - INFO - Received callback for node 69fa3cfca9d11f026cebeef4 INFO: 172.21.0.1:42990 - "POST /node/69fa3cfca9d11f026cebeef4 HTTP/1.0" 202 Accepted 2026-05-05 19:12:56,857 - lava_callback - INFO - Starting async job submit for node 69fa3cfca9d11f026cebeef4 2026-05-05 19:12:56,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:12:56,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3cfca9d11f026cebeef4 HTTP/1.1" 200 None 2026-05-05 19:12:56,939 - lava_callback - DEBUG - Processing node 69fa3cfca9d11f026cebeef4: baseline-arm 2026-05-05 19:12:57,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:12:57,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:12:57,810 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69fa3cfca9d11f026cebeef4/log.txt.gz 2026-05-05 19:12:58,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:12:58,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:12:58,324 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69fa3cfca9d11f026cebeef4/lava-logs.yaml 2026-05-05 19:12:58,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:12:58,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:12:58,456 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69fa3cfca9d11f026cebeef4/lava_callback.json.gz DEBUG: Setup failed for 69fa3cfca9d11f026cebeef4. Transitting job node result: incomplete -> fail 2026-05-05 19:12:58,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:12:58,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3cfca9d11f026cebeef4 HTTP/1.1" 200 None 2026-05-05 19:12:58,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:12:58,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 19:12:58,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:12:58,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa3cfca9d11f026cebeef4 HTTP/1.1" 200 None 2026-05-05 19:12:58,723 - lava_callback - INFO - Completed processing callback for node 69fa3cfca9d11f026cebeef4 INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:13:12,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:13:12,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59460 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:13:27,922 - lava_callback - INFO - Received callback for node 69f79e4b096243809b56d80f INFO: 172.21.0.1:59466 - "POST /node/69f79e4b096243809b56d80f HTTP/1.0" 202 Accepted 2026-05-05 19:13:27,928 - lava_callback - INFO - Starting async job submit for node 69f79e4b096243809b56d80f 2026-05-05 19:13:27,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:13:27,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79e4b096243809b56d80f HTTP/1.1" 200 None 2026-05-05 19:13:27,943 - lava_callback - DEBUG - Processing node 69f79e4b096243809b56d80f: baseline-arm64-clabbe 2026-05-05 19:13:27,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79e4b096243809b56d80f 2026-05-05 19:13:27,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:13:27,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79e4b096243809b56d80f HTTP/1.1" 200 None 2026-05-05 19:13:27,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:13:27,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 19:13:27,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:13:27,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79e4b096243809b56d80f HTTP/1.1" 200 None 2026-05-05 19:13:27,998 - lava_callback - ERROR - Error processing callback for node 69f79e4b096243809b56d80f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46308 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46314 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:16:08,036 - lava_callback - INFO - Received callback for node 69f79eeb096243809b56d86b INFO: 172.21.0.1:46324 - "POST /node/69f79eeb096243809b56d86b HTTP/1.0" 202 Accepted 2026-05-05 19:16:08,043 - lava_callback - INFO - Starting async job submit for node 69f79eeb096243809b56d86b 2026-05-05 19:16:08,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:16:08,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79eeb096243809b56d86b HTTP/1.1" 200 None 2026-05-05 19:16:08,059 - lava_callback - DEBUG - Processing node 69f79eeb096243809b56d86b: baseline-arm64-clabbe 2026-05-05 19:16:08,059 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79eeb096243809b56d86b 2026-05-05 19:16:08,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:16:08,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79eeb096243809b56d86b HTTP/1.1" 200 None 2026-05-05 19:16:08,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:16:08,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f1bf6299260e707730df5f HTTP/1.1" 200 None 2026-05-05 19:16:08,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:16:08,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79eeb096243809b56d86b HTTP/1.1" 200 None 2026-05-05 19:16:08,118 - lava_callback - ERROR - Error processing callback for node 69f79eeb096243809b56d86b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:16:33,731 - lava_callback - INFO - Received callback for node 69fa3d75a9d11f026cebef1d INFO: 172.21.0.1:33666 - "POST /node/69fa3d75a9d11f026cebef1d HTTP/1.0" 202 Accepted 2026-05-05 19:16:33,738 - lava_callback - INFO - Starting async job submit for node 69fa3d75a9d11f026cebef1d 2026-05-05 19:16:33,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:16:33,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3d75a9d11f026cebef1d HTTP/1.1" 200 None 2026-05-05 19:16:33,802 - lava_callback - DEBUG - Processing node 69fa3d75a9d11f026cebef1d: baseline-nfs-arm64 2026-05-05 19:16:35,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:16:35,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:16:35,276 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa3d75a9d11f026cebef1d/log.txt.gz 2026-05-05 19:16:35,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:16:36,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:16:36,094 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa3d75a9d11f026cebef1d/lava-logs.yaml 2026-05-05 19:16:36,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:16:36,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:16:36,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa3d75a9d11f026cebef1d/lava_callback.json.gz DEBUG: Setup failed for 69fa3d75a9d11f026cebef1d. Transitting job node result: incomplete -> fail 2026-05-05 19:16:36,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:16:36,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3d75a9d11f026cebef1d HTTP/1.1" 200 None 2026-05-05 19:16:36,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:16:36,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-05 19:16:36,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:16:36,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa3d75a9d11f026cebef1d HTTP/1.1" 200 None 2026-05-05 19:16:36,484 - lava_callback - INFO - Completed processing callback for node 69fa3d75a9d11f026cebef1d INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:16:42,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:16:42,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:17:41,438 - lava_callback - INFO - Received callback for node 69fa3dc7a9d11f026cebef44 INFO: 172.21.0.1:46630 - "POST /node/69fa3dc7a9d11f026cebef44 HTTP/1.0" 202 Accepted 2026-05-05 19:17:41,485 - lava_callback - INFO - Starting async job submit for node 69fa3dc7a9d11f026cebef44 2026-05-05 19:17:41,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:17:41,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3dc7a9d11f026cebef44 HTTP/1.1" 200 None 2026-05-05 19:17:41,532 - lava_callback - DEBUG - Processing node 69fa3dc7a9d11f026cebef44: baseline-arm-pengutronix 2026-05-05 19:17:41,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:17:41,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:17:41,751 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa3dc7a9d11f026cebef44/log.txt.gz 2026-05-05 19:17:41,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:17:41,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:17:41,971 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa3dc7a9d11f026cebef44/lava-logs.yaml 2026-05-05 19:17:41,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:17:42,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:17:42,071 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69fa3dc7a9d11f026cebef44/lava_callback.json.gz DEBUG: Setup failed for 69fa3dc7a9d11f026cebef44. Transitting job node result: incomplete -> fail 2026-05-05 19:17:42,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:17:42,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa3dc7a9d11f026cebef44 HTTP/1.1" 200 None 2026-05-05 19:17:42,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:17:42,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-05 19:17:42,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:17:42,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa3dc7a9d11f026cebef44 HTTP/1.1" 200 None 2026-05-05 19:17:42,243 - lava_callback - INFO - Completed processing callback for node 69fa3dc7a9d11f026cebef44 2026-05-05 19:17:42,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:17:42,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36874 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:18:28,150 - lava_callback - INFO - Received callback for node 69f79f7d096243809b56d8ac INFO: 172.21.0.1:36886 - "POST /node/69f79f7d096243809b56d8ac HTTP/1.0" 202 Accepted 2026-05-05 19:18:28,157 - lava_callback - INFO - Starting async job submit for node 69f79f7d096243809b56d8ac 2026-05-05 19:18:28,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:18:28,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79f7d096243809b56d8ac HTTP/1.1" 200 None 2026-05-05 19:18:28,176 - lava_callback - DEBUG - Processing node 69f79f7d096243809b56d8ac: baseline-arm-clabbe 2026-05-05 19:18:28,176 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79f7d096243809b56d8ac 2026-05-05 19:18:28,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:18:28,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79f7d096243809b56d8ac HTTP/1.1" 200 None 2026-05-05 19:18:28,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:18:28,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-05 19:18:28,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:18:28,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79f7d096243809b56d8ac HTTP/1.1" 200 None 2026-05-05 19:18:28,230 - lava_callback - ERROR - Error processing callback for node 69f79f7d096243809b56d8ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:19:08,182 - lava_callback - INFO - Received callback for node 69f79fa2096243809b56d8c0 INFO: 172.21.0.1:43744 - "POST /node/69f79fa2096243809b56d8c0 HTTP/1.0" 202 Accepted 2026-05-05 19:19:08,187 - lava_callback - INFO - Starting async job submit for node 69f79fa2096243809b56d8c0 2026-05-05 19:19:08,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:19:08,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79fa2096243809b56d8c0 HTTP/1.1" 200 None 2026-05-05 19:19:08,202 - lava_callback - DEBUG - Processing node 69f79fa2096243809b56d8c0: baseline-arm-clabbe 2026-05-05 19:19:08,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f79fa2096243809b56d8c0 2026-05-05 19:19:08,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:19:08,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f79fa2096243809b56d8c0 HTTP/1.1" 200 None 2026-05-05 19:19:08,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:19:08,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-05 19:19:08,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:19:08,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f79fa2096243809b56d8c0 HTTP/1.1" 200 None 2026-05-05 19:19:08,249 - lava_callback - ERROR - Error processing callback for node 69f79fa2096243809b56d8c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:19:54,438 - lava_callback - INFO - Received callback for node 69f9426bd09fe59064f059d9 INFO: 172.21.0.1:53350 - "POST /node/69f9426bd09fe59064f059d9 HTTP/1.0" 202 Accepted 2026-05-05 19:19:54,445 - lava_callback - INFO - Starting async job submit for node 69f9426bd09fe59064f059d9 2026-05-05 19:19:54,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:19:54,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9426bd09fe59064f059d9 HTTP/1.1" 200 None 2026-05-05 19:19:54,523 - lava_callback - DEBUG - Processing node 69f9426bd09fe59064f059d9: baseline-arm64 2026-05-05 19:19:55,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:19:55,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:19:55,225 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9426bd09fe59064f059d9/log.txt.gz 2026-05-05 19:19:55,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:19:55,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:19:55,714 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9426bd09fe59064f059d9/lava-logs.yaml 2026-05-05 19:19:55,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:19:55,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:19:55,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9426bd09fe59064f059d9/lava_callback.json.gz 2026-05-05 19:19:55,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:19:55,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9426bd09fe59064f059d9 HTTP/1.1" 200 None 2026-05-05 19:19:55,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:19:55,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 19:19:55,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:19:55,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9426bd09fe59064f059d9 HTTP/1.1" 200 None 2026-05-05 19:19:56,016 - lava_callback - INFO - Completed processing callback for node 69f9426bd09fe59064f059d9 INFO: 172.21.0.1:53352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:20:12,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:20:12,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET /node/69ef8b628305534e9723ae38%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59992 - "GET /node/693fd3a5575bc060ce14c11f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET /node/69ef8c5f8305534e9723ae83%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:21:08,293 - lava_callback - INFO - Received callback for node 69f7a014096243809b56d902 INFO: 172.21.0.1:47350 - "POST /node/69f7a014096243809b56d902 HTTP/1.0" 202 Accepted 2026-05-05 19:21:08,298 - lava_callback - INFO - Starting async job submit for node 69f7a014096243809b56d902 2026-05-05 19:21:08,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:21:08,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a014096243809b56d902 HTTP/1.1" 200 None 2026-05-05 19:21:08,314 - lava_callback - DEBUG - Processing node 69f7a014096243809b56d902: baseline-arm-clabbe 2026-05-05 19:21:08,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a014096243809b56d902 2026-05-05 19:21:08,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:21:08,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a014096243809b56d902 HTTP/1.1" 200 None 2026-05-05 19:21:08,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:21:08,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-05 19:21:08,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:21:08,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a014096243809b56d902 HTTP/1.1" 200 None 2026-05-05 19:21:08,361 - lava_callback - ERROR - Error processing callback for node 69f7a014096243809b56d902: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:21:48,245 - lava_callback - INFO - Received callback for node 69f7a039096243809b56d90b INFO: 172.21.0.1:58878 - "POST /node/69f7a039096243809b56d90b HTTP/1.0" 202 Accepted 2026-05-05 19:21:48,250 - lava_callback - INFO - Starting async job submit for node 69f7a039096243809b56d90b 2026-05-05 19:21:48,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:21:48,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a039096243809b56d90b HTTP/1.1" 200 None 2026-05-05 19:21:48,266 - lava_callback - DEBUG - Processing node 69f7a039096243809b56d90b: baseline-arm-clabbe 2026-05-05 19:21:48,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a039096243809b56d90b 2026-05-05 19:21:48,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:21:48,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a039096243809b56d90b HTTP/1.1" 200 None 2026-05-05 19:21:48,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:21:48,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-05 19:21:48,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:21:48,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a039096243809b56d90b HTTP/1.1" 200 None 2026-05-05 19:21:48,321 - lava_callback - ERROR - Error processing callback for node 69f7a039096243809b56d90b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:22:28,280 - lava_callback - INFO - Received callback for node 69f7a06c096243809b56d91e INFO: 172.21.0.1:40104 - "POST /node/69f7a06c096243809b56d91e HTTP/1.0" 202 Accepted 2026-05-05 19:22:28,285 - lava_callback - INFO - Starting async job submit for node 69f7a06c096243809b56d91e 2026-05-05 19:22:28,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:22:28,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a06c096243809b56d91e HTTP/1.1" 200 None 2026-05-05 19:22:28,300 - lava_callback - DEBUG - Processing node 69f7a06c096243809b56d91e: baseline-arm64-clabbe 2026-05-05 19:22:28,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a06c096243809b56d91e 2026-05-05 19:22:28,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:22:28,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a06c096243809b56d91e HTTP/1.1" 200 None 2026-05-05 19:22:28,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:22:28,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-05 19:22:28,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:22:28,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a06c096243809b56d91e HTTP/1.1" 200 None 2026-05-05 19:22:28,389 - lava_callback - ERROR - Error processing callback for node 69f7a06c096243809b56d91e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:25:08,580 - lava_callback - INFO - Received callback for node 69f7a109096243809b56d975 INFO: 172.21.0.1:39524 - "POST /node/69f7a109096243809b56d975 HTTP/1.0" 202 Accepted 2026-05-05 19:25:08,586 - lava_callback - INFO - Starting async job submit for node 69f7a109096243809b56d975 2026-05-05 19:25:08,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:25:08,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a109096243809b56d975 HTTP/1.1" 200 None 2026-05-05 19:25:08,604 - lava_callback - DEBUG - Processing node 69f7a109096243809b56d975: baseline-arm64-clabbe 2026-05-05 19:25:08,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a109096243809b56d975 2026-05-05 19:25:08,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:25:08,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a109096243809b56d975 HTTP/1.1" 200 None 2026-05-05 19:25:08,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:25:08,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-05 19:25:08,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:25:08,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a109096243809b56d975 HTTP/1.1" 200 None 2026-05-05 19:25:08,669 - lava_callback - ERROR - Error processing callback for node 69f7a109096243809b56d975: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33946 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:26:26,703 - lava_callback - INFO - Received callback for node 69f7a152096243809b56d990 INFO: 172.21.0.1:33952 - "POST /node/69f7a152096243809b56d990 HTTP/1.0" 202 Accepted 2026-05-05 19:26:26,709 - lava_callback - INFO - Starting async job submit for node 69f7a152096243809b56d990 2026-05-05 19:26:26,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:26:26,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a152096243809b56d990 HTTP/1.1" 200 None 2026-05-05 19:26:26,724 - lava_callback - DEBUG - Processing node 69f7a152096243809b56d990: baseline-arm64-baylibre 2026-05-05 19:26:26,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a152096243809b56d990 2026-05-05 19:26:26,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:26:26,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a152096243809b56d990 HTTP/1.1" 200 None 2026-05-05 19:26:26,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:26:26,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-05 19:26:26,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:26:26,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a152096243809b56d990 HTTP/1.1" 200 None 2026-05-05 19:26:26,785 - lava_callback - ERROR - Error processing callback for node 69f7a152096243809b56d990: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET /node/68f095c26297fa1cbf4b127b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:27:41,914 - lava_callback - INFO - Received callback for node 69f9427ad09fe59064f05a01 INFO: 172.21.0.1:38468 - "POST /node/69f9427ad09fe59064f05a01 HTTP/1.0" 202 Accepted 2026-05-05 19:27:41,921 - lava_callback - INFO - Starting async job submit for node 69f9427ad09fe59064f05a01 2026-05-05 19:27:41,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:27:41,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9427ad09fe59064f05a01 HTTP/1.1" 200 None 2026-05-05 19:27:41,961 - lava_callback - DEBUG - Processing node 69f9427ad09fe59064f05a01: baseline-nfs-arm64 2026-05-05 19:27:42,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:27:42,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:27:42,565 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f9427ad09fe59064f05a01/log.txt.gz 2026-05-05 19:27:42,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:27:43,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:27:43,014 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f9427ad09fe59064f05a01/lava-logs.yaml 2026-05-05 19:27:43,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:27:43,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:27:43,160 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f9427ad09fe59064f05a01/lava_callback.json.gz 2026-05-05 19:27:43,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:27:43,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9427ad09fe59064f05a01 HTTP/1.1" 200 None 2026-05-05 19:27:43,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:27:43,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 19:27:43,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:27:43,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9427ad09fe59064f05a01 HTTP/1.1" 200 None 2026-05-05 19:27:43,296 - lava_callback - INFO - Completed processing callback for node 69f9427ad09fe59064f05a01 INFO: 172.21.0.1:38484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38500 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:27:48,516 - lava_callback - INFO - Received callback for node 69f7a1a5096243809b56d9b6 INFO: 172.21.0.1:38516 - "POST /node/69f7a1a5096243809b56d9b6 HTTP/1.0" 202 Accepted 2026-05-05 19:27:48,522 - lava_callback - INFO - Starting async job submit for node 69f7a1a5096243809b56d9b6 2026-05-05 19:27:48,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:27:48,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a1a5096243809b56d9b6 HTTP/1.1" 200 None 2026-05-05 19:27:48,541 - lava_callback - DEBUG - Processing node 69f7a1a5096243809b56d9b6: baseline-arm64-clabbe 2026-05-05 19:27:48,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a1a5096243809b56d9b6 2026-05-05 19:27:48,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:27:48,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a1a5096243809b56d9b6 HTTP/1.1" 200 None 2026-05-05 19:27:48,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:27:48,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-05 19:27:48,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:27:48,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a1a5096243809b56d9b6 HTTP/1.1" 200 None 2026-05-05 19:27:48,598 - lava_callback - ERROR - Error processing callback for node 69f7a1a5096243809b56d9b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:28:12,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:28:12,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:29:08,599 - lava_callback - INFO - Received callback for node 69f7a1f4096243809b56d9e4 INFO: 172.21.0.1:52890 - "POST /node/69f7a1f4096243809b56d9e4 HTTP/1.0" 202 Accepted 2026-05-05 19:29:08,609 - lava_callback - INFO - Starting async job submit for node 69f7a1f4096243809b56d9e4 2026-05-05 19:29:08,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:29:08,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a1f4096243809b56d9e4 HTTP/1.1" 200 None 2026-05-05 19:29:08,630 - lava_callback - DEBUG - Processing node 69f7a1f4096243809b56d9e4: baseline-arm64-clabbe 2026-05-05 19:29:08,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a1f4096243809b56d9e4 2026-05-05 19:29:08,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:29:08,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a1f4096243809b56d9e4 HTTP/1.1" 200 None 2026-05-05 19:29:08,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:29:08,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-05 19:29:08,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:29:08,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a1f4096243809b56d9e4 HTTP/1.1" 200 None 2026-05-05 19:29:08,689 - lava_callback - ERROR - Error processing callback for node 69f7a1f4096243809b56d9e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59544 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:30:28,679 - lava_callback - INFO - Received callback for node 69f7a242096243809b56d9fd INFO: 172.21.0.1:59556 - "POST /node/69f7a242096243809b56d9fd HTTP/1.0" 202 Accepted 2026-05-05 19:30:28,685 - lava_callback - INFO - Starting async job submit for node 69f7a242096243809b56d9fd 2026-05-05 19:30:28,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:30:28,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a242096243809b56d9fd HTTP/1.1" 200 None 2026-05-05 19:30:28,701 - lava_callback - DEBUG - Processing node 69f7a242096243809b56d9fd: baseline-arm64-clabbe 2026-05-05 19:30:28,701 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a242096243809b56d9fd 2026-05-05 19:30:28,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:30:28,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a242096243809b56d9fd HTTP/1.1" 200 None 2026-05-05 19:30:28,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:30:28,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-05 19:30:28,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:30:28,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a242096243809b56d9fd HTTP/1.1" 200 None 2026-05-05 19:30:28,746 - lava_callback - ERROR - Error processing callback for node 69f7a242096243809b56d9fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42594 - "GET /node/69659ee4f8163dd6002e94c5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42602 - "GET /node/6992da8931166481c8dd46b0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47616 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:31:28,670 - lava_callback - INFO - Received callback for node 69f7a28d096243809b56da3d INFO: 172.21.0.1:47630 - "POST /node/69f7a28d096243809b56da3d HTTP/1.0" 202 Accepted 2026-05-05 19:31:28,676 - lava_callback - INFO - Starting async job submit for node 69f7a28d096243809b56da3d 2026-05-05 19:31:28,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:31:28,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a28d096243809b56da3d HTTP/1.1" 200 None 2026-05-05 19:31:28,691 - lava_callback - DEBUG - Processing node 69f7a28d096243809b56da3d: baseline-arm64-clabbe 2026-05-05 19:31:28,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a28d096243809b56da3d 2026-05-05 19:31:28,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:31:28,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a28d096243809b56da3d HTTP/1.1" 200 None 2026-05-05 19:31:28,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:31:28,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-05 19:31:28,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:31:28,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a28d096243809b56da3d HTTP/1.1" 200 None 2026-05-05 19:31:28,736 - lava_callback - ERROR - Error processing callback for node 69f7a28d096243809b56da3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46420 - "GET /node/6992da7931166481c8dd462d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46428 - "GET /node/6992de0131166481c8dd5613%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60762 - "GET /node/693e7d763c8f1be6d3cf158c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60766 - "GET /node/693e79f73c8f1be6d3cf07ac%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-05 19:32:07,469 - lava_callback - INFO - Received callback for node 69f998c4d09fe59064f07a36 INFO: 172.21.0.1:60782 - "POST /node/69f998c4d09fe59064f07a36 HTTP/1.0" 202 Accepted 2026-05-05 19:32:07,476 - lava_callback - INFO - Starting async job submit for node 69f998c4d09fe59064f07a36 2026-05-05 19:32:07,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:07,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f998c4d09fe59064f07a36 HTTP/1.1" 200 None 2026-05-05 19:32:07,518 - lava_callback - DEBUG - Processing node 69f998c4d09fe59064f07a36: baseline-nfs-arm64 2026-05-05 19:32:08,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:32:08,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:32:08,149 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f998c4d09fe59064f07a36/log.txt.gz 2026-05-05 19:32:08,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:32:08,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:32:08,691 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f998c4d09fe59064f07a36/lava-logs.yaml 2026-05-05 19:32:08,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:32:08,787 - lava_callback - INFO - Received callback for node 69f9986bd09fe59064f07a0c INFO: 172.21.0.1:60794 - "POST /node/69f9986bd09fe59064f07a0c HTTP/1.0" 202 Accepted 2026-05-05 19:32:08,797 - lava_callback - INFO - Starting async job submit for node 69f9986bd09fe59064f07a0c 2026-05-05 19:32:08,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:08,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:32:08,852 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f998c4d09fe59064f07a36/lava_callback.json.gz 2026-05-05 19:32:08,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9986bd09fe59064f07a0c HTTP/1.1" 200 None 2026-05-05 19:32:08,888 - lava_callback - DEBUG - Processing node 69f9986bd09fe59064f07a0c: baseline-arm64 2026-05-05 19:32:08,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:08,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f998c4d09fe59064f07a36 HTTP/1.1" 200 None 2026-05-05 19:32:09,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:09,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 19:32:09,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:09,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f998c4d09fe59064f07a36 HTTP/1.1" 200 None 2026-05-05 19:32:09,307 - lava_callback - INFO - Completed processing callback for node 69f998c4d09fe59064f07a36 2026-05-05 19:32:09,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:32:09,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:32:09,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9986bd09fe59064f07a0c/log.txt.gz 2026-05-05 19:32:09,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:32:10,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:32:10,024 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9986bd09fe59064f07a0c/lava-logs.yaml 2026-05-05 19:32:10,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:32:10,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:32:10,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9986bd09fe59064f07a0c/lava_callback.json.gz 2026-05-05 19:32:10,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:10,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9986bd09fe59064f07a0c HTTP/1.1" 200 None 2026-05-05 19:32:10,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:10,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 19:32:10,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:10,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9986bd09fe59064f07a0c HTTP/1.1" 200 None 2026-05-05 19:32:10,297 - lava_callback - INFO - Completed processing callback for node 69f9986bd09fe59064f07a0c 2026-05-05 19:32:12,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:12,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:32:48,713 - lava_callback - INFO - Received callback for node 69f7a2dd096243809b56da57 INFO: 172.21.0.1:36704 - "POST /node/69f7a2dd096243809b56da57 HTTP/1.0" 202 Accepted 2026-05-05 19:32:48,718 - lava_callback - INFO - Starting async job submit for node 69f7a2dd096243809b56da57 2026-05-05 19:32:48,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:48,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a2dd096243809b56da57 HTTP/1.1" 200 None 2026-05-05 19:32:48,739 - lava_callback - DEBUG - Processing node 69f7a2dd096243809b56da57: baseline-arm64-clabbe 2026-05-05 19:32:48,739 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a2dd096243809b56da57 2026-05-05 19:32:48,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:48,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a2dd096243809b56da57 HTTP/1.1" 200 None 2026-05-05 19:32:48,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:48,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-05 19:32:48,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:32:48,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a2dd096243809b56da57 HTTP/1.1" 200 None 2026-05-05 19:32:48,796 - lava_callback - ERROR - Error processing callback for node 69f7a2dd096243809b56da57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:34:08,773 - lava_callback - INFO - Received callback for node 69f7a32d096243809b56da81 INFO: 172.21.0.1:35654 - "POST /node/69f7a32d096243809b56da81 HTTP/1.0" 202 Accepted 2026-05-05 19:34:08,782 - lava_callback - INFO - Starting async job submit for node 69f7a32d096243809b56da81 2026-05-05 19:34:08,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:34:08,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a32d096243809b56da81 HTTP/1.1" 200 None 2026-05-05 19:34:08,800 - lava_callback - DEBUG - Processing node 69f7a32d096243809b56da81: baseline-arm64-clabbe 2026-05-05 19:34:08,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a32d096243809b56da81 2026-05-05 19:34:08,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:34:08,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a32d096243809b56da81 HTTP/1.1" 200 None 2026-05-05 19:34:08,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:34:08,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-05 19:34:08,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:34:08,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a32d096243809b56da81 HTTP/1.1" 200 None 2026-05-05 19:34:08,849 - lava_callback - ERROR - Error processing callback for node 69f7a32d096243809b56da81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET /node/6992da8331166481c8dd46a6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:35:28,895 - lava_callback - INFO - Received callback for node 69f7a37c096243809b56daaf INFO: 172.21.0.1:35594 - "POST /node/69f7a37c096243809b56daaf HTTP/1.0" 202 Accepted 2026-05-05 19:35:28,901 - lava_callback - INFO - Starting async job submit for node 69f7a37c096243809b56daaf 2026-05-05 19:35:28,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:35:28,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a37c096243809b56daaf HTTP/1.1" 200 None 2026-05-05 19:35:28,916 - lava_callback - DEBUG - Processing node 69f7a37c096243809b56daaf: baseline-arm64-clabbe 2026-05-05 19:35:28,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a37c096243809b56daaf 2026-05-05 19:35:28,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:35:28,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a37c096243809b56daaf HTTP/1.1" 200 None 2026-05-05 19:35:28,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:35:28,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-05 19:35:28,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:35:28,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a37c096243809b56daaf HTTP/1.1" 200 None 2026-05-05 19:35:28,960 - lava_callback - ERROR - Error processing callback for node 69f7a37c096243809b56daaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:36:48,902 - lava_callback - INFO - Received callback for node 69f7a3ca096243809b56dad1 INFO: 172.21.0.1:39388 - "POST /node/69f7a3ca096243809b56dad1 HTTP/1.0" 202 Accepted 2026-05-05 19:36:48,907 - lava_callback - INFO - Starting async job submit for node 69f7a3ca096243809b56dad1 2026-05-05 19:36:48,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:36:48,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a3ca096243809b56dad1 HTTP/1.1" 200 None 2026-05-05 19:36:48,922 - lava_callback - DEBUG - Processing node 69f7a3ca096243809b56dad1: baseline-arm64-clabbe 2026-05-05 19:36:48,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a3ca096243809b56dad1 2026-05-05 19:36:48,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:36:48,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a3ca096243809b56dad1 HTTP/1.1" 200 None 2026-05-05 19:36:48,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:36:48,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-05 19:36:48,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:36:48,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a3ca096243809b56dad1 HTTP/1.1" 200 None 2026-05-05 19:36:48,977 - lava_callback - ERROR - Error processing callback for node 69f7a3ca096243809b56dad1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33014 - "GET /node/68f088d56297fa1cbf4b0016%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56024 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:38:08,938 - lava_callback - INFO - Received callback for node 69f7a417096243809b56db00 INFO: 172.21.0.1:56032 - "POST /node/69f7a417096243809b56db00 HTTP/1.0" 202 Accepted 2026-05-05 19:38:08,946 - lava_callback - INFO - Starting async job submit for node 69f7a417096243809b56db00 2026-05-05 19:38:08,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:38:08,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a417096243809b56db00 HTTP/1.1" 200 None 2026-05-05 19:38:08,965 - lava_callback - DEBUG - Processing node 69f7a417096243809b56db00: baseline-arm64-clabbe 2026-05-05 19:38:08,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a417096243809b56db00 2026-05-05 19:38:08,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:38:08,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a417096243809b56db00 HTTP/1.1" 200 None 2026-05-05 19:38:08,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:38:09,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-05 19:38:09,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:38:09,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a417096243809b56db00 HTTP/1.1" 200 None 2026-05-05 19:38:09,027 - lava_callback - ERROR - Error processing callback for node 69f7a417096243809b56db00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:39:29,044 - lava_callback - INFO - Received callback for node 69f7a466096243809b56db23 INFO: 172.21.0.1:45848 - "POST /node/69f7a466096243809b56db23 HTTP/1.0" 202 Accepted 2026-05-05 19:39:29,049 - lava_callback - INFO - Starting async job submit for node 69f7a466096243809b56db23 2026-05-05 19:39:29,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:39:29,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a466096243809b56db23 HTTP/1.1" 200 None 2026-05-05 19:39:29,065 - lava_callback - DEBUG - Processing node 69f7a466096243809b56db23: baseline-arm64-clabbe 2026-05-05 19:39:29,065 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a466096243809b56db23 2026-05-05 19:39:29,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:39:29,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a466096243809b56db23 HTTP/1.1" 200 None 2026-05-05 19:39:29,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:39:29,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-05 19:39:29,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:39:29,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a466096243809b56db23 HTTP/1.1" 200 None 2026-05-05 19:39:29,122 - lava_callback - ERROR - Error processing callback for node 69f7a466096243809b56db23: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45854 - "GET /node/69e512ca9a34686dd62ebb1e%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-05 19:39:29,522 - lava_callback - INFO - Received callback for node 69f9b89b5b7e826894bd3aea INFO: 172.21.0.1:45858 - "POST /node/69f9b89b5b7e826894bd3aea HTTP/1.0" 202 Accepted 2026-05-05 19:39:29,529 - lava_callback - INFO - Starting async job submit for node 69f9b89b5b7e826894bd3aea 2026-05-05 19:39:29,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:39:29,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9b89b5b7e826894bd3aea HTTP/1.1" 200 None 2026-05-05 19:39:29,573 - lava_callback - DEBUG - Processing node 69f9b89b5b7e826894bd3aea: baseline-arm64 2026-05-05 19:39:30,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:39:30,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:39:30,207 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9b89b5b7e826894bd3aea/log.txt.gz 2026-05-05 19:39:30,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:39:30,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:39:30,673 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9b89b5b7e826894bd3aea/lava-logs.yaml 2026-05-05 19:39:30,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:39:30,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:39:30,823 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9b89b5b7e826894bd3aea/lava_callback.json.gz 2026-05-05 19:39:30,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:39:30,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9b89b5b7e826894bd3aea HTTP/1.1" 200 None 2026-05-05 19:39:30,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:39:30,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-05 19:39:30,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:39:30,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9b89b5b7e826894bd3aea HTTP/1.1" 200 None 2026-05-05 19:39:30,986 - lava_callback - INFO - Completed processing callback for node 69f9b89b5b7e826894bd3aea INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:39:42,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:39:42,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52048 - "GET /node/68ed9a7fc7da4797da292d5f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39404 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:40:49,069 - lava_callback - INFO - Received callback for node 69f7a4b1096243809b56db5b INFO: 172.21.0.1:39410 - "POST /node/69f7a4b1096243809b56db5b HTTP/1.0" 202 Accepted 2026-05-05 19:40:49,074 - lava_callback - INFO - Starting async job submit for node 69f7a4b1096243809b56db5b 2026-05-05 19:40:49,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:40:49,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a4b1096243809b56db5b HTTP/1.1" 200 None 2026-05-05 19:40:49,096 - lava_callback - DEBUG - Processing node 69f7a4b1096243809b56db5b: baseline-arm64-clabbe 2026-05-05 19:40:49,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a4b1096243809b56db5b 2026-05-05 19:40:49,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:40:49,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a4b1096243809b56db5b HTTP/1.1" 200 None 2026-05-05 19:40:49,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:40:49,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-05 19:40:49,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:40:49,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a4b1096243809b56db5b HTTP/1.1" 200 None 2026-05-05 19:40:49,142 - lava_callback - ERROR - Error processing callback for node 69f7a4b1096243809b56db5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:42:09,053 - lava_callback - INFO - Received callback for node 69f7a4ff096243809b56db80 INFO: 172.21.0.1:43300 - "POST /node/69f7a4ff096243809b56db80 HTTP/1.0" 202 Accepted 2026-05-05 19:42:09,058 - lava_callback - INFO - Starting async job submit for node 69f7a4ff096243809b56db80 2026-05-05 19:42:09,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:42:09,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a4ff096243809b56db80 HTTP/1.1" 200 None 2026-05-05 19:42:09,074 - lava_callback - DEBUG - Processing node 69f7a4ff096243809b56db80: baseline-arm64-clabbe 2026-05-05 19:42:09,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a4ff096243809b56db80 2026-05-05 19:42:09,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:42:09,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a4ff096243809b56db80 HTTP/1.1" 200 None 2026-05-05 19:42:09,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:42:09,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-05 19:42:09,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:42:09,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a4ff096243809b56db80 HTTP/1.1" 200 None 2026-05-05 19:42:09,119 - lava_callback - ERROR - Error processing callback for node 69f7a4ff096243809b56db80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59136 - "GET /node/6992fda231166481c8ddf03d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59140 - "GET /node/6993513f523507f3806a6eec%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:43:29,067 - lava_callback - INFO - Received callback for node 69f7a54d096243809b56dba4 INFO: 172.21.0.1:38912 - "POST /node/69f7a54d096243809b56dba4 HTTP/1.0" 202 Accepted 2026-05-05 19:43:29,073 - lava_callback - INFO - Starting async job submit for node 69f7a54d096243809b56dba4 2026-05-05 19:43:29,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:43:29,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a54d096243809b56dba4 HTTP/1.1" 200 None 2026-05-05 19:43:29,098 - lava_callback - DEBUG - Processing node 69f7a54d096243809b56dba4: baseline-arm64-clabbe 2026-05-05 19:43:29,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a54d096243809b56dba4 2026-05-05 19:43:29,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:43:29,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a54d096243809b56dba4 HTTP/1.1" 200 None 2026-05-05 19:43:29,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:43:29,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-05 19:43:29,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:43:29,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a54d096243809b56dba4 HTTP/1.1" 200 None 2026-05-05 19:43:29,147 - lava_callback - ERROR - Error processing callback for node 69f7a54d096243809b56dba4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35904 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:44:37,511 - lava_callback - INFO - Received callback for node 69f9b8aa5b7e826894bd3b16 INFO: 172.21.0.1:35906 - "POST /node/69f9b8aa5b7e826894bd3b16 HTTP/1.0" 202 Accepted 2026-05-05 19:44:37,518 - lava_callback - INFO - Starting async job submit for node 69f9b8aa5b7e826894bd3b16 2026-05-05 19:44:37,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:44:37,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9b8aa5b7e826894bd3b16 HTTP/1.1" 200 None 2026-05-05 19:44:37,558 - lava_callback - DEBUG - Processing node 69f9b8aa5b7e826894bd3b16: baseline-nfs-arm64 2026-05-05 19:44:38,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:44:38,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:44:38,218 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f9b8aa5b7e826894bd3b16/log.txt.gz 2026-05-05 19:44:38,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:44:38,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:44:38,741 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f9b8aa5b7e826894bd3b16/lava-logs.yaml 2026-05-05 19:44:38,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:44:38,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:44:38,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f9b8aa5b7e826894bd3b16/lava_callback.json.gz 2026-05-05 19:44:38,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:44:38,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9b8aa5b7e826894bd3b16 HTTP/1.1" 200 None 2026-05-05 19:44:38,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:44:39,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-05 19:44:39,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:44:39,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9b8aa5b7e826894bd3b16 HTTP/1.1" 200 None 2026-05-05 19:44:39,074 - lava_callback - INFO - Completed processing callback for node 69f9b8aa5b7e826894bd3b16 2026-05-05 19:44:42,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:44:42,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:44:49,147 - lava_callback - INFO - Received callback for node 69f7a59e096243809b56dbd2 INFO: 172.21.0.1:55268 - "POST /node/69f7a59e096243809b56dbd2 HTTP/1.0" 202 Accepted 2026-05-05 19:44:49,153 - lava_callback - INFO - Starting async job submit for node 69f7a59e096243809b56dbd2 2026-05-05 19:44:49,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:44:49,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a59e096243809b56dbd2 HTTP/1.1" 200 None 2026-05-05 19:44:49,182 - lava_callback - DEBUG - Processing node 69f7a59e096243809b56dbd2: baseline-arm64-clabbe 2026-05-05 19:44:49,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a59e096243809b56dbd2 2026-05-05 19:44:49,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:44:49,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a59e096243809b56dbd2 HTTP/1.1" 200 None 2026-05-05 19:44:49,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:44:49,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-05 19:44:49,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:44:49,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a59e096243809b56dbd2 HTTP/1.1" 200 None 2026-05-05 19:44:49,239 - lava_callback - ERROR - Error processing callback for node 69f7a59e096243809b56dbd2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET /node/69943c7b5ae459b9df3d6066%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:45:17,528 - lava_callback - INFO - Received callback for node 69f9edfc5b7e826894bd4a4e INFO: 172.21.0.1:44736 - "POST /node/69f9edfc5b7e826894bd4a4e HTTP/1.0" 202 Accepted 2026-05-05 19:45:17,535 - lava_callback - INFO - Starting async job submit for node 69f9edfc5b7e826894bd4a4e 2026-05-05 19:45:17,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:45:17,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9edfc5b7e826894bd4a4e HTTP/1.1" 200 None 2026-05-05 19:45:17,584 - lava_callback - DEBUG - Processing node 69f9edfc5b7e826894bd4a4e: baseline-arm64 2026-05-05 19:45:18,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:45:18,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:45:18,221 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9edfc5b7e826894bd4a4e/log.txt.gz 2026-05-05 19:45:18,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:45:18,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:45:18,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9edfc5b7e826894bd4a4e/lava-logs.yaml 2026-05-05 19:45:18,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:45:18,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:45:18,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f9edfc5b7e826894bd4a4e/lava_callback.json.gz 2026-05-05 19:45:18,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:45:18,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9edfc5b7e826894bd4a4e HTTP/1.1" 200 None 2026-05-05 19:45:18,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:45:18,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 19:45:18,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:45:18,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9edfc5b7e826894bd4a4e HTTP/1.1" 200 None 2026-05-05 19:45:18,986 - lava_callback - INFO - Completed processing callback for node 69f9edfc5b7e826894bd4a4e INFO: 172.21.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:45:41,624 - lava_callback - INFO - Received callback for node 69f9eea25b7e826894bd4a8c INFO: 172.21.0.1:48134 - "POST /node/69f9eea25b7e826894bd4a8c HTTP/1.0" 202 Accepted 2026-05-05 19:45:41,631 - lava_callback - INFO - Starting async job submit for node 69f9eea25b7e826894bd4a8c 2026-05-05 19:45:41,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:45:41,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9eea25b7e826894bd4a8c HTTP/1.1" 200 None 2026-05-05 19:45:41,672 - lava_callback - DEBUG - Processing node 69f9eea25b7e826894bd4a8c: baseline-nfs-arm64 2026-05-05 19:45:42,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:45:42,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:45:42,360 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f9eea25b7e826894bd4a8c/log.txt.gz 2026-05-05 19:45:42,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:45:42,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:45:42,769 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f9eea25b7e826894bd4a8c/lava-logs.yaml 2026-05-05 19:45:42,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 19:45:42,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:45:42,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-05 19:45:42,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 19:45:42,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f9eea25b7e826894bd4a8c/lava_callback.json.gz 2026-05-05 19:45:42,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:45:42,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9eea25b7e826894bd4a8c HTTP/1.1" 200 None 2026-05-05 19:45:42,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:45:42,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 19:45:42,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:45:42,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f9eea25b7e826894bd4a8c HTTP/1.1" 200 None 2026-05-05 19:45:43,030 - lava_callback - INFO - Completed processing callback for node 69f9eea25b7e826894bd4a8c INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51984 - "GET /node/699352d3523507f3806a7c28%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56590 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:46:09,261 - lava_callback - INFO - Received callback for node 69f7a5eb096243809b56dbef INFO: 172.21.0.1:56604 - "POST /node/69f7a5eb096243809b56dbef HTTP/1.0" 202 Accepted 2026-05-05 19:46:09,268 - lava_callback - INFO - Starting async job submit for node 69f7a5eb096243809b56dbef 2026-05-05 19:46:09,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:46:09,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a5eb096243809b56dbef HTTP/1.1" 200 None 2026-05-05 19:46:09,284 - lava_callback - DEBUG - Processing node 69f7a5eb096243809b56dbef: baseline-arm64-clabbe 2026-05-05 19:46:09,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a5eb096243809b56dbef 2026-05-05 19:46:09,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:46:09,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a5eb096243809b56dbef HTTP/1.1" 200 None 2026-05-05 19:46:09,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:46:09,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6943a1f903fec0b0dbc8b HTTP/1.1" 200 None 2026-05-05 19:46:09,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:46:09,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a5eb096243809b56dbef HTTP/1.1" 200 None 2026-05-05 19:46:09,337 - lava_callback - ERROR - Error processing callback for node 69f7a5eb096243809b56dbef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 19:46:12,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:46:12,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40890 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:47:09,253 - lava_callback - INFO - Received callback for node 69f7a63a096243809b56dc18 INFO: 172.21.0.1:40892 - "POST /node/69f7a63a096243809b56dc18 HTTP/1.0" 202 Accepted 2026-05-05 19:47:09,259 - lava_callback - INFO - Starting async job submit for node 69f7a63a096243809b56dc18 2026-05-05 19:47:09,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:47:09,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a63a096243809b56dc18 HTTP/1.1" 200 None 2026-05-05 19:47:09,275 - lava_callback - DEBUG - Processing node 69f7a63a096243809b56dc18: baseline-arm64-clabbe 2026-05-05 19:47:09,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a63a096243809b56dc18 2026-05-05 19:47:09,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:47:09,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a63a096243809b56dc18 HTTP/1.1" 200 None 2026-05-05 19:47:09,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:47:09,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-05 19:47:09,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:47:09,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a63a096243809b56dc18 HTTP/1.1" 200 None 2026-05-05 19:47:09,328 - lava_callback - ERROR - Error processing callback for node 69f7a63a096243809b56dc18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60184 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:48:29,378 - lava_callback - INFO - Received callback for node 69f7a689096243809b56dc45 INFO: 172.21.0.1:60198 - "POST /node/69f7a689096243809b56dc45 HTTP/1.0" 202 Accepted 2026-05-05 19:48:29,384 - lava_callback - INFO - Starting async job submit for node 69f7a689096243809b56dc45 2026-05-05 19:48:29,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:48:29,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a689096243809b56dc45 HTTP/1.1" 200 None 2026-05-05 19:48:29,399 - lava_callback - DEBUG - Processing node 69f7a689096243809b56dc45: baseline-arm64-clabbe 2026-05-05 19:48:29,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a689096243809b56dc45 2026-05-05 19:48:29,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:48:29,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a689096243809b56dc45 HTTP/1.1" 200 None 2026-05-05 19:48:29,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:48:29,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-05 19:48:29,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:48:29,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a689096243809b56dc45 HTTP/1.1" 200 None 2026-05-05 19:48:29,455 - lava_callback - ERROR - Error processing callback for node 69f7a689096243809b56dc45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:49:49,463 - lava_callback - INFO - Received callback for node 69f7a6d7096243809b56dc61 INFO: 172.21.0.1:37508 - "POST /node/69f7a6d7096243809b56dc61 HTTP/1.0" 202 Accepted 2026-05-05 19:49:49,469 - lava_callback - INFO - Starting async job submit for node 69f7a6d7096243809b56dc61 2026-05-05 19:49:49,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:49:49,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a6d7096243809b56dc61 HTTP/1.1" 200 None 2026-05-05 19:49:49,485 - lava_callback - DEBUG - Processing node 69f7a6d7096243809b56dc61: baseline-arm64-clabbe 2026-05-05 19:49:49,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a6d7096243809b56dc61 2026-05-05 19:49:49,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:49:49,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a6d7096243809b56dc61 HTTP/1.1" 200 None 2026-05-05 19:49:49,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:49:49,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-05 19:49:49,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:49:49,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a6d7096243809b56dc61 HTTP/1.1" 200 None 2026-05-05 19:49:49,542 - lava_callback - ERROR - Error processing callback for node 69f7a6d7096243809b56dc61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:51:09,544 - lava_callback - INFO - Received callback for node 69f7a723096243809b56dc8b INFO: 172.21.0.1:38372 - "POST /node/69f7a723096243809b56dc8b HTTP/1.0" 202 Accepted 2026-05-05 19:51:09,550 - lava_callback - INFO - Starting async job submit for node 69f7a723096243809b56dc8b 2026-05-05 19:51:09,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:51:09,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a723096243809b56dc8b HTTP/1.1" 200 None 2026-05-05 19:51:09,566 - lava_callback - DEBUG - Processing node 69f7a723096243809b56dc8b: baseline-arm64-clabbe 2026-05-05 19:51:09,566 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a723096243809b56dc8b 2026-05-05 19:51:09,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:51:09,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a723096243809b56dc8b HTTP/1.1" 200 None 2026-05-05 19:51:09,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:51:09,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-05 19:51:09,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:51:09,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a723096243809b56dc8b HTTP/1.1" 200 None 2026-05-05 19:51:09,622 - lava_callback - ERROR - Error processing callback for node 69f7a723096243809b56dc8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:52:29,546 - lava_callback - INFO - Received callback for node 69f7a770096243809b56dca9 INFO: 172.21.0.1:46194 - "POST /node/69f7a770096243809b56dca9 HTTP/1.0" 202 Accepted 2026-05-05 19:52:29,552 - lava_callback - INFO - Starting async job submit for node 69f7a770096243809b56dca9 2026-05-05 19:52:29,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:52:29,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a770096243809b56dca9 HTTP/1.1" 200 None 2026-05-05 19:52:29,572 - lava_callback - DEBUG - Processing node 69f7a770096243809b56dca9: baseline-arm64-clabbe 2026-05-05 19:52:29,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a770096243809b56dca9 2026-05-05 19:52:29,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:52:29,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a770096243809b56dca9 HTTP/1.1" 200 None 2026-05-05 19:52:29,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:52:29,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-05 19:52:29,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:52:29,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a770096243809b56dca9 HTTP/1.1" 200 None 2026-05-05 19:52:29,631 - lava_callback - ERROR - Error processing callback for node 69f7a770096243809b56dca9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:53:49,630 - lava_callback - INFO - Received callback for node 69f7a7bc096243809b56dcd3 INFO: 172.21.0.1:35544 - "POST /node/69f7a7bc096243809b56dcd3 HTTP/1.0" 202 Accepted 2026-05-05 19:53:49,637 - lava_callback - INFO - Starting async job submit for node 69f7a7bc096243809b56dcd3 2026-05-05 19:53:49,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:53:49,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a7bc096243809b56dcd3 HTTP/1.1" 200 None 2026-05-05 19:53:49,655 - lava_callback - DEBUG - Processing node 69f7a7bc096243809b56dcd3: baseline-arm64-clabbe 2026-05-05 19:53:49,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a7bc096243809b56dcd3 2026-05-05 19:53:49,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:53:49,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a7bc096243809b56dcd3 HTTP/1.1" 200 None 2026-05-05 19:53:49,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:53:49,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-05 19:53:49,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:53:49,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a7bc096243809b56dcd3 HTTP/1.1" 200 None 2026-05-05 19:53:49,708 - lava_callback - ERROR - Error processing callback for node 69f7a7bc096243809b56dcd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37544 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:55:09,627 - lava_callback - INFO - Received callback for node 69f7a807096243809b56dcf4 INFO: 172.21.0.1:37556 - "POST /node/69f7a807096243809b56dcf4 HTTP/1.0" 202 Accepted 2026-05-05 19:55:09,632 - lava_callback - INFO - Starting async job submit for node 69f7a807096243809b56dcf4 2026-05-05 19:55:09,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:55:09,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a807096243809b56dcf4 HTTP/1.1" 200 None 2026-05-05 19:55:09,648 - lava_callback - DEBUG - Processing node 69f7a807096243809b56dcf4: baseline-arm64-clabbe 2026-05-05 19:55:09,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a807096243809b56dcf4 2026-05-05 19:55:09,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:55:09,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a807096243809b56dcf4 HTTP/1.1" 200 None 2026-05-05 19:55:09,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:55:09,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-05 19:55:09,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:55:09,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a807096243809b56dcf4 HTTP/1.1" 200 None 2026-05-05 19:55:09,697 - lava_callback - ERROR - Error processing callback for node 69f7a807096243809b56dcf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:56:09,665 - lava_callback - INFO - Received callback for node 69f7a853096243809b56dd1a INFO: 172.21.0.1:43494 - "POST /node/69f7a853096243809b56dd1a HTTP/1.0" 202 Accepted 2026-05-05 19:56:09,674 - lava_callback - INFO - Starting async job submit for node 69f7a853096243809b56dd1a 2026-05-05 19:56:09,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:56:09,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a853096243809b56dd1a HTTP/1.1" 200 None 2026-05-05 19:56:09,697 - lava_callback - DEBUG - Processing node 69f7a853096243809b56dd1a: baseline-arm64-clabbe 2026-05-05 19:56:09,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a853096243809b56dd1a 2026-05-05 19:56:09,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:56:09,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a853096243809b56dd1a HTTP/1.1" 200 None 2026-05-05 19:56:09,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:56:09,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-05 19:56:09,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:56:09,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a853096243809b56dd1a HTTP/1.1" 200 None 2026-05-05 19:56:09,756 - lava_callback - ERROR - Error processing callback for node 69f7a853096243809b56dd1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK 2026-05-05 19:58:49,743 - lava_callback - INFO - Received callback for node 69f7a8e4096243809b56dd62 INFO: 172.21.0.1:39258 - "POST /node/69f7a8e4096243809b56dd62 HTTP/1.0" 202 Accepted 2026-05-05 19:58:49,749 - lava_callback - INFO - Starting async job submit for node 69f7a8e4096243809b56dd62 2026-05-05 19:58:49,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:58:49,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a8e4096243809b56dd62 HTTP/1.1" 200 None 2026-05-05 19:58:49,765 - lava_callback - DEBUG - Processing node 69f7a8e4096243809b56dd62: baseline-arm64-clabbe 2026-05-05 19:58:49,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a8e4096243809b56dd62 2026-05-05 19:58:49,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:58:49,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a8e4096243809b56dd62 HTTP/1.1" 200 None 2026-05-05 19:58:49,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:58:49,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-05 19:58:49,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 19:58:49,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a8e4096243809b56dd62 HTTP/1.1" 200 None 2026-05-05 19:58:49,815 - lava_callback - ERROR - Error processing callback for node 69f7a8e4096243809b56dd62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39374 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:02:09,975 - lava_callback - INFO - Received callback for node 69f7a9b8096243809b56ddc5 INFO: 172.21.0.1:33056 - "POST /node/69f7a9b8096243809b56ddc5 HTTP/1.0" 202 Accepted 2026-05-05 20:02:09,981 - lava_callback - INFO - Starting async job submit for node 69f7a9b8096243809b56ddc5 2026-05-05 20:02:09,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:02:09,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a9b8096243809b56ddc5 HTTP/1.1" 200 None 2026-05-05 20:02:09,999 - lava_callback - DEBUG - Processing node 69f7a9b8096243809b56ddc5: baseline-arm64-clabbe 2026-05-05 20:02:09,999 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7a9b8096243809b56ddc5 2026-05-05 20:02:10,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:02:10,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7a9b8096243809b56ddc5 HTTP/1.1" 200 None 2026-05-05 20:02:10,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:02:10,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5dc08305534e972331e6 HTTP/1.1" 200 None 2026-05-05 20:02:10,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:02:10,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7a9b8096243809b56ddc5 HTTP/1.1" 200 None 2026-05-05 20:02:10,050 - lava_callback - ERROR - Error processing callback for node 69f7a9b8096243809b56ddc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET /node/69f5b80f8cb8354ccaa5f02f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53316 - "GET /node/69876d08e31b58f834f19c60%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:03:29,952 - lava_callback - INFO - Received callback for node 69f7aa05096243809b56dde6 INFO: 172.21.0.1:52528 - "POST /node/69f7aa05096243809b56dde6 HTTP/1.0" 202 Accepted 2026-05-05 20:03:29,958 - lava_callback - INFO - Starting async job submit for node 69f7aa05096243809b56dde6 2026-05-05 20:03:29,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:03:29,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7aa05096243809b56dde6 HTTP/1.1" 200 None 2026-05-05 20:03:29,973 - lava_callback - DEBUG - Processing node 69f7aa05096243809b56dde6: baseline-arm64-clabbe 2026-05-05 20:03:29,973 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7aa05096243809b56dde6 2026-05-05 20:03:29,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:03:29,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7aa05096243809b56dde6 HTTP/1.1" 200 None 2026-05-05 20:03:29,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:03:30,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e108305534e97233243 HTTP/1.1" 200 None 2026-05-05 20:03:30,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:03:30,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7aa05096243809b56dde6 HTTP/1.1" 200 None 2026-05-05 20:03:30,021 - lava_callback - ERROR - Error processing callback for node 69f7aa05096243809b56dde6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET /node/69e72cb1fbd3a2737e5418fb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51888 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:04:50,018 - lava_callback - INFO - Received callback for node 69f7aa51096243809b56de13 INFO: 172.21.0.1:58572 - "POST /node/69f7aa51096243809b56de13 HTTP/1.0" 202 Accepted 2026-05-05 20:04:50,027 - lava_callback - INFO - Starting async job submit for node 69f7aa51096243809b56de13 2026-05-05 20:04:50,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:04:50,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7aa51096243809b56de13 HTTP/1.1" 200 None 2026-05-05 20:04:50,056 - lava_callback - DEBUG - Processing node 69f7aa51096243809b56de13: baseline-arm64-clabbe 2026-05-05 20:04:50,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7aa51096243809b56de13 2026-05-05 20:04:50,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:04:50,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7aa51096243809b56de13 HTTP/1.1" 200 None 2026-05-05 20:04:50,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:04:50,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e668305534e972332b2 HTTP/1.1" 200 None 2026-05-05 20:04:50,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:04:50,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7aa51096243809b56de13 HTTP/1.1" 200 None 2026-05-05 20:04:50,113 - lava_callback - ERROR - Error processing callback for node 69f7aa51096243809b56de13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:06:10,039 - lava_callback - INFO - Received callback for node 69f7aa9c096243809b56de38 INFO: 172.21.0.1:38456 - "POST /node/69f7aa9c096243809b56de38 HTTP/1.0" 202 Accepted 2026-05-05 20:06:10,045 - lava_callback - INFO - Starting async job submit for node 69f7aa9c096243809b56de38 2026-05-05 20:06:10,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:06:10,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7aa9c096243809b56de38 HTTP/1.1" 200 None 2026-05-05 20:06:10,061 - lava_callback - DEBUG - Processing node 69f7aa9c096243809b56de38: baseline-arm64-clabbe 2026-05-05 20:06:10,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7aa9c096243809b56de38 2026-05-05 20:06:10,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:06:10,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7aa9c096243809b56de38 HTTP/1.1" 200 None 2026-05-05 20:06:10,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:06:10,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5eb98305534e97233321 HTTP/1.1" 200 None 2026-05-05 20:06:10,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:06:10,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7aa9c096243809b56de38 HTTP/1.1" 200 None 2026-05-05 20:06:10,110 - lava_callback - ERROR - Error processing callback for node 69f7aa9c096243809b56de38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET /node/69f26593f5ce4820821f16eb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60534 - "GET /node/69656a3ecf87553b28022e24%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52392 - "GET /node/6992efc031166481c8dda631%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40208 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:08:10,110 - lava_callback - INFO - Received callback for node 69f7ab24096243809b56de82 INFO: 172.21.0.1:42452 - "POST /node/69f7ab24096243809b56de82 HTTP/1.0" 202 Accepted 2026-05-05 20:08:10,115 - lava_callback - INFO - Starting async job submit for node 69f7ab24096243809b56de82 2026-05-05 20:08:10,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:08:10,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ab24096243809b56de82 HTTP/1.1" 200 None 2026-05-05 20:08:10,138 - lava_callback - DEBUG - Processing node 69f7ab24096243809b56de82: baseline-arm-clabbe 2026-05-05 20:08:10,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ab24096243809b56de82 2026-05-05 20:08:10,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:08:10,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ab24096243809b56de82 HTTP/1.1" 200 None 2026-05-05 20:08:10,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:08:10,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-05 20:08:10,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:08:10,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ab24096243809b56de82 HTTP/1.1" 200 None 2026-05-05 20:08:10,183 - lava_callback - ERROR - Error processing callback for node 69f7ab24096243809b56de82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44460 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:08:50,152 - lava_callback - INFO - Received callback for node 69f7ab49096243809b56de94 INFO: 172.21.0.1:42936 - "POST /node/69f7ab49096243809b56de94 HTTP/1.0" 202 Accepted 2026-05-05 20:08:50,158 - lava_callback - INFO - Starting async job submit for node 69f7ab49096243809b56de94 2026-05-05 20:08:50,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:08:50,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ab49096243809b56de94 HTTP/1.1" 200 None 2026-05-05 20:08:50,173 - lava_callback - DEBUG - Processing node 69f7ab49096243809b56de94: baseline-arm-clabbe 2026-05-05 20:08:50,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ab49096243809b56de94 2026-05-05 20:08:50,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:08:50,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ab49096243809b56de94 HTTP/1.1" 200 None 2026-05-05 20:08:50,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:08:50,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-05 20:08:50,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:08:50,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ab49096243809b56de94 HTTP/1.1" 200 None 2026-05-05 20:08:50,229 - lava_callback - ERROR - Error processing callback for node 69f7ab49096243809b56de94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35006 - "GET /node/6992da7c31166481c8dd4635%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60810 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:10:50,364 - lava_callback - INFO - Received callback for node 69f7abb7096243809b56decc INFO: 172.21.0.1:49494 - "POST /node/69f7abb7096243809b56decc HTTP/1.0" 202 Accepted 2026-05-05 20:10:50,370 - lava_callback - INFO - Starting async job submit for node 69f7abb7096243809b56decc 2026-05-05 20:10:50,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:10:50,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7abb7096243809b56decc HTTP/1.1" 200 None 2026-05-05 20:10:50,385 - lava_callback - DEBUG - Processing node 69f7abb7096243809b56decc: baseline-arm-clabbe 2026-05-05 20:10:50,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7abb7096243809b56decc 2026-05-05 20:10:50,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:10:50,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7abb7096243809b56decc HTTP/1.1" 200 None 2026-05-05 20:10:50,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:10:50,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-05 20:10:50,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:10:50,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7abb7096243809b56decc HTTP/1.1" 200 None 2026-05-05 20:10:50,438 - lava_callback - ERROR - Error processing callback for node 69f7abb7096243809b56decc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52918 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:11:30,233 - lava_callback - INFO - Received callback for node 69f7abdc096243809b56dede INFO: 172.21.0.1:33484 - "POST /node/69f7abdc096243809b56dede HTTP/1.0" 202 Accepted 2026-05-05 20:11:30,242 - lava_callback - INFO - Starting async job submit for node 69f7abdc096243809b56dede 2026-05-05 20:11:30,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:11:30,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7abdc096243809b56dede HTTP/1.1" 200 None 2026-05-05 20:11:30,258 - lava_callback - DEBUG - Processing node 69f7abdc096243809b56dede: baseline-arm-clabbe 2026-05-05 20:11:30,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7abdc096243809b56dede 2026-05-05 20:11:30,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:11:30,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7abdc096243809b56dede HTTP/1.1" 200 None 2026-05-05 20:11:30,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:11:30,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-05 20:11:30,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:11:30,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7abdc096243809b56dede HTTP/1.1" 200 None 2026-05-05 20:11:30,313 - lava_callback - ERROR - Error processing callback for node 69f7abdc096243809b56dede: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48736 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:13:10,391 - lava_callback - INFO - Received callback for node 69f7ac4a096243809b56df13 INFO: 172.21.0.1:33298 - "POST /node/69f7ac4a096243809b56df13 HTTP/1.0" 202 Accepted 2026-05-05 20:13:10,398 - lava_callback - INFO - Starting async job submit for node 69f7ac4a096243809b56df13 2026-05-05 20:13:10,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:13:10,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ac4a096243809b56df13 HTTP/1.1" 200 None 2026-05-05 20:13:10,424 - lava_callback - DEBUG - Processing node 69f7ac4a096243809b56df13: baseline-arm-clabbe 2026-05-05 20:13:10,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ac4a096243809b56df13 2026-05-05 20:13:10,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:13:10,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ac4a096243809b56df13 HTTP/1.1" 200 None 2026-05-05 20:13:10,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:13:10,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-05 20:13:10,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:13:10,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ac4a096243809b56df13 HTTP/1.1" 200 None 2026-05-05 20:13:10,485 - lava_callback - ERROR - Error processing callback for node 69f7ac4a096243809b56df13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:13:49,150 - lava_callback - INFO - Received callback for node 69f7ac76096243809b56df24 INFO: 172.21.0.1:36042 - "POST /node/69f7ac76096243809b56df24 HTTP/1.0" 202 Accepted 2026-05-05 20:13:49,155 - lava_callback - INFO - Starting async job submit for node 69f7ac76096243809b56df24 2026-05-05 20:13:49,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:13:49,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ac76096243809b56df24 HTTP/1.1" 200 None 2026-05-05 20:13:49,170 - lava_callback - DEBUG - Processing node 69f7ac76096243809b56df24: baseline-arm64-baylibre 2026-05-05 20:13:49,171 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ac76096243809b56df24 2026-05-05 20:13:49,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:13:49,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ac76096243809b56df24 HTTP/1.1" 200 None 2026-05-05 20:13:49,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:13:49,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-05 20:13:49,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:13:49,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ac76096243809b56df24 HTTP/1.1" 200 None 2026-05-05 20:13:49,227 - lava_callback - ERROR - Error processing callback for node 69f7ac76096243809b56df24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45020 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:15:10,446 - lava_callback - INFO - Received callback for node 69f7acb7096243809b56df49 INFO: 172.21.0.1:45158 - "POST /node/69f7acb7096243809b56df49 HTTP/1.0" 202 Accepted 2026-05-05 20:15:10,452 - lava_callback - INFO - Starting async job submit for node 69f7acb7096243809b56df49 2026-05-05 20:15:10,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:15:10,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7acb7096243809b56df49 HTTP/1.1" 200 None 2026-05-05 20:15:10,467 - lava_callback - DEBUG - Processing node 69f7acb7096243809b56df49: baseline-arm-clabbe 2026-05-05 20:15:10,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7acb7096243809b56df49 2026-05-05 20:15:10,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:15:10,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7acb7096243809b56df49 HTTP/1.1" 200 None 2026-05-05 20:15:10,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:15:10,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-05 20:15:10,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:15:10,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7acb7096243809b56df49 HTTP/1.1" 200 None 2026-05-05 20:15:10,519 - lava_callback - ERROR - Error processing callback for node 69f7acb7096243809b56df49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53480 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:16:50,450 - lava_callback - INFO - Received callback for node 69f7ad24096243809b56df81 INFO: 172.21.0.1:51332 - "POST /node/69f7ad24096243809b56df81 HTTP/1.0" 202 Accepted 2026-05-05 20:16:50,455 - lava_callback - INFO - Starting async job submit for node 69f7ad24096243809b56df81 2026-05-05 20:16:50,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:16:50,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ad24096243809b56df81 HTTP/1.1" 200 None 2026-05-05 20:16:50,470 - lava_callback - DEBUG - Processing node 69f7ad24096243809b56df81: baseline-arm-clabbe 2026-05-05 20:16:50,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ad24096243809b56df81 2026-05-05 20:16:50,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:16:50,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ad24096243809b56df81 HTTP/1.1" 200 None 2026-05-05 20:16:50,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:16:50,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-05 20:16:50,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:16:50,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ad24096243809b56df81 HTTP/1.1" 200 None 2026-05-05 20:16:50,516 - lava_callback - ERROR - Error processing callback for node 69f7ad24096243809b56df81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:17:30,438 - lava_callback - INFO - Received callback for node 69f7ad49096243809b56df93 INFO: 172.21.0.1:43196 - "POST /node/69f7ad49096243809b56df93 HTTP/1.0" 202 Accepted 2026-05-05 20:17:30,444 - lava_callback - INFO - Starting async job submit for node 69f7ad49096243809b56df93 2026-05-05 20:17:30,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:17:30,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ad49096243809b56df93 HTTP/1.1" 200 None 2026-05-05 20:17:30,460 - lava_callback - DEBUG - Processing node 69f7ad49096243809b56df93: baseline-arm-clabbe 2026-05-05 20:17:30,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ad49096243809b56df93 2026-05-05 20:17:30,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:17:30,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ad49096243809b56df93 HTTP/1.1" 200 None 2026-05-05 20:17:30,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:17:30,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-05 20:17:30,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:17:30,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ad49096243809b56df93 HTTP/1.1" 200 None 2026-05-05 20:17:30,507 - lava_callback - ERROR - Error processing callback for node 69f7ad49096243809b56df93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:19:10,716 - lava_callback - INFO - Received callback for node 69f7adb6096243809b56dfc7 INFO: 172.21.0.1:48616 - "POST /node/69f7adb6096243809b56dfc7 HTTP/1.0" 202 Accepted 2026-05-05 20:19:10,722 - lava_callback - INFO - Starting async job submit for node 69f7adb6096243809b56dfc7 2026-05-05 20:19:10,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:19:10,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7adb6096243809b56dfc7 HTTP/1.1" 200 None 2026-05-05 20:19:10,737 - lava_callback - DEBUG - Processing node 69f7adb6096243809b56dfc7: baseline-arm-clabbe 2026-05-05 20:19:10,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7adb6096243809b56dfc7 2026-05-05 20:19:10,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:19:10,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7adb6096243809b56dfc7 HTTP/1.1" 200 None 2026-05-05 20:19:10,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:19:10,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-05 20:19:10,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:19:10,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7adb6096243809b56dfc7 HTTP/1.1" 200 None 2026-05-05 20:19:10,784 - lava_callback - ERROR - Error processing callback for node 69f7adb6096243809b56dfc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET /node/69e5f54cab69ed7ddbbc4671%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47264 - "GET /node/69f467b76f80da3b31228acd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56274 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:19:50,563 - lava_callback - INFO - Received callback for node 69f7addb096243809b56dfd9 INFO: 172.21.0.1:47842 - "POST /node/69f7addb096243809b56dfd9 HTTP/1.0" 202 Accepted 2026-05-05 20:19:50,570 - lava_callback - INFO - Starting async job submit for node 69f7addb096243809b56dfd9 2026-05-05 20:19:50,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:19:50,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7addb096243809b56dfd9 HTTP/1.1" 200 None 2026-05-05 20:19:50,609 - lava_callback - DEBUG - Processing node 69f7addb096243809b56dfd9: baseline-arm-clabbe 2026-05-05 20:19:50,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7addb096243809b56dfd9 2026-05-05 20:19:50,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:19:50,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7addb096243809b56dfd9 HTTP/1.1" 200 None 2026-05-05 20:19:50,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:19:50,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-05 20:19:50,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:19:50,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7addb096243809b56dfd9 HTTP/1.1" 200 None 2026-05-05 20:19:50,666 - lava_callback - ERROR - Error processing callback for node 69f7addb096243809b56dfd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42074 - "GET /node/6992fda131166481c8ddf03b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42088 - "GET /node/69934b1b523507f3806a5543%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:42096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:20:30,610 - lava_callback - INFO - Received callback for node 69f7ae00096243809b56dfec INFO: 172.21.0.1:51534 - "POST /node/69f7ae00096243809b56dfec HTTP/1.0" 202 Accepted 2026-05-05 20:20:30,616 - lava_callback - INFO - Starting async job submit for node 69f7ae00096243809b56dfec 2026-05-05 20:20:30,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:20:30,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ae00096243809b56dfec HTTP/1.1" 200 None 2026-05-05 20:20:30,631 - lava_callback - DEBUG - Processing node 69f7ae00096243809b56dfec: baseline-arm-clabbe 2026-05-05 20:20:30,631 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ae00096243809b56dfec 2026-05-05 20:20:30,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:20:30,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ae00096243809b56dfec HTTP/1.1" 200 None 2026-05-05 20:20:30,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:20:30,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-05 20:20:30,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:20:30,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ae00096243809b56dfec HTTP/1.1" 200 None 2026-05-05 20:20:30,677 - lava_callback - ERROR - Error processing callback for node 69f7ae00096243809b56dfec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:21:10,588 - lava_callback - INFO - Received callback for node 69f7ae24096243809b56dffd INFO: 172.21.0.1:58198 - "POST /node/69f7ae24096243809b56dffd HTTP/1.0" 202 Accepted 2026-05-05 20:21:10,593 - lava_callback - INFO - Starting async job submit for node 69f7ae24096243809b56dffd 2026-05-05 20:21:10,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:21:10,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ae24096243809b56dffd HTTP/1.1" 200 None 2026-05-05 20:21:10,615 - lava_callback - DEBUG - Processing node 69f7ae24096243809b56dffd: baseline-arm-clabbe 2026-05-05 20:21:10,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ae24096243809b56dffd 2026-05-05 20:21:10,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:21:10,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ae24096243809b56dffd HTTP/1.1" 200 None 2026-05-05 20:21:10,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:21:10,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-05 20:21:10,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:21:10,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ae24096243809b56dffd HTTP/1.1" 200 None 2026-05-05 20:21:10,669 - lava_callback - ERROR - Error processing callback for node 69f7ae24096243809b56dffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48262 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:21:50,665 - lava_callback - INFO - Received callback for node 69f7ae4a096243809b56e011 INFO: 172.21.0.1:36926 - "POST /node/69f7ae4a096243809b56e011 HTTP/1.0" 202 Accepted 2026-05-05 20:21:50,671 - lava_callback - INFO - Starting async job submit for node 69f7ae4a096243809b56e011 2026-05-05 20:21:50,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:21:50,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ae4a096243809b56e011 HTTP/1.1" 200 None 2026-05-05 20:21:50,704 - lava_callback - DEBUG - Processing node 69f7ae4a096243809b56e011: baseline-arm-clabbe 2026-05-05 20:21:50,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ae4a096243809b56e011 2026-05-05 20:21:50,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:21:50,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ae4a096243809b56e011 HTTP/1.1" 200 None 2026-05-05 20:21:50,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:21:50,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5da98305534e972331c0 HTTP/1.1" 200 None 2026-05-05 20:21:50,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:21:50,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ae4a096243809b56e011 HTTP/1.1" 200 None 2026-05-05 20:21:50,752 - lava_callback - ERROR - Error processing callback for node 69f7ae4a096243809b56e011: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:22:30,085 - lava_callback - INFO - Received callback for node 69f7ae76096243809b56e025 INFO: 172.21.0.1:51698 - "POST /node/69f7ae76096243809b56e025 HTTP/1.0" 202 Accepted 2026-05-05 20:22:30,091 - lava_callback - INFO - Starting async job submit for node 69f7ae76096243809b56e025 2026-05-05 20:22:30,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:22:30,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ae76096243809b56e025 HTTP/1.1" 200 None 2026-05-05 20:22:30,106 - lava_callback - DEBUG - Processing node 69f7ae76096243809b56e025: baseline-arm64-baylibre 2026-05-05 20:22:30,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ae76096243809b56e025 2026-05-05 20:22:30,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:22:30,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ae76096243809b56e025 HTTP/1.1" 200 None 2026-05-05 20:22:30,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:22:30,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-05 20:22:30,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:22:30,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ae76096243809b56e025 HTTP/1.1" 200 None 2026-05-05 20:22:30,164 - lava_callback - ERROR - Error processing callback for node 69f7ae76096243809b56e025: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:23:30,751 - lava_callback - INFO - Received callback for node 69f7aeb9096243809b56e04c INFO: 172.21.0.1:56754 - "POST /node/69f7aeb9096243809b56e04c HTTP/1.0" 202 Accepted 2026-05-05 20:23:30,757 - lava_callback - INFO - Starting async job submit for node 69f7aeb9096243809b56e04c 2026-05-05 20:23:30,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:23:30,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7aeb9096243809b56e04c HTTP/1.1" 200 None 2026-05-05 20:23:30,772 - lava_callback - DEBUG - Processing node 69f7aeb9096243809b56e04c: baseline-arm-clabbe 2026-05-05 20:23:30,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7aeb9096243809b56e04c 2026-05-05 20:23:30,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:23:30,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7aeb9096243809b56e04c HTTP/1.1" 200 None 2026-05-05 20:23:30,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:23:30,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5ea28305534e972332fe HTTP/1.1" 200 None 2026-05-05 20:23:30,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:23:30,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7aeb9096243809b56e04c HTTP/1.1" 200 None 2026-05-05 20:23:30,826 - lava_callback - ERROR - Error processing callback for node 69f7aeb9096243809b56e04c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:24:10,782 - lava_callback - INFO - Received callback for node 69f7aedd096243809b56e064 INFO: 172.21.0.1:52824 - "POST /node/69f7aedd096243809b56e064 HTTP/1.0" 202 Accepted 2026-05-05 20:24:10,788 - lava_callback - INFO - Starting async job submit for node 69f7aedd096243809b56e064 2026-05-05 20:24:10,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:24:10,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7aedd096243809b56e064 HTTP/1.1" 200 None 2026-05-05 20:24:10,808 - lava_callback - DEBUG - Processing node 69f7aedd096243809b56e064: baseline-arm-clabbe 2026-05-05 20:24:10,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7aedd096243809b56e064 2026-05-05 20:24:10,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:24:10,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7aedd096243809b56e064 HTTP/1.1" 200 None 2026-05-05 20:24:10,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:24:10,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5e4d8305534e9723328e HTTP/1.1" 200 None 2026-05-05 20:24:10,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:24:10,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7aedd096243809b56e064 HTTP/1.1" 200 None 2026-05-05 20:24:10,855 - lava_callback - ERROR - Error processing callback for node 69f7aedd096243809b56e064: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57954 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:25:30,874 - lava_callback - INFO - Received callback for node 69f7af32096243809b56e072 INFO: 172.21.0.1:39880 - "POST /node/69f7af32096243809b56e072 HTTP/1.0" 202 Accepted 2026-05-05 20:25:30,880 - lava_callback - INFO - Starting async job submit for node 69f7af32096243809b56e072 2026-05-05 20:25:30,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:25:30,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7af32096243809b56e072 HTTP/1.1" 200 None 2026-05-05 20:25:30,906 - lava_callback - DEBUG - Processing node 69f7af32096243809b56e072: baseline-arm-clabbe 2026-05-05 20:25:30,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7af32096243809b56e072 2026-05-05 20:25:30,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:25:30,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7af32096243809b56e072 HTTP/1.1" 200 None 2026-05-05 20:25:30,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:25:30,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ef5df98305534e97233234 HTTP/1.1" 200 None 2026-05-05 20:25:30,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:25:30,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7af32096243809b56e072 HTTP/1.1" 200 None 2026-05-05 20:25:30,951 - lava_callback - ERROR - Error processing callback for node 69f7af32096243809b56e072: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET /node/69ef969d8305534e9723b270%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:26:09,754 - lava_callback - INFO - Received callback for node 69f7af5f096243809b56e086 INFO: 172.21.0.1:48284 - "POST /node/69f7af5f096243809b56e086 HTTP/1.0" 202 Accepted 2026-05-05 20:26:09,760 - lava_callback - INFO - Starting async job submit for node 69f7af5f096243809b56e086 2026-05-05 20:26:09,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:26:09,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7af5f096243809b56e086 HTTP/1.1" 200 None 2026-05-05 20:26:09,776 - lava_callback - DEBUG - Processing node 69f7af5f096243809b56e086: baseline-arm64-baylibre 2026-05-05 20:26:09,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7af5f096243809b56e086 2026-05-05 20:26:09,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:26:09,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7af5f096243809b56e086 HTTP/1.1" 200 None 2026-05-05 20:26:09,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:26:09,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-05 20:26:09,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:26:09,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7af5f096243809b56e086 HTTP/1.1" 200 None 2026-05-05 20:26:09,827 - lava_callback - ERROR - Error processing callback for node 69f7af5f096243809b56e086: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:41:31,692 - lava_callback - INFO - Received callback for node 69f7b2ea096243809b56e0ec INFO: 172.21.0.1:53160 - "POST /node/69f7b2ea096243809b56e0ec HTTP/1.0" 202 Accepted 2026-05-05 20:41:31,697 - lava_callback - INFO - Starting async job submit for node 69f7b2ea096243809b56e0ec 2026-05-05 20:41:31,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:41:31,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b2ea096243809b56e0ec HTTP/1.1" 200 None 2026-05-05 20:41:31,711 - lava_callback - DEBUG - Processing node 69f7b2ea096243809b56e0ec: baseline-arm-clabbe 2026-05-05 20:41:31,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b2ea096243809b56e0ec 2026-05-05 20:41:31,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:41:31,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b2ea096243809b56e0ec HTTP/1.1" 200 None 2026-05-05 20:41:31,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:41:31,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-05 20:41:31,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:41:31,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b2ea096243809b56e0ec HTTP/1.1" 200 None 2026-05-05 20:41:31,766 - lava_callback - ERROR - Error processing callback for node 69f7b2ea096243809b56e0ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:42:11,413 - lava_callback - INFO - Received callback for node 69f7b31e096243809b56e0fa INFO: 172.21.0.1:50958 - "POST /node/69f7b31e096243809b56e0fa HTTP/1.0" 202 Accepted 2026-05-05 20:42:11,419 - lava_callback - INFO - Starting async job submit for node 69f7b31e096243809b56e0fa 2026-05-05 20:42:11,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:42:11,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b31e096243809b56e0fa HTTP/1.1" 200 None 2026-05-05 20:42:11,444 - lava_callback - DEBUG - Processing node 69f7b31e096243809b56e0fa: baseline-arm-clabbe 2026-05-05 20:42:11,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b31e096243809b56e0fa 2026-05-05 20:42:11,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:42:11,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b31e096243809b56e0fa HTTP/1.1" 200 None 2026-05-05 20:42:11,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:42:11,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-05 20:42:11,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:42:11,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b31e096243809b56e0fa HTTP/1.1" 200 None 2026-05-05 20:42:11,496 - lava_callback - ERROR - Error processing callback for node 69f7b31e096243809b56e0fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44184 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:43:11,506 - lava_callback - INFO - Received callback for node 69f7b35a096243809b56e10b INFO: 172.21.0.1:50602 - "POST /node/69f7b35a096243809b56e10b HTTP/1.0" 202 Accepted 2026-05-05 20:43:11,511 - lava_callback - INFO - Starting async job submit for node 69f7b35a096243809b56e10b 2026-05-05 20:43:11,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:43:11,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b35a096243809b56e10b HTTP/1.1" 200 None 2026-05-05 20:43:11,527 - lava_callback - DEBUG - Processing node 69f7b35a096243809b56e10b: baseline-arm-clabbe 2026-05-05 20:43:11,527 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b35a096243809b56e10b 2026-05-05 20:43:11,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:43:11,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b35a096243809b56e10b HTTP/1.1" 200 None 2026-05-05 20:43:11,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:43:11,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-05 20:43:11,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:43:11,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b35a096243809b56e10b HTTP/1.1" 200 None 2026-05-05 20:43:11,572 - lava_callback - ERROR - Error processing callback for node 69f7b35a096243809b56e10b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:43:51,428 - lava_callback - INFO - Received callback for node 69f7b37e096243809b56e119 INFO: 172.21.0.1:50114 - "POST /node/69f7b37e096243809b56e119 HTTP/1.0" 202 Accepted 2026-05-05 20:43:51,433 - lava_callback - INFO - Starting async job submit for node 69f7b37e096243809b56e119 2026-05-05 20:43:51,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:43:51,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b37e096243809b56e119 HTTP/1.1" 200 None 2026-05-05 20:43:51,448 - lava_callback - DEBUG - Processing node 69f7b37e096243809b56e119: baseline-arm-clabbe 2026-05-05 20:43:51,448 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b37e096243809b56e119 2026-05-05 20:43:51,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:43:51,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b37e096243809b56e119 HTTP/1.1" 200 None 2026-05-05 20:43:51,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:43:51,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-05 20:43:51,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:43:51,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b37e096243809b56e119 HTTP/1.1" 200 None 2026-05-05 20:43:51,493 - lava_callback - ERROR - Error processing callback for node 69f7b37e096243809b56e119: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57164 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:45:11,543 - lava_callback - INFO - Received callback for node 69f7b3d2096243809b56e128 INFO: 172.21.0.1:44354 - "POST /node/69f7b3d2096243809b56e128 HTTP/1.0" 202 Accepted 2026-05-05 20:45:11,548 - lava_callback - INFO - Starting async job submit for node 69f7b3d2096243809b56e128 2026-05-05 20:45:11,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:45:11,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b3d2096243809b56e128 HTTP/1.1" 200 None 2026-05-05 20:45:11,566 - lava_callback - DEBUG - Processing node 69f7b3d2096243809b56e128: baseline-arm-clabbe 2026-05-05 20:45:11,566 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b3d2096243809b56e128 2026-05-05 20:45:11,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:45:11,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b3d2096243809b56e128 HTTP/1.1" 200 None 2026-05-05 20:45:11,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:45:11,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704b787005b7b22f0cae8 HTTP/1.1" 200 None 2026-05-05 20:45:11,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:45:11,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b3d2096243809b56e128 HTTP/1.1" 200 None 2026-05-05 20:45:11,616 - lava_callback - ERROR - Error processing callback for node 69f7b3d2096243809b56e128: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44356 - "GET /node/69934e26523507f3806a615a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44166 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:46:18,483 - lava_callback - INFO - Received callback for node 69fa4267a9d11f026cebf068 INFO: 172.21.0.1:44178 - "POST /node/69fa4267a9d11f026cebf068 HTTP/1.0" 202 Accepted 2026-05-05 20:46:18,490 - lava_callback - INFO - Starting async job submit for node 69fa4267a9d11f026cebf068 2026-05-05 20:46:18,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:46:18,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa4267a9d11f026cebf068 HTTP/1.1" 200 None 2026-05-05 20:46:18,538 - lava_callback - DEBUG - Processing node 69fa4267a9d11f026cebf068: baseline-arm64 2026-05-05 20:46:19,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:46:19,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:46:19,146 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa4267a9d11f026cebf068/log.txt.gz 2026-05-05 20:46:19,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:46:19,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:46:19,558 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa4267a9d11f026cebf068/lava-logs.yaml 2026-05-05 20:46:19,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:46:19,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:46:19,716 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa4267a9d11f026cebf068/lava_callback.json.gz 2026-05-05 20:46:19,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:46:19,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa4267a9d11f026cebf068 HTTP/1.1" 200 None 2026-05-05 20:46:19,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:46:19,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 20:46:19,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:46:19,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa4267a9d11f026cebf068 HTTP/1.1" 200 None 2026-05-05 20:46:19,838 - lava_callback - INFO - Completed processing callback for node 69fa4267a9d11f026cebf068 INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:46:42,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:46:42,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55690 - "GET /node/6992de1f31166481c8dd5929%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55694 - "GET /node/69935307523507f3806a7d56%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET /node/6992ddf531166481c8dd55e2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35254 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:49:20,019 - lava_callback - INFO - Received callback for node 69fa42e1a9d11f026cebf08c INFO: 172.21.0.1:42208 - "POST /node/69fa42e1a9d11f026cebf08c HTTP/1.0" 202 Accepted 2026-05-05 20:49:20,025 - lava_callback - INFO - Starting async job submit for node 69fa42e1a9d11f026cebf08c 2026-05-05 20:49:20,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:49:20,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa42e1a9d11f026cebf08c HTTP/1.1" 200 None 2026-05-05 20:49:20,071 - lava_callback - DEBUG - Processing node 69fa42e1a9d11f026cebf08c: baseline-arm64 2026-05-05 20:49:20,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:49:20,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:49:20,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa42e1a9d11f026cebf08c/log.txt.gz 2026-05-05 20:49:20,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:49:21,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:49:21,137 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa42e1a9d11f026cebf08c/lava-logs.yaml 2026-05-05 20:49:21,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:49:21,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:49:21,262 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa42e1a9d11f026cebf08c/lava_callback.json.gz 2026-05-05 20:49:21,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:49:21,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa42e1a9d11f026cebf08c HTTP/1.1" 200 None 2026-05-05 20:49:21,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:49:21,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 20:49:21,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:49:21,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa42e1a9d11f026cebf08c HTTP/1.1" 200 None 2026-05-05 20:49:21,394 - lava_callback - INFO - Completed processing callback for node 69fa42e1a9d11f026cebf08c INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57294 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:49:42,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:49:42,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET /node/6939b8035206d8a4495e9e3c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:46148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET /node/6993510c523507f3806a6d59%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58282 - "GET /node/69f5ba7d8cb8354ccaa5f4a9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:52:04,231 - lava_callback - INFO - Received callback for node 69fa4334a9d11f026cebf0b1 INFO: 172.21.0.1:40902 - "POST /node/69fa4334a9d11f026cebf0b1 HTTP/1.0" 202 Accepted 2026-05-05 20:52:04,238 - lava_callback - INFO - Starting async job submit for node 69fa4334a9d11f026cebf0b1 2026-05-05 20:52:04,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:52:04,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa4334a9d11f026cebf0b1 HTTP/1.1" 200 None 2026-05-05 20:52:04,278 - lava_callback - DEBUG - Processing node 69fa4334a9d11f026cebf0b1: baseline-nfs-arm64 2026-05-05 20:52:04,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:52:04,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:52:04,950 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa4334a9d11f026cebf0b1/log.txt.gz 2026-05-05 20:52:05,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:52:05,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:52:05,367 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa4334a9d11f026cebf0b1/lava-logs.yaml 2026-05-05 20:52:05,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:52:05,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:52:05,497 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa4334a9d11f026cebf0b1/lava_callback.json.gz 2026-05-05 20:52:05,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:52:05,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa4334a9d11f026cebf0b1 HTTP/1.1" 200 None 2026-05-05 20:52:05,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:52:05,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 20:52:05,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:52:05,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa4334a9d11f026cebf0b1 HTTP/1.1" 200 None 2026-05-05 20:52:05,621 - lava_callback - INFO - Completed processing callback for node 69fa4334a9d11f026cebf0b1 INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:52:12,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:52:12,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:52:50,236 - lava_callback - INFO - Received callback for node 69fa44d6a9d11f026cebf102 INFO: 172.21.0.1:38874 - "POST /node/69fa44d6a9d11f026cebf102 HTTP/1.0" 202 Accepted 2026-05-05 20:52:50,246 - lava_callback - INFO - Starting async job submit for node 69fa44d6a9d11f026cebf102 2026-05-05 20:52:50,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:52:50,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa44d6a9d11f026cebf102 HTTP/1.1" 200 None 2026-05-05 20:52:50,309 - lava_callback - DEBUG - Processing node 69fa44d6a9d11f026cebf102: baseline-nfs-arm64 2026-05-05 20:52:50,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:52:50,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:52:50,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa44d6a9d11f026cebf102/log.txt.gz 2026-05-05 20:52:51,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:52:51,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:52:51,392 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa44d6a9d11f026cebf102/lava-logs.yaml 2026-05-05 20:52:51,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 20:52:51,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 20:52:51,514 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa44d6a9d11f026cebf102/lava_callback.json.gz 2026-05-05 20:52:51,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:52:51,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa44d6a9d11f026cebf102 HTTP/1.1" 200 None 2026-05-05 20:52:51,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:52:51,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 20:52:51,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:52:51,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa44d6a9d11f026cebf102 HTTP/1.1" 200 None 2026-05-05 20:52:51,636 - lava_callback - INFO - Completed processing callback for node 69fa44d6a9d11f026cebf102 INFO: 172.21.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET /node/6992dde531166481c8dd55cc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45904 - "GET /node/68f8b310adbe6d86fc1f4d3a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:53:12,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:53:12,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:53:31,569 - lava_callback - INFO - Received callback for node 69f7b5b9096243809b56e1e6 INFO: 172.21.0.1:37172 - "POST /node/69f7b5b9096243809b56e1e6 HTTP/1.0" 202 Accepted 2026-05-05 20:53:31,575 - lava_callback - INFO - Starting async job submit for node 69f7b5b9096243809b56e1e6 2026-05-05 20:53:31,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:53:31,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b5b9096243809b56e1e6 HTTP/1.1" 200 None 2026-05-05 20:53:31,590 - lava_callback - DEBUG - Processing node 69f7b5b9096243809b56e1e6: baseline-arm64-baylibre 2026-05-05 20:53:31,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b5b9096243809b56e1e6 2026-05-05 20:53:31,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:53:31,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b5b9096243809b56e1e6 HTTP/1.1" 200 None 2026-05-05 20:53:31,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:53:31,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-05 20:53:31,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:53:31,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b5b9096243809b56e1e6 HTTP/1.1" 200 None 2026-05-05 20:53:31,646 - lava_callback - ERROR - Error processing callback for node 69f7b5b9096243809b56e1e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:54:52,057 - lava_callback - INFO - Received callback for node 69f7b608096243809b56e215 INFO: 172.21.0.1:40238 - "POST /node/69f7b608096243809b56e215 HTTP/1.0" 202 Accepted 2026-05-05 20:54:52,062 - lava_callback - INFO - Starting async job submit for node 69f7b608096243809b56e215 2026-05-05 20:54:52,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:54:52,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b608096243809b56e215 HTTP/1.1" 200 None 2026-05-05 20:54:52,081 - lava_callback - DEBUG - Processing node 69f7b608096243809b56e215: baseline-arm64-clabbe 2026-05-05 20:54:52,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b608096243809b56e215 2026-05-05 20:54:52,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:54:52,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b608096243809b56e215 HTTP/1.1" 200 None 2026-05-05 20:54:52,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:54:52,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-05 20:54:52,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:54:52,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b608096243809b56e215 HTTP/1.1" 200 None 2026-05-05 20:54:52,130 - lava_callback - ERROR - Error processing callback for node 69f7b608096243809b56e215: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:55:52,225 - lava_callback - INFO - Received callback for node 69f7b651096243809b56e237 INFO: 172.21.0.1:57834 - "POST /node/69f7b651096243809b56e237 HTTP/1.0" 202 Accepted 2026-05-05 20:55:52,231 - lava_callback - INFO - Starting async job submit for node 69f7b651096243809b56e237 2026-05-05 20:55:52,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:55:52,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b651096243809b56e237 HTTP/1.1" 200 None 2026-05-05 20:55:52,246 - lava_callback - DEBUG - Processing node 69f7b651096243809b56e237: baseline-arm64-clabbe 2026-05-05 20:55:52,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b651096243809b56e237 2026-05-05 20:55:52,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:55:52,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b651096243809b56e237 HTTP/1.1" 200 None 2026-05-05 20:55:52,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:55:52,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-05 20:55:52,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:55:52,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b651096243809b56e237 HTTP/1.1" 200 None 2026-05-05 20:55:52,293 - lava_callback - ERROR - Error processing callback for node 69f7b651096243809b56e237: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51530 - "GET /node/69e3b4947f5347282fbde46d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51544 - "GET /node/69943ac95ae459b9df3d55fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:57:12,067 - lava_callback - INFO - Received callback for node 69f7b69b096243809b56e26a INFO: 172.21.0.1:41022 - "POST /node/69f7b69b096243809b56e26a HTTP/1.0" 202 Accepted 2026-05-05 20:57:12,072 - lava_callback - INFO - Starting async job submit for node 69f7b69b096243809b56e26a 2026-05-05 20:57:12,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:57:12,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b69b096243809b56e26a HTTP/1.1" 200 None 2026-05-05 20:57:12,089 - lava_callback - DEBUG - Processing node 69f7b69b096243809b56e26a: baseline-arm64-clabbe 2026-05-05 20:57:12,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b69b096243809b56e26a 2026-05-05 20:57:12,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:57:12,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b69b096243809b56e26a HTTP/1.1" 200 None 2026-05-05 20:57:12,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:57:12,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-05 20:57:12,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:57:12,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b69b096243809b56e26a HTTP/1.1" 200 None 2026-05-05 20:57:12,136 - lava_callback - ERROR - Error processing callback for node 69f7b69b096243809b56e26a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:58:11,541 - lava_callback - INFO - Received callback for node 69f7b6d5096243809b56e283 INFO: 172.21.0.1:59930 - "POST /node/69f7b6d5096243809b56e283 HTTP/1.0" 202 Accepted 2026-05-05 20:58:11,546 - lava_callback - INFO - Starting async job submit for node 69f7b6d5096243809b56e283 2026-05-05 20:58:11,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:58:11,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b6d5096243809b56e283 HTTP/1.1" 200 None 2026-05-05 20:58:11,579 - lava_callback - DEBUG - Processing node 69f7b6d5096243809b56e283: baseline-arm-baylibre 2026-05-05 20:58:11,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b6d5096243809b56e283 2026-05-05 20:58:11,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:58:11,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b6d5096243809b56e283 HTTP/1.1" 200 None 2026-05-05 20:58:11,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:58:11,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-05 20:58:11,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:58:11,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b6d5096243809b56e283 HTTP/1.1" 200 None 2026-05-05 20:58:11,646 - lava_callback - ERROR - Error processing callback for node 69f7b6d5096243809b56e283: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52692 - "GET /node/685d055d6e9add64ba7d2132%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52704 - "GET /node/69ef6b4e8305534e97239d73%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK 2026-05-05 20:59:12,146 - lava_callback - INFO - Received callback for node 69f7b70a096243809b56e291 INFO: 172.21.0.1:60122 - "POST /node/69f7b70a096243809b56e291 HTTP/1.0" 202 Accepted 2026-05-05 20:59:12,152 - lava_callback - INFO - Starting async job submit for node 69f7b70a096243809b56e291 2026-05-05 20:59:12,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:59:12,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b70a096243809b56e291 HTTP/1.1" 200 None 2026-05-05 20:59:12,167 - lava_callback - DEBUG - Processing node 69f7b70a096243809b56e291: baseline-arm64-clabbe 2026-05-05 20:59:12,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b70a096243809b56e291 2026-05-05 20:59:12,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:59:12,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b70a096243809b56e291 HTTP/1.1" 200 None 2026-05-05 20:59:12,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:59:12,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-05 20:59:12,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 20:59:12,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b70a096243809b56e291 HTTP/1.1" 200 None 2026-05-05 20:59:12,231 - lava_callback - ERROR - Error processing callback for node 69f7b70a096243809b56e291: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43940 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:00:12,280 - lava_callback - INFO - Received callback for node 69f7b752096243809b56e2c1 INFO: 172.21.0.1:55120 - "POST /node/69f7b752096243809b56e2c1 HTTP/1.0" 202 Accepted 2026-05-05 21:00:12,286 - lava_callback - INFO - Starting async job submit for node 69f7b752096243809b56e2c1 2026-05-05 21:00:12,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:00:12,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b752096243809b56e2c1 HTTP/1.1" 200 None 2026-05-05 21:00:12,301 - lava_callback - DEBUG - Processing node 69f7b752096243809b56e2c1: baseline-arm64-clabbe 2026-05-05 21:00:12,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b752096243809b56e2c1 2026-05-05 21:00:12,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:00:12,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b752096243809b56e2c1 HTTP/1.1" 200 None 2026-05-05 21:00:12,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:00:12,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-05 21:00:12,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:00:12,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b752096243809b56e2c1 HTTP/1.1" 200 None 2026-05-05 21:00:12,365 - lava_callback - ERROR - Error processing callback for node 69f7b752096243809b56e2c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39824 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:01:11,741 - lava_callback - INFO - Received callback for node 69f7b78c096243809b56e2e3 INFO: 172.21.0.1:47568 - "POST /node/69f7b78c096243809b56e2e3 HTTP/1.0" 202 Accepted 2026-05-05 21:01:11,746 - lava_callback - INFO - Starting async job submit for node 69f7b78c096243809b56e2e3 2026-05-05 21:01:11,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:01:11,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b78c096243809b56e2e3 HTTP/1.1" 200 None 2026-05-05 21:01:11,763 - lava_callback - DEBUG - Processing node 69f7b78c096243809b56e2e3: baseline-arm-baylibre 2026-05-05 21:01:11,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b78c096243809b56e2e3 2026-05-05 21:01:11,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:01:11,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b78c096243809b56e2e3 HTTP/1.1" 200 None 2026-05-05 21:01:11,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:01:11,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-05 21:01:11,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:01:11,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b78c096243809b56e2e3 HTTP/1.1" 200 None 2026-05-05 21:01:11,810 - lava_callback - ERROR - Error processing callback for node 69f7b78c096243809b56e2e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:02:12,216 - lava_callback - INFO - Received callback for node 69f7b7c1096243809b56e2f1 INFO: 172.21.0.1:40724 - "POST /node/69f7b7c1096243809b56e2f1 HTTP/1.0" 202 Accepted 2026-05-05 21:02:12,221 - lava_callback - INFO - Starting async job submit for node 69f7b7c1096243809b56e2f1 2026-05-05 21:02:12,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:02:12,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b7c1096243809b56e2f1 HTTP/1.1" 200 None 2026-05-05 21:02:12,238 - lava_callback - DEBUG - Processing node 69f7b7c1096243809b56e2f1: baseline-arm64-clabbe 2026-05-05 21:02:12,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b7c1096243809b56e2f1 2026-05-05 21:02:12,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:02:12,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b7c1096243809b56e2f1 HTTP/1.1" 200 None 2026-05-05 21:02:12,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:02:12,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f704c587005b7b22f0caf7 HTTP/1.1" 200 None 2026-05-05 21:02:12,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:02:12,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b7c1096243809b56e2f1 HTTP/1.1" 200 None 2026-05-05 21:02:12,293 - lava_callback - ERROR - Error processing callback for node 69f7b7c1096243809b56e2f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51322 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:03:11,814 - lava_callback - INFO - Received callback for node 69f7b7fa096243809b56e31b INFO: 172.21.0.1:34968 - "POST /node/69f7b7fa096243809b56e31b HTTP/1.0" 202 Accepted 2026-05-05 21:03:11,823 - lava_callback - INFO - Starting async job submit for node 69f7b7fa096243809b56e31b 2026-05-05 21:03:11,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:03:11,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b7fa096243809b56e31b HTTP/1.1" 200 None 2026-05-05 21:03:11,840 - lava_callback - DEBUG - Processing node 69f7b7fa096243809b56e31b: baseline-arm-baylibre 2026-05-05 21:03:11,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b7fa096243809b56e31b 2026-05-05 21:03:11,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:03:11,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b7fa096243809b56e31b HTTP/1.1" 200 None 2026-05-05 21:03:11,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:03:11,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-05 21:03:11,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:03:11,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b7fa096243809b56e31b HTTP/1.1" 200 None 2026-05-05 21:03:11,922 - lava_callback - ERROR - Error processing callback for node 69f7b7fa096243809b56e31b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:03:31,761 - lava_callback - INFO - Received callback for node 69f7b81d096243809b56e332 INFO: 172.21.0.1:36638 - "POST /node/69f7b81d096243809b56e332 HTTP/1.0" 202 Accepted 2026-05-05 21:03:31,771 - lava_callback - INFO - Starting async job submit for node 69f7b81d096243809b56e332 2026-05-05 21:03:31,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:03:31,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b81d096243809b56e332 HTTP/1.1" 200 None 2026-05-05 21:03:31,787 - lava_callback - DEBUG - Processing node 69f7b81d096243809b56e332: baseline-arm-baylibre 2026-05-05 21:03:31,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b81d096243809b56e332 2026-05-05 21:03:31,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:03:31,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b81d096243809b56e332 HTTP/1.1" 200 None 2026-05-05 21:03:31,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:03:31,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:03:31,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:03:31,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b81d096243809b56e332 HTTP/1.1" 200 None 2026-05-05 21:03:31,841 - lava_callback - ERROR - Error processing callback for node 69f7b81d096243809b56e332: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:04:07,976 - lava_callback - INFO - Received callback for node 69fa4615a9d11f026cebf18e INFO: 172.21.0.1:55044 - "POST /node/69fa4615a9d11f026cebf18e HTTP/1.0" 202 Accepted 2026-05-05 21:04:07,982 - lava_callback - INFO - Starting async job submit for node 69fa4615a9d11f026cebf18e 2026-05-05 21:04:08,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:08,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa4615a9d11f026cebf18e HTTP/1.1" 200 None 2026-05-05 21:04:08,023 - lava_callback - DEBUG - Processing node 69fa4615a9d11f026cebf18e: baseline-nfs-arm64 2026-05-05 21:04:08,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:04:08,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:04:08,761 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa4615a9d11f026cebf18e/log.txt.gz 2026-05-05 21:04:09,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:04:09,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:04:09,175 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa4615a9d11f026cebf18e/lava-logs.yaml 2026-05-05 21:04:09,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:04:09,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:04:09,303 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa4615a9d11f026cebf18e/lava_callback.json.gz 2026-05-05 21:04:09,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:09,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa4615a9d11f026cebf18e HTTP/1.1" 200 None 2026-05-05 21:04:09,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:09,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 21:04:09,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:09,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa4615a9d11f026cebf18e HTTP/1.1" 200 None 2026-05-05 21:04:09,433 - lava_callback - INFO - Completed processing callback for node 69fa4615a9d11f026cebf18e 2026-05-05 21:04:11,821 - lava_callback - INFO - Received callback for node 69f7b841096243809b56e33f INFO: 172.21.0.1:54096 - "POST /node/69f7b841096243809b56e33f HTTP/1.0" 202 Accepted 2026-05-05 21:04:11,827 - lava_callback - INFO - Starting async job submit for node 69f7b841096243809b56e33f 2026-05-05 21:04:11,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:11,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b841096243809b56e33f HTTP/1.1" 200 None 2026-05-05 21:04:11,843 - lava_callback - DEBUG - Processing node 69f7b841096243809b56e33f: baseline-arm-baylibre 2026-05-05 21:04:11,843 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b841096243809b56e33f 2026-05-05 21:04:11,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:11,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b841096243809b56e33f HTTP/1.1" 200 None 2026-05-05 21:04:11,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:11,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-05 21:04:11,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:11,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b841096243809b56e33f HTTP/1.1" 200 None 2026-05-05 21:04:11,908 - lava_callback - ERROR - Error processing callback for node 69f7b841096243809b56e33f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 21:04:12,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:12,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54292 - "GET /node/69e3b4957f5347282fbde470%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54304 - "GET /node/69ef89b98305534e9723ada0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54320 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:04:51,890 - lava_callback - INFO - Received callback for node 69f7b864096243809b56e34b INFO: 172.21.0.1:49612 - "POST /node/69f7b864096243809b56e34b HTTP/1.0" 202 Accepted 2026-05-05 21:04:51,896 - lava_callback - INFO - Starting async job submit for node 69f7b864096243809b56e34b 2026-05-05 21:04:51,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:51,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b864096243809b56e34b HTTP/1.1" 200 None 2026-05-05 21:04:51,913 - lava_callback - DEBUG - Processing node 69f7b864096243809b56e34b: baseline-arm-baylibre 2026-05-05 21:04:51,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b864096243809b56e34b 2026-05-05 21:04:51,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:51,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b864096243809b56e34b HTTP/1.1" 200 None 2026-05-05 21:04:51,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:51,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:04:51,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:04:51,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b864096243809b56e34b HTTP/1.1" 200 None 2026-05-05 21:04:51,972 - lava_callback - ERROR - Error processing callback for node 69f7b864096243809b56e34b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:05:32,359 - lava_callback - INFO - Received callback for node 69f7b88b096243809b56e35d INFO: 172.21.0.1:58898 - "POST /node/69f7b88b096243809b56e35d HTTP/1.0" 202 Accepted 2026-05-05 21:05:32,365 - lava_callback - INFO - Starting async job submit for node 69f7b88b096243809b56e35d 2026-05-05 21:05:32,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:05:32,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b88b096243809b56e35d HTTP/1.1" 200 None 2026-05-05 21:05:32,381 - lava_callback - DEBUG - Processing node 69f7b88b096243809b56e35d: baseline-arm-clabbe 2026-05-05 21:05:32,381 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b88b096243809b56e35d 2026-05-05 21:05:32,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:05:32,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b88b096243809b56e35d HTTP/1.1" 200 None 2026-05-05 21:05:32,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:05:32,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:05:32,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:05:32,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b88b096243809b56e35d HTTP/1.1" 200 None 2026-05-05 21:05:32,430 - lava_callback - ERROR - Error processing callback for node 69f7b88b096243809b56e35d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:05:51,965 - lava_callback - INFO - Received callback for node 69f7b8ab096243809b56e368 INFO: 172.21.0.1:51380 - "POST /node/69f7b8ab096243809b56e368 HTTP/1.0" 202 Accepted 2026-05-05 21:05:51,973 - lava_callback - INFO - Starting async job submit for node 69f7b8ab096243809b56e368 2026-05-05 21:05:51,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:05:51,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b8ab096243809b56e368 HTTP/1.1" 200 None 2026-05-05 21:05:51,989 - lava_callback - DEBUG - Processing node 69f7b8ab096243809b56e368: baseline-arm-baylibre 2026-05-05 21:05:51,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b8ab096243809b56e368 2026-05-05 21:05:51,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:05:52,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b8ab096243809b56e368 HTTP/1.1" 200 None 2026-05-05 21:05:52,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:05:52,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:05:52,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:05:52,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b8ab096243809b56e368 HTTP/1.1" 200 None 2026-05-05 21:05:52,044 - lava_callback - ERROR - Error processing callback for node 69f7b8ab096243809b56e368: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET /node/69933b8e31166481c8ded56a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51404 - "GET /node/69efcd838305534e9723cdff%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-05 21:05:59,271 - lava_callback - INFO - Received callback for node 69fa465ea9d11f026cebf1af INFO: 172.21.0.1:51406 - "POST /node/69fa465ea9d11f026cebf1af HTTP/1.0" 202 Accepted 2026-05-05 21:05:59,278 - lava_callback - INFO - Starting async job submit for node 69fa465ea9d11f026cebf1af 2026-05-05 21:05:59,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:05:59,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa465ea9d11f026cebf1af HTTP/1.1" 200 None 2026-05-05 21:05:59,325 - lava_callback - DEBUG - Processing node 69fa465ea9d11f026cebf1af: baseline-arm64 2026-05-05 21:05:59,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:05:59,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:05:59,965 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa465ea9d11f026cebf1af/log.txt.gz 2026-05-05 21:06:00,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:06:00,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:06:00,419 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa465ea9d11f026cebf1af/lava-logs.yaml 2026-05-05 21:06:00,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:06:00,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:06:00,747 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa465ea9d11f026cebf1af/lava_callback.json.gz 2026-05-05 21:06:00,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:06:00,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa465ea9d11f026cebf1af HTTP/1.1" 200 None 2026-05-05 21:06:00,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:06:00,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 21:06:00,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:06:00,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa465ea9d11f026cebf1af HTTP/1.1" 200 None 2026-05-05 21:06:00,914 - lava_callback - INFO - Completed processing callback for node 69fa465ea9d11f026cebf1af INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:06:12,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:06:12,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:06:32,108 - lava_callback - INFO - Received callback for node 69f7b8cf096243809b56e374 INFO: 172.21.0.1:56276 - "POST /node/69f7b8cf096243809b56e374 HTTP/1.0" 202 Accepted 2026-05-05 21:06:32,113 - lava_callback - INFO - Starting async job submit for node 69f7b8cf096243809b56e374 2026-05-05 21:06:32,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:06:32,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b8cf096243809b56e374 HTTP/1.1" 200 None 2026-05-05 21:06:32,129 - lava_callback - DEBUG - Processing node 69f7b8cf096243809b56e374: baseline-arm-baylibre 2026-05-05 21:06:32,129 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b8cf096243809b56e374 2026-05-05 21:06:32,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:06:32,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b8cf096243809b56e374 HTTP/1.1" 200 None 2026-05-05 21:06:32,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:06:32,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:06:32,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:06:32,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b8cf096243809b56e374 HTTP/1.1" 200 None 2026-05-05 21:06:32,175 - lava_callback - ERROR - Error processing callback for node 69f7b8cf096243809b56e374: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56290 - "GET /node/69934b1a523507f3806a550a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43480 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:07:12,005 - lava_callback - INFO - Received callback for node 69f7b8f3096243809b56e383 INFO: 172.21.0.1:38234 - "POST /node/69f7b8f3096243809b56e383 HTTP/1.0" 202 Accepted 2026-05-05 21:07:12,011 - lava_callback - INFO - Starting async job submit for node 69f7b8f3096243809b56e383 2026-05-05 21:07:12,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:07:12,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b8f3096243809b56e383 HTTP/1.1" 200 None 2026-05-05 21:07:12,027 - lava_callback - DEBUG - Processing node 69f7b8f3096243809b56e383: baseline-arm-baylibre 2026-05-05 21:07:12,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b8f3096243809b56e383 2026-05-05 21:07:12,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:07:12,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b8f3096243809b56e383 HTTP/1.1" 200 None 2026-05-05 21:07:12,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:07:12,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:07:12,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:07:12,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b8f3096243809b56e383 HTTP/1.1" 200 None 2026-05-05 21:07:12,090 - lava_callback - ERROR - Error processing callback for node 69f7b8f3096243809b56e383: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51746 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:07:52,070 - lava_callback - INFO - Received callback for node 69f7b917096243809b56e396 INFO: 172.21.0.1:47508 - "POST /node/69f7b917096243809b56e396 HTTP/1.0" 202 Accepted 2026-05-05 21:07:52,076 - lava_callback - INFO - Starting async job submit for node 69f7b917096243809b56e396 2026-05-05 21:07:52,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:07:52,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b917096243809b56e396 HTTP/1.1" 200 None 2026-05-05 21:07:52,099 - lava_callback - DEBUG - Processing node 69f7b917096243809b56e396: baseline-arm-baylibre 2026-05-05 21:07:52,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b917096243809b56e396 2026-05-05 21:07:52,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:07:52,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b917096243809b56e396 HTTP/1.1" 200 None 2026-05-05 21:07:52,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:07:52,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-05 21:07:52,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:07:52,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b917096243809b56e396 HTTP/1.1" 200 None 2026-05-05 21:07:52,169 - lava_callback - ERROR - Error processing callback for node 69f7b917096243809b56e396: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:08:32,075 - lava_callback - INFO - Received callback for node 69f7b93b096243809b56e3a5 INFO: 172.21.0.1:32938 - "POST /node/69f7b93b096243809b56e3a5 HTTP/1.0" 202 Accepted 2026-05-05 21:08:32,080 - lava_callback - INFO - Starting async job submit for node 69f7b93b096243809b56e3a5 2026-05-05 21:08:32,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:08:32,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b93b096243809b56e3a5 HTTP/1.1" 200 None 2026-05-05 21:08:32,096 - lava_callback - DEBUG - Processing node 69f7b93b096243809b56e3a5: baseline-arm-baylibre 2026-05-05 21:08:32,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b93b096243809b56e3a5 2026-05-05 21:08:32,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:08:32,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b93b096243809b56e3a5 HTTP/1.1" 200 None 2026-05-05 21:08:32,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:08:32,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2023113aba9734a494540 HTTP/1.1" 200 None 2026-05-05 21:08:32,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:08:32,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b93b096243809b56e3a5 HTTP/1.1" 200 None 2026-05-05 21:08:32,151 - lava_callback - ERROR - Error processing callback for node 69f7b93b096243809b56e3a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59756 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:08:52,488 - lava_callback - INFO - Received callback for node 69f7b960096243809b56e3b3 INFO: 172.21.0.1:46918 - "POST /node/69f7b960096243809b56e3b3 HTTP/1.0" 202 Accepted 2026-05-05 21:08:52,493 - lava_callback - INFO - Starting async job submit for node 69f7b960096243809b56e3b3 2026-05-05 21:08:52,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:08:52,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b960096243809b56e3b3 HTTP/1.1" 200 None 2026-05-05 21:08:52,529 - lava_callback - DEBUG - Processing node 69f7b960096243809b56e3b3: baseline-arm-clabbe 2026-05-05 21:08:52,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b960096243809b56e3b3 2026-05-05 21:08:52,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:08:52,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b960096243809b56e3b3 HTTP/1.1" 200 None 2026-05-05 21:08:52,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:08:52,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:08:52,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:08:52,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b960096243809b56e3b3 HTTP/1.1" 200 None 2026-05-05 21:08:52,576 - lava_callback - ERROR - Error processing callback for node 69f7b960096243809b56e3b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:09:32,444 - lava_callback - INFO - Received callback for node 69f7b984096243809b56e3c4 INFO: 172.21.0.1:56392 - "POST /node/69f7b984096243809b56e3c4 HTTP/1.0" 202 Accepted 2026-05-05 21:09:32,450 - lava_callback - INFO - Starting async job submit for node 69f7b984096243809b56e3c4 2026-05-05 21:09:32,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:09:32,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b984096243809b56e3c4 HTTP/1.1" 200 None 2026-05-05 21:09:32,472 - lava_callback - DEBUG - Processing node 69f7b984096243809b56e3c4: baseline-arm-clabbe 2026-05-05 21:09:32,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b984096243809b56e3c4 2026-05-05 21:09:32,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:09:32,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b984096243809b56e3c4 HTTP/1.1" 200 None 2026-05-05 21:09:32,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:09:32,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:09:32,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:09:32,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b984096243809b56e3c4 HTTP/1.1" 200 None 2026-05-05 21:09:32,521 - lava_callback - ERROR - Error processing callback for node 69f7b984096243809b56e3c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET /node/68f5c2a7b416eab2dc8d760b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:10:12,249 - lava_callback - INFO - Received callback for node 69f7b9a5096243809b56e3d3 INFO: 172.21.0.1:42586 - "POST /node/69f7b9a5096243809b56e3d3 HTTP/1.0" 202 Accepted 2026-05-05 21:10:12,254 - lava_callback - INFO - Starting async job submit for node 69f7b9a5096243809b56e3d3 2026-05-05 21:10:12,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:10:12,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b9a5096243809b56e3d3 HTTP/1.1" 200 None 2026-05-05 21:10:12,270 - lava_callback - DEBUG - Processing node 69f7b9a5096243809b56e3d3: baseline-arm-baylibre 2026-05-05 21:10:12,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b9a5096243809b56e3d3 2026-05-05 21:10:12,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:10:12,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b9a5096243809b56e3d3 HTTP/1.1" 200 None 2026-05-05 21:10:12,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:10:12,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:10:12,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:10:12,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b9a5096243809b56e3d3 HTTP/1.1" 200 None 2026-05-05 21:10:12,316 - lava_callback - ERROR - Error processing callback for node 69f7b9a5096243809b56e3d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38674 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:10:52,608 - lava_callback - INFO - Received callback for node 69f7b9cc096243809b56e3dd INFO: 172.21.0.1:36526 - "POST /node/69f7b9cc096243809b56e3dd HTTP/1.0" 202 Accepted 2026-05-05 21:10:52,614 - lava_callback - INFO - Starting async job submit for node 69f7b9cc096243809b56e3dd 2026-05-05 21:10:52,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:10:52,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b9cc096243809b56e3dd HTTP/1.1" 200 None 2026-05-05 21:10:52,630 - lava_callback - DEBUG - Processing node 69f7b9cc096243809b56e3dd: baseline-arm-clabbe 2026-05-05 21:10:52,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b9cc096243809b56e3dd 2026-05-05 21:10:52,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:10:52,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b9cc096243809b56e3dd HTTP/1.1" 200 None 2026-05-05 21:10:52,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:10:52,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:10:52,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:10:52,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b9cc096243809b56e3dd HTTP/1.1" 200 None 2026-05-05 21:10:52,675 - lava_callback - ERROR - Error processing callback for node 69f7b9cc096243809b56e3dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:11:18,176 - lava_callback - INFO - Received callback for node 69fa479ea9d11f026cebf23a INFO: 172.21.0.1:54818 - "POST /node/69fa479ea9d11f026cebf23a HTTP/1.0" 202 Accepted 2026-05-05 21:11:18,183 - lava_callback - INFO - Starting async job submit for node 69fa479ea9d11f026cebf23a 2026-05-05 21:11:18,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:18,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa479ea9d11f026cebf23a HTTP/1.1" 200 None 2026-05-05 21:11:18,222 - lava_callback - DEBUG - Processing node 69fa479ea9d11f026cebf23a: baseline-arm64 2026-05-05 21:11:18,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:11:18,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:11:18,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa479ea9d11f026cebf23a/log.txt.gz 2026-05-05 21:11:19,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:11:19,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:11:19,331 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa479ea9d11f026cebf23a/lava-logs.yaml 2026-05-05 21:11:19,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:11:19,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:11:19,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa479ea9d11f026cebf23a/lava_callback.json.gz 2026-05-05 21:11:19,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:19,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa479ea9d11f026cebf23a HTTP/1.1" 200 None 2026-05-05 21:11:19,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:19,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-05 21:11:19,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:19,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa479ea9d11f026cebf23a HTTP/1.1" 200 None 2026-05-05 21:11:19,582 - lava_callback - INFO - Completed processing callback for node 69fa479ea9d11f026cebf23a INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:11:32,513 - lava_callback - INFO - Received callback for node 69f7b9f0096243809b56e3eb INFO: 172.21.0.1:60216 - "POST /node/69f7b9f0096243809b56e3eb HTTP/1.0" 202 Accepted 2026-05-05 21:11:32,518 - lava_callback - INFO - Starting async job submit for node 69f7b9f0096243809b56e3eb 2026-05-05 21:11:32,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:32,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b9f0096243809b56e3eb HTTP/1.1" 200 None 2026-05-05 21:11:32,535 - lava_callback - DEBUG - Processing node 69f7b9f0096243809b56e3eb: baseline-arm-clabbe 2026-05-05 21:11:32,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7b9f0096243809b56e3eb 2026-05-05 21:11:32,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:32,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7b9f0096243809b56e3eb HTTP/1.1" 200 None 2026-05-05 21:11:32,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:32,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:11:32,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:32,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7b9f0096243809b56e3eb HTTP/1.1" 200 None 2026-05-05 21:11:32,585 - lava_callback - ERROR - Error processing callback for node 69f7b9f0096243809b56e3eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:11:42,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:42,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:11:52,367 - lava_callback - INFO - Received callback for node 69f7ba12096243809b56e3fb INFO: 172.21.0.1:35752 - "POST /node/69f7ba12096243809b56e3fb HTTP/1.0" 202 Accepted 2026-05-05 21:11:52,374 - lava_callback - INFO - Starting async job submit for node 69f7ba12096243809b56e3fb 2026-05-05 21:11:52,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:52,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ba12096243809b56e3fb HTTP/1.1" 200 None 2026-05-05 21:11:52,394 - lava_callback - DEBUG - Processing node 69f7ba12096243809b56e3fb: baseline-arm-baylibre 2026-05-05 21:11:52,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ba12096243809b56e3fb 2026-05-05 21:11:52,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:52,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ba12096243809b56e3fb HTTP/1.1" 200 None 2026-05-05 21:11:52,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:52,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:11:52,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:11:52,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ba12096243809b56e3fb HTTP/1.1" 200 None 2026-05-05 21:11:52,439 - lava_callback - ERROR - Error processing callback for node 69f7ba12096243809b56e3fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50842 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:12:32,292 - lava_callback - INFO - Received callback for node 69f7ba36096243809b56e40c INFO: 172.21.0.1:35478 - "POST /node/69f7ba36096243809b56e40c HTTP/1.0" 202 Accepted 2026-05-05 21:12:32,297 - lava_callback - INFO - Starting async job submit for node 69f7ba36096243809b56e40c 2026-05-05 21:12:32,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:12:32,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ba36096243809b56e40c HTTP/1.1" 200 None 2026-05-05 21:12:32,329 - lava_callback - DEBUG - Processing node 69f7ba36096243809b56e40c: baseline-arm-baylibre 2026-05-05 21:12:32,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ba36096243809b56e40c 2026-05-05 21:12:32,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:12:32,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ba36096243809b56e40c HTTP/1.1" 200 None 2026-05-05 21:12:32,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:12:32,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:12:32,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:12:32,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ba36096243809b56e40c HTTP/1.1" 200 None 2026-05-05 21:12:32,375 - lava_callback - ERROR - Error processing callback for node 69f7ba36096243809b56e40c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32824 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:13:12,683 - lava_callback - INFO - Received callback for node 69f7ba5b096243809b56e41d INFO: 172.21.0.1:39270 - "POST /node/69f7ba5b096243809b56e41d HTTP/1.0" 202 Accepted 2026-05-05 21:13:12,688 - lava_callback - INFO - Starting async job submit for node 69f7ba5b096243809b56e41d 2026-05-05 21:13:12,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:13:12,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ba5b096243809b56e41d HTTP/1.1" 200 None 2026-05-05 21:13:12,703 - lava_callback - DEBUG - Processing node 69f7ba5b096243809b56e41d: baseline-arm-clabbe 2026-05-05 21:13:12,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ba5b096243809b56e41d 2026-05-05 21:13:12,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:13:12,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ba5b096243809b56e41d HTTP/1.1" 200 None 2026-05-05 21:13:12,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:13:12,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:13:12,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:13:12,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ba5b096243809b56e41d HTTP/1.1" 200 None 2026-05-05 21:13:12,749 - lava_callback - ERROR - Error processing callback for node 69f7ba5b096243809b56e41d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58832 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:13:52,674 - lava_callback - INFO - Received callback for node 69f7ba7f096243809b56e42a INFO: 172.21.0.1:37426 - "POST /node/69f7ba7f096243809b56e42a HTTP/1.0" 202 Accepted 2026-05-05 21:13:52,680 - lava_callback - INFO - Starting async job submit for node 69f7ba7f096243809b56e42a 2026-05-05 21:13:52,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:13:52,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ba7f096243809b56e42a HTTP/1.1" 200 None 2026-05-05 21:13:52,694 - lava_callback - DEBUG - Processing node 69f7ba7f096243809b56e42a: baseline-arm-clabbe 2026-05-05 21:13:52,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ba7f096243809b56e42a 2026-05-05 21:13:52,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:13:52,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ba7f096243809b56e42a HTTP/1.1" 200 None 2026-05-05 21:13:52,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:13:52,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:13:52,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:13:52,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ba7f096243809b56e42a HTTP/1.1" 200 None 2026-05-05 21:13:52,739 - lava_callback - ERROR - Error processing callback for node 69f7ba7f096243809b56e42a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:14:18,740 - lava_callback - INFO - Received callback for node 69fa48b2a9d11f026cebf27b INFO: 172.21.0.1:43744 - "POST /node/69fa48b2a9d11f026cebf27b HTTP/1.0" 202 Accepted 2026-05-05 21:14:18,747 - lava_callback - INFO - Starting async job submit for node 69fa48b2a9d11f026cebf27b 2026-05-05 21:14:18,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:18,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa48b2a9d11f026cebf27b HTTP/1.1" 200 None 2026-05-05 21:14:18,786 - lava_callback - DEBUG - Processing node 69fa48b2a9d11f026cebf27b: baseline-nfs-arm64 2026-05-05 21:14:19,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:14:19,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:14:19,493 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa48b2a9d11f026cebf27b/log.txt.gz 2026-05-05 21:14:19,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:14:19,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:14:19,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa48b2a9d11f026cebf27b/lava-logs.yaml 2026-05-05 21:14:19,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:14:20,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:14:20,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa48b2a9d11f026cebf27b/lava_callback.json.gz 2026-05-05 21:14:20,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:20,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa48b2a9d11f026cebf27b HTTP/1.1" 200 None 2026-05-05 21:14:20,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:20,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-05 21:14:20,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:20,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa48b2a9d11f026cebf27b HTTP/1.1" 200 None 2026-05-05 21:14:20,200 - lava_callback - INFO - Completed processing callback for node 69fa48b2a9d11f026cebf27b INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:14:32,658 - lava_callback - INFO - Received callback for node 69f7baa3096243809b56e43a INFO: 172.21.0.1:42608 - "POST /node/69f7baa3096243809b56e43a HTTP/1.0" 202 Accepted 2026-05-05 21:14:32,664 - lava_callback - INFO - Starting async job submit for node 69f7baa3096243809b56e43a 2026-05-05 21:14:32,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:32,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7baa3096243809b56e43a HTTP/1.1" 200 None 2026-05-05 21:14:32,679 - lava_callback - DEBUG - Processing node 69f7baa3096243809b56e43a: baseline-arm-clabbe 2026-05-05 21:14:32,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7baa3096243809b56e43a 2026-05-05 21:14:32,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:32,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7baa3096243809b56e43a HTTP/1.1" 200 None 2026-05-05 21:14:32,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:32,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:14:32,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:32,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7baa3096243809b56e43a HTTP/1.1" 200 None 2026-05-05 21:14:32,725 - lava_callback - ERROR - Error processing callback for node 69f7baa3096243809b56e43a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:14:42,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:43,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47280 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:14:52,697 - lava_callback - INFO - Received callback for node 69f7bac7096243809b56e448 INFO: 172.21.0.1:41080 - "POST /node/69f7bac7096243809b56e448 HTTP/1.0" 202 Accepted 2026-05-05 21:14:52,703 - lava_callback - INFO - Starting async job submit for node 69f7bac7096243809b56e448 2026-05-05 21:14:52,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:52,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bac7096243809b56e448 HTTP/1.1" 200 None 2026-05-05 21:14:52,719 - lava_callback - DEBUG - Processing node 69f7bac7096243809b56e448: baseline-arm-clabbe 2026-05-05 21:14:52,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7bac7096243809b56e448 2026-05-05 21:14:52,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:52,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bac7096243809b56e448 HTTP/1.1" 200 None 2026-05-05 21:14:52,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:52,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:14:52,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:14:52,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7bac7096243809b56e448 HTTP/1.1" 200 None 2026-05-05 21:14:52,784 - lava_callback - ERROR - Error processing callback for node 69f7bac7096243809b56e448: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35454 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:15:32,734 - lava_callback - INFO - Received callback for node 69f7baeb096243809b56e456 INFO: 172.21.0.1:57512 - "POST /node/69f7baeb096243809b56e456 HTTP/1.0" 202 Accepted 2026-05-05 21:15:32,743 - lava_callback - INFO - Starting async job submit for node 69f7baeb096243809b56e456 2026-05-05 21:15:32,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:15:32,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7baeb096243809b56e456 HTTP/1.1" 200 None 2026-05-05 21:15:32,759 - lava_callback - DEBUG - Processing node 69f7baeb096243809b56e456: baseline-arm-clabbe 2026-05-05 21:15:32,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7baeb096243809b56e456 2026-05-05 21:15:32,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:15:32,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7baeb096243809b56e456 HTTP/1.1" 200 None 2026-05-05 21:15:32,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:15:32,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:15:32,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:15:32,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7baeb096243809b56e456 HTTP/1.1" 200 None 2026-05-05 21:15:32,823 - lava_callback - ERROR - Error processing callback for node 69f7baeb096243809b56e456: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:15:53,266 - lava_callback - INFO - Received callback for node 69fa48fea9d11f026cebf29f INFO: 172.21.0.1:43642 - "POST /node/69fa48fea9d11f026cebf29f HTTP/1.0" 202 Accepted 2026-05-05 21:15:53,272 - lava_callback - INFO - Starting async job submit for node 69fa48fea9d11f026cebf29f 2026-05-05 21:15:53,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:15:53,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa48fea9d11f026cebf29f HTTP/1.1" 200 None 2026-05-05 21:15:53,312 - lava_callback - DEBUG - Processing node 69fa48fea9d11f026cebf29f: baseline-arm64 2026-05-05 21:15:53,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:15:53,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:15:53,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa48fea9d11f026cebf29f/log.txt.gz 2026-05-05 21:15:54,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:15:54,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:15:54,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa48fea9d11f026cebf29f/lava-logs.yaml 2026-05-05 21:15:54,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:15:54,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:15:54,466 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa48fea9d11f026cebf29f/lava_callback.json.gz 2026-05-05 21:15:54,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:15:54,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa48fea9d11f026cebf29f HTTP/1.1" 200 None 2026-05-05 21:15:54,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:15:54,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 21:15:54,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:15:54,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa48fea9d11f026cebf29f HTTP/1.1" 200 None 2026-05-05 21:15:54,578 - lava_callback - INFO - Completed processing callback for node 69fa48fea9d11f026cebf29f INFO: 172.21.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39544 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:16:12,697 - lava_callback - INFO - Received callback for node 69f7bb10096243809b56e465 INFO: 172.21.0.1:52582 - "POST /node/69f7bb10096243809b56e465 HTTP/1.0" 202 Accepted 2026-05-05 21:16:12,702 - lava_callback - INFO - Starting async job submit for node 69f7bb10096243809b56e465 2026-05-05 21:16:12,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:16:12,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bb10096243809b56e465 HTTP/1.1" 200 None 2026-05-05 21:16:12,718 - lava_callback - DEBUG - Processing node 69f7bb10096243809b56e465: baseline-arm-clabbe 2026-05-05 21:16:12,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7bb10096243809b56e465 2026-05-05 21:16:12,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:16:12,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bb10096243809b56e465 HTTP/1.1" 200 None 2026-05-05 21:16:12,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:16:12,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:16:12,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:16:12,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7bb10096243809b56e465 HTTP/1.1" 200 None 2026-05-05 21:16:12,769 - lava_callback - ERROR - Error processing callback for node 69f7bb10096243809b56e465: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 21:16:13,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:16:13,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:16:52,737 - lava_callback - INFO - Received callback for node 69f7bb35096243809b56e475 INFO: 172.21.0.1:44146 - "POST /node/69f7bb35096243809b56e475 HTTP/1.0" 202 Accepted 2026-05-05 21:16:52,743 - lava_callback - INFO - Starting async job submit for node 69f7bb35096243809b56e475 2026-05-05 21:16:52,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:16:52,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bb35096243809b56e475 HTTP/1.1" 200 None 2026-05-05 21:16:52,758 - lava_callback - DEBUG - Processing node 69f7bb35096243809b56e475: baseline-arm-clabbe 2026-05-05 21:16:52,758 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7bb35096243809b56e475 2026-05-05 21:16:52,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:16:52,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bb35096243809b56e475 HTTP/1.1" 200 None 2026-05-05 21:16:52,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:16:52,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:16:52,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:16:52,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7bb35096243809b56e475 HTTP/1.1" 200 None 2026-05-05 21:16:52,802 - lava_callback - ERROR - Error processing callback for node 69f7bb35096243809b56e475: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54072 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:17:32,754 - lava_callback - INFO - Received callback for node 69f7bb59096243809b56e484 INFO: 172.21.0.1:33164 - "POST /node/69f7bb59096243809b56e484 HTTP/1.0" 202 Accepted 2026-05-05 21:17:32,759 - lava_callback - INFO - Starting async job submit for node 69f7bb59096243809b56e484 2026-05-05 21:17:32,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:17:32,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bb59096243809b56e484 HTTP/1.1" 200 None 2026-05-05 21:17:32,777 - lava_callback - DEBUG - Processing node 69f7bb59096243809b56e484: baseline-arm-clabbe 2026-05-05 21:17:32,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7bb59096243809b56e484 2026-05-05 21:17:32,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:17:32,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bb59096243809b56e484 HTTP/1.1" 200 None 2026-05-05 21:17:32,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:17:32,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:17:32,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:17:32,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7bb59096243809b56e484 HTTP/1.1" 200 None 2026-05-05 21:17:32,823 - lava_callback - ERROR - Error processing callback for node 69f7bb59096243809b56e484: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33200 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:18:12,807 - lava_callback - INFO - Received callback for node 69f7bb7e096243809b56e497 INFO: 172.21.0.1:34056 - "POST /node/69f7bb7e096243809b56e497 HTTP/1.0" 202 Accepted 2026-05-05 21:18:12,813 - lava_callback - INFO - Starting async job submit for node 69f7bb7e096243809b56e497 2026-05-05 21:18:12,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:18:12,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bb7e096243809b56e497 HTTP/1.1" 200 None 2026-05-05 21:18:12,835 - lava_callback - DEBUG - Processing node 69f7bb7e096243809b56e497: baseline-arm-clabbe 2026-05-05 21:18:12,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7bb7e096243809b56e497 2026-05-05 21:18:12,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:18:12,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bb7e096243809b56e497 HTTP/1.1" 200 None 2026-05-05 21:18:12,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:18:12,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:18:12,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:18:12,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7bb7e096243809b56e497 HTTP/1.1" 200 None 2026-05-05 21:18:12,896 - lava_callback - ERROR - Error processing callback for node 69f7bb7e096243809b56e497: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:19:11,260 - lava_callback - INFO - Received callback for node 69fa4954a9d11f026cebf2c3 INFO: 172.21.0.1:35958 - "POST /node/69fa4954a9d11f026cebf2c3 HTTP/1.0" 202 Accepted 2026-05-05 21:19:11,267 - lava_callback - INFO - Starting async job submit for node 69fa4954a9d11f026cebf2c3 2026-05-05 21:19:11,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:19:11,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa4954a9d11f026cebf2c3 HTTP/1.1" 200 None 2026-05-05 21:19:11,308 - lava_callback - DEBUG - Processing node 69fa4954a9d11f026cebf2c3: baseline-nfs-arm64 2026-05-05 21:19:11,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:19:12,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:19:12,028 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa4954a9d11f026cebf2c3/log.txt.gz 2026-05-05 21:19:12,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:19:12,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:19:12,486 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa4954a9d11f026cebf2c3/lava-logs.yaml 2026-05-05 21:19:12,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:19:12,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:19:12,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa4954a9d11f026cebf2c3/lava_callback.json.gz 2026-05-05 21:19:12,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:19:12,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa4954a9d11f026cebf2c3 HTTP/1.1" 200 None 2026-05-05 21:19:12,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:19:12,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 21:19:12,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:19:12,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa4954a9d11f026cebf2c3 HTTP/1.1" 200 None 2026-05-05 21:19:12,730 - lava_callback - INFO - Completed processing callback for node 69fa4954a9d11f026cebf2c3 2026-05-05 21:19:12,846 - lava_callback - INFO - Received callback for node 69f7bbcd096243809b56e4a9 INFO: 172.21.0.1:35964 - "POST /node/69f7bbcd096243809b56e4a9 HTTP/1.0" 202 Accepted 2026-05-05 21:19:12,854 - lava_callback - INFO - Starting async job submit for node 69f7bbcd096243809b56e4a9 2026-05-05 21:19:12,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:19:12,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bbcd096243809b56e4a9 HTTP/1.1" 200 None 2026-05-05 21:19:12,871 - lava_callback - DEBUG - Processing node 69f7bbcd096243809b56e4a9: baseline-arm-clabbe 2026-05-05 21:19:12,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7bbcd096243809b56e4a9 2026-05-05 21:19:12,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:19:12,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bbcd096243809b56e4a9 HTTP/1.1" 200 None 2026-05-05 21:19:12,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:19:12,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f461916f80da3b312261ad HTTP/1.1" 200 None 2026-05-05 21:19:12,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:19:12,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7bbcd096243809b56e4a9 HTTP/1.1" 200 None 2026-05-05 21:19:12,916 - lava_callback - ERROR - Error processing callback for node 69f7bbcd096243809b56e4a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-05 21:19:13,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:19:13,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42856 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:26:21,646 - lava_callback - INFO - Received callback for node 69fa5883a9d11f026cebf44b INFO: 172.21.0.1:45222 - "POST /node/69fa5883a9d11f026cebf44b HTTP/1.0" 202 Accepted 2026-05-05 21:26:21,653 - lava_callback - INFO - Starting async job submit for node 69fa5883a9d11f026cebf44b 2026-05-05 21:26:21,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:26:21,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa5883a9d11f026cebf44b HTTP/1.1" 200 None 2026-05-05 21:26:21,697 - lava_callback - DEBUG - Processing node 69fa5883a9d11f026cebf44b: baseline-arm64 2026-05-05 21:26:22,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:26:22,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:26:22,429 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa5883a9d11f026cebf44b/log.txt.gz 2026-05-05 21:26:22,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:26:22,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:26:22,864 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa5883a9d11f026cebf44b/lava-logs.yaml 2026-05-05 21:26:22,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:26:23,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:26:23,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa5883a9d11f026cebf44b/lava_callback.json.gz 2026-05-05 21:26:23,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:26:23,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa5883a9d11f026cebf44b HTTP/1.1" 200 None 2026-05-05 21:26:23,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:26:23,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 21:26:23,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:26:23,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa5883a9d11f026cebf44b HTTP/1.1" 200 None 2026-05-05 21:26:23,160 - lava_callback - INFO - Completed processing callback for node 69fa5883a9d11f026cebf44b INFO: 172.21.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43758 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:26:43,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:26:43,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55018 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:27:46,381 - lava_callback - INFO - Received callback for node 69fa596ba9d11f026cebf4b0 INFO: 172.21.0.1:57554 - "POST /node/69fa596ba9d11f026cebf4b0 HTTP/1.0" 202 Accepted 2026-05-05 21:27:46,388 - lava_callback - INFO - Starting async job submit for node 69fa596ba9d11f026cebf4b0 2026-05-05 21:27:46,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:27:46,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa596ba9d11f026cebf4b0 HTTP/1.1" 200 None 2026-05-05 21:27:46,429 - lava_callback - DEBUG - Processing node 69fa596ba9d11f026cebf4b0: baseline-nfs-arm64 INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:27:46,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:27:47,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:27:47,028 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa596ba9d11f026cebf4b0/log.txt.gz 2026-05-05 21:27:47,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:27:47,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:27:47,489 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa596ba9d11f026cebf4b0/lava-logs.yaml 2026-05-05 21:27:47,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:27:47,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:27:47,622 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa596ba9d11f026cebf4b0/lava_callback.json.gz 2026-05-05 21:27:47,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:27:47,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa596ba9d11f026cebf4b0 HTTP/1.1" 200 None INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:27:47,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:27:47,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 21:27:47,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:27:47,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa596ba9d11f026cebf4b0 HTTP/1.1" 200 None 2026-05-05 21:27:47,756 - lava_callback - INFO - Completed processing callback for node 69fa596ba9d11f026cebf4b0 INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:28:13,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:28:13,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:32:31,980 - lava_callback - INFO - Received callback for node 69fa5e8ba9d11f026cebf6e1 INFO: 172.21.0.1:44666 - "POST /node/69fa5e8ba9d11f026cebf6e1 HTTP/1.0" 202 Accepted 2026-05-05 21:32:31,987 - lava_callback - INFO - Starting async job submit for node 69fa5e8ba9d11f026cebf6e1 2026-05-05 21:32:32,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:32:32,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa5e8ba9d11f026cebf6e1 HTTP/1.1" 200 None 2026-05-05 21:32:32,056 - lava_callback - DEBUG - Processing node 69fa5e8ba9d11f026cebf6e1: baseline-nfs-arm64 2026-05-05 21:32:32,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:32:32,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:32:32,730 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa5e8ba9d11f026cebf6e1/log.txt.gz 2026-05-05 21:32:32,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:32:33,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:32:33,150 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa5e8ba9d11f026cebf6e1/lava-logs.yaml 2026-05-05 21:32:33,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:32:33,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:32:33,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa5e8ba9d11f026cebf6e1/lava_callback.json.gz 2026-05-05 21:32:33,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:32:33,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa5e8ba9d11f026cebf6e1 HTTP/1.1" 200 None 2026-05-05 21:32:33,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:32:33,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 21:32:33,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:32:33,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa5e8ba9d11f026cebf6e1 HTTP/1.1" 200 None 2026-05-05 21:32:33,382 - lava_callback - INFO - Completed processing callback for node 69fa5e8ba9d11f026cebf6e1 INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:32:43,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:32:43,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49744 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:35:33,764 - lava_callback - INFO - Received callback for node 69f7bf96096243809b56e4e6 INFO: 172.21.0.1:41012 - "POST /node/69f7bf96096243809b56e4e6 HTTP/1.0" 202 Accepted 2026-05-05 21:35:33,772 - lava_callback - INFO - Starting async job submit for node 69f7bf96096243809b56e4e6 2026-05-05 21:35:33,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:35:33,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bf96096243809b56e4e6 HTTP/1.1" 200 None 2026-05-05 21:35:33,786 - lava_callback - DEBUG - Processing node 69f7bf96096243809b56e4e6: baseline-arm64-baylibre 2026-05-05 21:35:33,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7bf96096243809b56e4e6 2026-05-05 21:35:33,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:35:33,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bf96096243809b56e4e6 HTTP/1.1" 200 None 2026-05-05 21:35:33,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:35:33,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:35:33,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:35:33,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7bf96096243809b56e4e6 HTTP/1.1" 200 None 2026-05-05 21:35:33,831 - lava_callback - ERROR - Error processing callback for node 69f7bf96096243809b56e4e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:35:40,084 - lava_callback - INFO - Received callback for node 69fa5f22a9d11f026cebf72c INFO: 172.21.0.1:44588 - "POST /node/69fa5f22a9d11f026cebf72c HTTP/1.0" 202 Accepted 2026-05-05 21:35:40,091 - lava_callback - INFO - Starting async job submit for node 69fa5f22a9d11f026cebf72c 2026-05-05 21:35:40,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:35:40,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa5f22a9d11f026cebf72c HTTP/1.1" 200 None 2026-05-05 21:35:40,130 - lava_callback - DEBUG - Processing node 69fa5f22a9d11f026cebf72c: baseline-arm64 2026-05-05 21:35:40,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:35:40,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:35:40,799 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa5f22a9d11f026cebf72c/log.txt.gz 2026-05-05 21:35:41,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:35:41,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:35:41,212 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa5f22a9d11f026cebf72c/lava-logs.yaml 2026-05-05 21:35:41,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:35:41,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:35:41,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa5f22a9d11f026cebf72c/lava_callback.json.gz 2026-05-05 21:35:41,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:35:41,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa5f22a9d11f026cebf72c HTTP/1.1" 200 None 2026-05-05 21:35:41,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:35:41,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 21:35:41,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:35:41,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa5f22a9d11f026cebf72c HTTP/1.1" 200 None 2026-05-05 21:35:41,497 - lava_callback - INFO - Completed processing callback for node 69fa5f22a9d11f026cebf72c 2026-05-05 21:35:43,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:35:43,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:36:53,616 - lava_callback - INFO - Received callback for node 69f7bfe6096243809b56e509 INFO: 172.21.0.1:58884 - "POST /node/69f7bfe6096243809b56e509 HTTP/1.0" 202 Accepted 2026-05-05 21:36:53,622 - lava_callback - INFO - Starting async job submit for node 69f7bfe6096243809b56e509 2026-05-05 21:36:53,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:36:53,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bfe6096243809b56e509 HTTP/1.1" 200 None 2026-05-05 21:36:53,637 - lava_callback - DEBUG - Processing node 69f7bfe6096243809b56e509: baseline-arm64-clabbe 2026-05-05 21:36:53,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7bfe6096243809b56e509 2026-05-05 21:36:53,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:36:53,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7bfe6096243809b56e509 HTTP/1.1" 200 None 2026-05-05 21:36:53,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:36:53,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:36:53,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:36:53,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7bfe6096243809b56e509 HTTP/1.1" 200 None 2026-05-05 21:36:53,691 - lava_callback - ERROR - Error processing callback for node 69f7bfe6096243809b56e509: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:38:13,727 - lava_callback - INFO - Received callback for node 69f7c030096243809b56e529 INFO: 172.21.0.1:53444 - "POST /node/69f7c030096243809b56e529 HTTP/1.0" 202 Accepted 2026-05-05 21:38:13,733 - lava_callback - INFO - Starting async job submit for node 69f7c030096243809b56e529 2026-05-05 21:38:13,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:38:13,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c030096243809b56e529 HTTP/1.1" 200 None 2026-05-05 21:38:13,748 - lava_callback - DEBUG - Processing node 69f7c030096243809b56e529: baseline-arm64-clabbe 2026-05-05 21:38:13,749 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c030096243809b56e529 2026-05-05 21:38:13,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:38:13,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c030096243809b56e529 HTTP/1.1" 200 None 2026-05-05 21:38:13,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:38:13,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:38:13,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:38:13,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c030096243809b56e529 HTTP/1.1" 200 None 2026-05-05 21:38:13,807 - lava_callback - ERROR - Error processing callback for node 69f7c030096243809b56e529: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:38:20,929 - lava_callback - INFO - Received callback for node 69fa60a7a9d11f026cebf7dc INFO: 172.21.0.1:48252 - "POST /node/69fa60a7a9d11f026cebf7dc HTTP/1.0" 202 Accepted 2026-05-05 21:38:20,935 - lava_callback - INFO - Starting async job submit for node 69fa60a7a9d11f026cebf7dc 2026-05-05 21:38:20,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:38:20,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa60a7a9d11f026cebf7dc HTTP/1.1" 200 None 2026-05-05 21:38:20,980 - lava_callback - DEBUG - Processing node 69fa60a7a9d11f026cebf7dc: baseline-arm64 2026-05-05 21:38:21,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:38:21,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:38:21,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa60a7a9d11f026cebf7dc/log.txt.gz 2026-05-05 21:38:21,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:38:22,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:38:22,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa60a7a9d11f026cebf7dc/lava-logs.yaml 2026-05-05 21:38:22,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:38:22,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:38:22,225 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa60a7a9d11f026cebf7dc/lava_callback.json.gz 2026-05-05 21:38:22,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:38:22,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa60a7a9d11f026cebf7dc HTTP/1.1" 200 None 2026-05-05 21:38:22,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:38:22,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-05 21:38:22,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:38:22,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa60a7a9d11f026cebf7dc HTTP/1.1" 200 None 2026-05-05 21:38:22,365 - lava_callback - INFO - Completed processing callback for node 69fa60a7a9d11f026cebf7dc INFO: 172.21.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:38:43,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:38:43,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:39:33,676 - lava_callback - INFO - Received callback for node 69f7c08b096243809b56e54b INFO: 172.21.0.1:56858 - "POST /node/69f7c08b096243809b56e54b HTTP/1.0" 202 Accepted 2026-05-05 21:39:33,682 - lava_callback - INFO - Starting async job submit for node 69f7c08b096243809b56e54b 2026-05-05 21:39:33,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:39:33,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c08b096243809b56e54b HTTP/1.1" 200 None 2026-05-05 21:39:33,697 - lava_callback - DEBUG - Processing node 69f7c08b096243809b56e54b: baseline-arm64-clabbe 2026-05-05 21:39:33,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c08b096243809b56e54b 2026-05-05 21:39:33,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:39:33,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c08b096243809b56e54b HTTP/1.1" 200 None 2026-05-05 21:39:33,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:39:33,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:39:33,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:39:33,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c08b096243809b56e54b HTTP/1.1" 200 None 2026-05-05 21:39:33,748 - lava_callback - ERROR - Error processing callback for node 69f7c08b096243809b56e54b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37294 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:40:53,783 - lava_callback - INFO - Received callback for node 69f7c0d7096243809b56e56f INFO: 172.21.0.1:58428 - "POST /node/69f7c0d7096243809b56e56f HTTP/1.0" 202 Accepted 2026-05-05 21:40:53,789 - lava_callback - INFO - Starting async job submit for node 69f7c0d7096243809b56e56f 2026-05-05 21:40:53,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:40:53,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c0d7096243809b56e56f HTTP/1.1" 200 None 2026-05-05 21:40:53,806 - lava_callback - DEBUG - Processing node 69f7c0d7096243809b56e56f: baseline-arm64-clabbe 2026-05-05 21:40:53,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c0d7096243809b56e56f 2026-05-05 21:40:53,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:40:53,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c0d7096243809b56e56f HTTP/1.1" 200 None 2026-05-05 21:40:53,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:40:53,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:40:53,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:40:53,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c0d7096243809b56e56f HTTP/1.1" 200 None 2026-05-05 21:40:53,852 - lava_callback - ERROR - Error processing callback for node 69f7c0d7096243809b56e56f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:41:04,540 - lava_callback - INFO - Received callback for node 69fa6195a9d11f026cebf846 INFO: 172.21.0.1:40172 - "POST /node/69fa6195a9d11f026cebf846 HTTP/1.0" 202 Accepted 2026-05-05 21:41:04,548 - lava_callback - INFO - Starting async job submit for node 69fa6195a9d11f026cebf846 2026-05-05 21:41:04,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:41:04,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa6195a9d11f026cebf846 HTTP/1.1" 200 None 2026-05-05 21:41:04,598 - lava_callback - DEBUG - Processing node 69fa6195a9d11f026cebf846: baseline-nfs-arm64 2026-05-05 21:41:05,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:41:05,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:41:05,254 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa6195a9d11f026cebf846/log.txt.gz 2026-05-05 21:41:05,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:41:05,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:41:05,677 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa6195a9d11f026cebf846/lava-logs.yaml 2026-05-05 21:41:05,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:41:05,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:41:05,800 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa6195a9d11f026cebf846/lava_callback.json.gz 2026-05-05 21:41:05,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:41:05,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa6195a9d11f026cebf846 HTTP/1.1" 200 None 2026-05-05 21:41:05,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:41:05,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-05 21:41:05,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:41:05,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa6195a9d11f026cebf846 HTTP/1.1" 200 None 2026-05-05 21:41:05,937 - lava_callback - INFO - Completed processing callback for node 69fa6195a9d11f026cebf846 INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:41:13,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:41:13,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:41:53,968 - lava_callback - INFO - Received callback for node 69f7c118096243809b56e58f INFO: 172.21.0.1:32780 - "POST /node/69f7c118096243809b56e58f HTTP/1.0" 202 Accepted 2026-05-05 21:41:53,974 - lava_callback - INFO - Starting async job submit for node 69f7c118096243809b56e58f 2026-05-05 21:41:53,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:41:53,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c118096243809b56e58f HTTP/1.1" 200 None 2026-05-05 21:41:53,991 - lava_callback - DEBUG - Processing node 69f7c118096243809b56e58f: baseline-arm64-baylibre 2026-05-05 21:41:53,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c118096243809b56e58f 2026-05-05 21:41:53,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:41:54,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c118096243809b56e58f HTTP/1.1" 200 None 2026-05-05 21:41:54,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:41:54,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:41:54,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:41:54,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c118096243809b56e58f HTTP/1.1" 200 None 2026-05-05 21:41:54,045 - lava_callback - ERROR - Error processing callback for node 69f7c118096243809b56e58f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56084 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:43:14,029 - lava_callback - INFO - Received callback for node 69f7c162096243809b56e5b3 INFO: 172.21.0.1:37020 - "POST /node/69f7c162096243809b56e5b3 HTTP/1.0" 202 Accepted 2026-05-05 21:43:14,035 - lava_callback - INFO - Starting async job submit for node 69f7c162096243809b56e5b3 2026-05-05 21:43:14,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:43:14,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c162096243809b56e5b3 HTTP/1.1" 200 None 2026-05-05 21:43:14,062 - lava_callback - DEBUG - Processing node 69f7c162096243809b56e5b3: baseline-arm64-baylibre 2026-05-05 21:43:14,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c162096243809b56e5b3 2026-05-05 21:43:14,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:43:14,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c162096243809b56e5b3 HTTP/1.1" 200 None 2026-05-05 21:43:14,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:43:14,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:43:14,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:43:14,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c162096243809b56e5b3 HTTP/1.1" 200 None 2026-05-05 21:43:14,127 - lava_callback - ERROR - Error processing callback for node 69f7c162096243809b56e5b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:44:14,017 - lava_callback - INFO - Received callback for node 69f7c1ac096243809b56e5d3 INFO: 172.21.0.1:50614 - "POST /node/69f7c1ac096243809b56e5d3 HTTP/1.0" 202 Accepted 2026-05-05 21:44:14,023 - lava_callback - INFO - Starting async job submit for node 69f7c1ac096243809b56e5d3 2026-05-05 21:44:14,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:44:14,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c1ac096243809b56e5d3 HTTP/1.1" 200 None 2026-05-05 21:44:14,045 - lava_callback - DEBUG - Processing node 69f7c1ac096243809b56e5d3: baseline-arm64-baylibre 2026-05-05 21:44:14,045 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c1ac096243809b56e5d3 2026-05-05 21:44:14,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:44:14,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c1ac096243809b56e5d3 HTTP/1.1" 200 None 2026-05-05 21:44:14,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:44:14,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:44:14,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:44:14,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c1ac096243809b56e5d3 HTTP/1.1" 200 None 2026-05-05 21:44:14,116 - lava_callback - ERROR - Error processing callback for node 69f7c1ac096243809b56e5d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:45:41,033 - lava_callback - INFO - Received callback for node 69fa6277a9d11f026cebf8b4 INFO: 172.21.0.1:57158 - "POST /node/69fa6277a9d11f026cebf8b4 HTTP/1.0" 202 Accepted 2026-05-05 21:45:41,040 - lava_callback - INFO - Starting async job submit for node 69fa6277a9d11f026cebf8b4 2026-05-05 21:45:41,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:45:41,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa6277a9d11f026cebf8b4 HTTP/1.1" 200 None 2026-05-05 21:45:41,079 - lava_callback - DEBUG - Processing node 69fa6277a9d11f026cebf8b4: baseline-arm64 2026-05-05 21:45:41,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:45:41,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:45:41,753 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa6277a9d11f026cebf8b4/log.txt.gz 2026-05-05 21:45:42,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:45:42,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:45:42,190 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa6277a9d11f026cebf8b4/lava-logs.yaml 2026-05-05 21:45:42,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:45:42,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:45:42,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa6277a9d11f026cebf8b4/lava_callback.json.gz 2026-05-05 21:45:42,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:45:42,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa6277a9d11f026cebf8b4 HTTP/1.1" 200 None 2026-05-05 21:45:42,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:45:42,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 21:45:42,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:45:42,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa6277a9d11f026cebf8b4 HTTP/1.1" 200 None 2026-05-05 21:45:42,491 - lava_callback - INFO - Completed processing callback for node 69fa6277a9d11f026cebf8b4 2026-05-05 21:45:43,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:45:43,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57186 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:45:53,958 - lava_callback - INFO - Received callback for node 69f7c1fc096243809b56e5fb INFO: 172.21.0.1:51430 - "POST /node/69f7c1fc096243809b56e5fb HTTP/1.0" 202 Accepted 2026-05-05 21:45:53,964 - lava_callback - INFO - Starting async job submit for node 69f7c1fc096243809b56e5fb 2026-05-05 21:45:53,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:45:53,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c1fc096243809b56e5fb HTTP/1.1" 200 None 2026-05-05 21:45:53,979 - lava_callback - DEBUG - Processing node 69f7c1fc096243809b56e5fb: baseline-arm64-clabbe 2026-05-05 21:45:53,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c1fc096243809b56e5fb 2026-05-05 21:45:53,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:45:53,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c1fc096243809b56e5fb HTTP/1.1" 200 None 2026-05-05 21:45:53,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:45:54,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:45:54,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:45:54,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c1fc096243809b56e5fb HTTP/1.1" 200 None 2026-05-05 21:45:54,026 - lava_callback - ERROR - Error processing callback for node 69f7c1fc096243809b56e5fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:46:54,175 - lava_callback - INFO - Received callback for node 69f7c23e096243809b56e618 INFO: 172.21.0.1:40214 - "POST /node/69f7c23e096243809b56e618 HTTP/1.0" 202 Accepted 2026-05-05 21:46:54,181 - lava_callback - INFO - Starting async job submit for node 69f7c23e096243809b56e618 2026-05-05 21:46:54,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:46:54,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c23e096243809b56e618 HTTP/1.1" 200 None 2026-05-05 21:46:54,197 - lava_callback - DEBUG - Processing node 69f7c23e096243809b56e618: baseline-arm64-baylibre 2026-05-05 21:46:54,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c23e096243809b56e618 2026-05-05 21:46:54,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:46:54,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c23e096243809b56e618 HTTP/1.1" 200 None 2026-05-05 21:46:54,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:46:54,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:46:54,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:46:54,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c23e096243809b56e618 HTTP/1.1" 200 None 2026-05-05 21:46:54,243 - lava_callback - ERROR - Error processing callback for node 69f7c23e096243809b56e618: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:48:14,036 - lava_callback - INFO - Received callback for node 69f7c28c096243809b56e642 INFO: 172.21.0.1:37632 - "POST /node/69f7c28c096243809b56e642 HTTP/1.0" 202 Accepted 2026-05-05 21:48:14,041 - lava_callback - INFO - Starting async job submit for node 69f7c28c096243809b56e642 2026-05-05 21:48:14,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:48:14,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c28c096243809b56e642 HTTP/1.1" 200 None 2026-05-05 21:48:14,057 - lava_callback - DEBUG - Processing node 69f7c28c096243809b56e642: baseline-arm64-clabbe 2026-05-05 21:48:14,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c28c096243809b56e642 2026-05-05 21:48:14,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:48:14,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c28c096243809b56e642 HTTP/1.1" 200 None 2026-05-05 21:48:14,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:48:14,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:48:14,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:48:14,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c28c096243809b56e642 HTTP/1.1" 200 None 2026-05-05 21:48:14,113 - lava_callback - ERROR - Error processing callback for node 69f7c28c096243809b56e642: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:49:14,604 - lava_callback - INFO - Received callback for node 69f7c2cf096243809b56e65c INFO: 172.21.0.1:35854 - "POST /node/69f7c2cf096243809b56e65c HTTP/1.0" 202 Accepted 2026-05-05 21:49:14,609 - lava_callback - INFO - Starting async job submit for node 69f7c2cf096243809b56e65c 2026-05-05 21:49:14,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:49:14,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c2cf096243809b56e65c HTTP/1.1" 200 None 2026-05-05 21:49:14,623 - lava_callback - DEBUG - Processing node 69f7c2cf096243809b56e65c: baseline-arm64-baylibre 2026-05-05 21:49:14,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c2cf096243809b56e65c 2026-05-05 21:49:14,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:49:14,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c2cf096243809b56e65c HTTP/1.1" 200 None 2026-05-05 21:49:14,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:49:14,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:49:14,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:49:14,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c2cf096243809b56e65c HTTP/1.1" 200 None 2026-05-05 21:49:14,710 - lava_callback - ERROR - Error processing callback for node 69f7c2cf096243809b56e65c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45316 - "GET /node/69934b1c523507f3806a5585%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45318 - "GET /node/68f07df06297fa1cbf4ae97d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35362 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:50:34,459 - lava_callback - INFO - Received callback for node 69f7c315096243809b56e67b INFO: 172.21.0.1:58190 - "POST /node/69f7c315096243809b56e67b HTTP/1.0" 202 Accepted 2026-05-05 21:50:34,465 - lava_callback - INFO - Starting async job submit for node 69f7c315096243809b56e67b 2026-05-05 21:50:34,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:50:34,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c315096243809b56e67b HTTP/1.1" 200 None 2026-05-05 21:50:34,481 - lava_callback - DEBUG - Processing node 69f7c315096243809b56e67b: baseline-arm64-baylibre 2026-05-05 21:50:34,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c315096243809b56e67b 2026-05-05 21:50:34,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:50:34,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c315096243809b56e67b HTTP/1.1" 200 None 2026-05-05 21:50:34,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:50:34,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-05 21:50:34,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:50:34,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c315096243809b56e67b HTTP/1.1" 200 None 2026-05-05 21:50:34,536 - lava_callback - ERROR - Error processing callback for node 69f7c315096243809b56e67b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:51:34,415 - lava_callback - INFO - Received callback for node 69f7c362096243809b56e6a1 INFO: 172.21.0.1:34318 - "POST /node/69f7c362096243809b56e6a1 HTTP/1.0" 202 Accepted 2026-05-05 21:51:34,421 - lava_callback - INFO - Starting async job submit for node 69f7c362096243809b56e6a1 2026-05-05 21:51:34,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:51:34,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c362096243809b56e6a1 HTTP/1.1" 200 None 2026-05-05 21:51:34,437 - lava_callback - DEBUG - Processing node 69f7c362096243809b56e6a1: baseline-arm64-baylibre 2026-05-05 21:51:34,437 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c362096243809b56e6a1 2026-05-05 21:51:34,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:51:34,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c362096243809b56e6a1 HTTP/1.1" 200 None 2026-05-05 21:51:34,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:51:34,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-05 21:51:34,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:51:34,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c362096243809b56e6a1 HTTP/1.1" 200 None 2026-05-05 21:51:34,501 - lava_callback - ERROR - Error processing callback for node 69f7c362096243809b56e6a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET /node/69943ac35ae459b9df3d55f2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48366 - "GET /node/699438a95ae459b9df3d4bff%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-05 21:52:54,528 - lava_callback - INFO - Received callback for node 69f7c3af096243809b56e6c2 INFO: 172.21.0.1:48372 - "POST /node/69f7c3af096243809b56e6c2 HTTP/1.0" 202 Accepted 2026-05-05 21:52:54,533 - lava_callback - INFO - Starting async job submit for node 69f7c3af096243809b56e6c2 2026-05-05 21:52:54,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:52:54,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c3af096243809b56e6c2 HTTP/1.1" 200 None 2026-05-05 21:52:54,555 - lava_callback - DEBUG - Processing node 69f7c3af096243809b56e6c2: baseline-arm64-baylibre 2026-05-05 21:52:54,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c3af096243809b56e6c2 2026-05-05 21:52:54,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:52:54,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c3af096243809b56e6c2 HTTP/1.1" 200 None 2026-05-05 21:52:54,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:52:54,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:52:54,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:52:54,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c3af096243809b56e6c2 HTTP/1.1" 200 None 2026-05-05 21:52:54,605 - lava_callback - ERROR - Error processing callback for node 69f7c3af096243809b56e6c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET /node/6992e50031166481c8dd6ebe%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42078 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:54:14,702 - lava_callback - INFO - Received callback for node 69f7c3f8096243809b56e6e8 INFO: 172.21.0.1:49268 - "POST /node/69f7c3f8096243809b56e6e8 HTTP/1.0" 202 Accepted 2026-05-05 21:54:14,708 - lava_callback - INFO - Starting async job submit for node 69f7c3f8096243809b56e6e8 2026-05-05 21:54:14,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:54:14,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c3f8096243809b56e6e8 HTTP/1.1" 200 None 2026-05-05 21:54:14,723 - lava_callback - DEBUG - Processing node 69f7c3f8096243809b56e6e8: baseline-arm64-baylibre 2026-05-05 21:54:14,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c3f8096243809b56e6e8 2026-05-05 21:54:14,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:54:14,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c3f8096243809b56e6e8 HTTP/1.1" 200 None 2026-05-05 21:54:14,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:54:14,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-05 21:54:14,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:54:14,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c3f8096243809b56e6e8 HTTP/1.1" 200 None 2026-05-05 21:54:14,796 - lava_callback - ERROR - Error processing callback for node 69f7c3f8096243809b56e6e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54342 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:55:34,354 - lava_callback - INFO - Received callback for node 69f7c44b096243809b56e707 INFO: 172.21.0.1:41670 - "POST /node/69f7c44b096243809b56e707 HTTP/1.0" 202 Accepted 2026-05-05 21:55:34,360 - lava_callback - INFO - Starting async job submit for node 69f7c44b096243809b56e707 2026-05-05 21:55:34,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:55:34,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c44b096243809b56e707 HTTP/1.1" 200 None 2026-05-05 21:55:34,383 - lava_callback - DEBUG - Processing node 69f7c44b096243809b56e707: baseline-arm64-clabbe 2026-05-05 21:55:34,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c44b096243809b56e707 2026-05-05 21:55:34,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:55:34,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c44b096243809b56e707 HTTP/1.1" 200 None 2026-05-05 21:55:34,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:55:34,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:55:34,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:55:34,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c44b096243809b56e707 HTTP/1.1" 200 None 2026-05-05 21:55:34,437 - lava_callback - ERROR - Error processing callback for node 69f7c44b096243809b56e707: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET /node/69861721177ca0f097bd09b9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:56:34,992 - lava_callback - INFO - Received callback for node 69f7c490096243809b56e72b INFO: 172.21.0.1:52230 - "POST /node/69f7c490096243809b56e72b HTTP/1.0" 202 Accepted 2026-05-05 21:56:34,998 - lava_callback - INFO - Starting async job submit for node 69f7c490096243809b56e72b 2026-05-05 21:56:34,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:56:35,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c490096243809b56e72b HTTP/1.1" 200 None 2026-05-05 21:56:35,013 - lava_callback - DEBUG - Processing node 69f7c490096243809b56e72b: baseline-arm64-baylibre 2026-05-05 21:56:35,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c490096243809b56e72b 2026-05-05 21:56:35,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:56:35,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c490096243809b56e72b HTTP/1.1" 200 None 2026-05-05 21:56:35,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:56:35,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-05 21:56:35,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:56:35,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c490096243809b56e72b HTTP/1.1" 200 None 2026-05-05 21:56:35,058 - lava_callback - ERROR - Error processing callback for node 69f7c490096243809b56e72b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57358 - "GET /node/6990b663c45febfe44523606%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:57:54,940 - lava_callback - INFO - Received callback for node 69f7c4dc096243809b56e74b INFO: 172.21.0.1:52362 - "POST /node/69f7c4dc096243809b56e74b HTTP/1.0" 202 Accepted 2026-05-05 21:57:54,945 - lava_callback - INFO - Starting async job submit for node 69f7c4dc096243809b56e74b 2026-05-05 21:57:54,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:57:54,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c4dc096243809b56e74b HTTP/1.1" 200 None 2026-05-05 21:57:54,963 - lava_callback - DEBUG - Processing node 69f7c4dc096243809b56e74b: baseline-arm64-baylibre 2026-05-05 21:57:54,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c4dc096243809b56e74b 2026-05-05 21:57:54,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:57:54,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c4dc096243809b56e74b HTTP/1.1" 200 None 2026-05-05 21:57:54,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:57:54,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-05 21:57:54,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:57:55,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c4dc096243809b56e74b HTTP/1.1" 200 None 2026-05-05 21:57:55,015 - lava_callback - ERROR - Error processing callback for node 69f7c4dc096243809b56e74b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:58:47,430 - lava_callback - INFO - Received callback for node 69fa63fba9d11f026cebf961 INFO: 172.21.0.1:45980 - "POST /node/69fa63fba9d11f026cebf961 HTTP/1.0" 202 Accepted 2026-05-05 21:58:47,437 - lava_callback - INFO - Starting async job submit for node 69fa63fba9d11f026cebf961 2026-05-05 21:58:47,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:58:47,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa63fba9d11f026cebf961 HTTP/1.1" 200 None 2026-05-05 21:58:47,477 - lava_callback - DEBUG - Processing node 69fa63fba9d11f026cebf961: baseline-arm64 2026-05-05 21:58:48,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:58:48,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:58:48,114 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa63fba9d11f026cebf961/log.txt.gz INFO: 172.21.0.1:45986 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:58:48,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:58:48,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:58:48,545 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa63fba9d11f026cebf961/lava-logs.yaml 2026-05-05 21:58:48,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:58:48,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:58:48,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69fa63fba9d11f026cebf961/lava_callback.json.gz 2026-05-05 21:58:48,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:58:48,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa63fba9d11f026cebf961 HTTP/1.1" 200 None 2026-05-05 21:58:48,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:58:48,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-05 21:58:48,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:58:48,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa63fba9d11f026cebf961 HTTP/1.1" 200 None 2026-05-05 21:58:48,805 - lava_callback - INFO - Completed processing callback for node 69fa63fba9d11f026cebf961 2026-05-05 21:58:55,312 - lava_callback - INFO - Received callback for node 69fa62caa9d11f026cebf8d7 INFO: 172.21.0.1:57742 - "POST /node/69fa62caa9d11f026cebf8d7 HTTP/1.0" 202 Accepted 2026-05-05 21:58:55,319 - lava_callback - INFO - Starting async job submit for node 69fa62caa9d11f026cebf8d7 2026-05-05 21:58:55,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:58:55,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa62caa9d11f026cebf8d7 HTTP/1.1" 200 None 2026-05-05 21:58:55,358 - lava_callback - DEBUG - Processing node 69fa62caa9d11f026cebf8d7: baseline-nfs-arm64 2026-05-05 21:58:55,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:58:56,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:58:56,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa62caa9d11f026cebf8d7/log.txt.gz 2026-05-05 21:58:56,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 21:58:56,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:58:56,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa62caa9d11f026cebf8d7/lava-logs.yaml 2026-05-05 21:58:56,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:57756 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:58:56,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 21:58:56,625 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa62caa9d11f026cebf8d7/lava_callback.json.gz 2026-05-05 21:58:56,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:58:56,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa62caa9d11f026cebf8d7 HTTP/1.1" 200 None 2026-05-05 21:58:56,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:58:56,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f93713d09fe59064f02d00 HTTP/1.1" 200 None 2026-05-05 21:58:56,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:58:56,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa62caa9d11f026cebf8d7 HTTP/1.1" 200 None 2026-05-05 21:58:56,751 - lava_callback - INFO - Completed processing callback for node 69fa62caa9d11f026cebf8d7 INFO: 172.21.0.1:59302 - "GET /node/6992e0ee31166481c8dd6429%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59318 - "GET / HTTP/1.0" 200 OK 2026-05-05 21:59:13,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:59:13,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-05 21:59:14,452 - lava_callback - INFO - Received callback for node 69f7c52c096243809b56e771 INFO: 172.21.0.1:47360 - "POST /node/69f7c52c096243809b56e771 HTTP/1.0" 202 Accepted 2026-05-05 21:59:14,458 - lava_callback - INFO - Starting async job submit for node 69f7c52c096243809b56e771 2026-05-05 21:59:14,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:59:14,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c52c096243809b56e771 HTTP/1.1" 200 None 2026-05-05 21:59:14,476 - lava_callback - DEBUG - Processing node 69f7c52c096243809b56e771: baseline-arm64-clabbe 2026-05-05 21:59:14,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c52c096243809b56e771 2026-05-05 21:59:14,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:59:14,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c52c096243809b56e771 HTTP/1.1" 200 None 2026-05-05 21:59:14,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:59:14,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 21:59:14,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 21:59:14,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c52c096243809b56e771 HTTP/1.1" 200 None 2026-05-05 21:59:14,523 - lava_callback - ERROR - Error processing callback for node 69f7c52c096243809b56e771: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:00:34,994 - lava_callback - INFO - Received callback for node 69f7c573096243809b56e792 INFO: 172.21.0.1:42082 - "POST /node/69f7c573096243809b56e792 HTTP/1.0" 202 Accepted 2026-05-05 22:00:35,001 - lava_callback - INFO - Starting async job submit for node 69f7c573096243809b56e792 2026-05-05 22:00:35,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:00:35,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c573096243809b56e792 HTTP/1.1" 200 None 2026-05-05 22:00:35,018 - lava_callback - DEBUG - Processing node 69f7c573096243809b56e792: baseline-arm64-baylibre 2026-05-05 22:00:35,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c573096243809b56e792 2026-05-05 22:00:35,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:00:35,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c573096243809b56e792 HTTP/1.1" 200 None 2026-05-05 22:00:35,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:00:35,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f2024713aba9734a49455e HTTP/1.1" 200 None 2026-05-05 22:00:35,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:00:35,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c573096243809b56e792 HTTP/1.1" 200 None 2026-05-05 22:00:35,063 - lava_callback - ERROR - Error processing callback for node 69f7c573096243809b56e792: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:01:54,567 - lava_callback - INFO - Received callback for node 69f7c5c2096243809b56e7c0 INFO: 172.21.0.1:44236 - "POST /node/69f7c5c2096243809b56e7c0 HTTP/1.0" 202 Accepted 2026-05-05 22:01:54,572 - lava_callback - INFO - Starting async job submit for node 69f7c5c2096243809b56e7c0 2026-05-05 22:01:54,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:01:54,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c5c2096243809b56e7c0 HTTP/1.1" 200 None 2026-05-05 22:01:54,603 - lava_callback - DEBUG - Processing node 69f7c5c2096243809b56e7c0: baseline-arm64-clabbe 2026-05-05 22:01:54,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c5c2096243809b56e7c0 2026-05-05 22:01:54,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:01:54,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c5c2096243809b56e7c0 HTTP/1.1" 200 None 2026-05-05 22:01:54,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:01:54,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 22:01:54,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:01:54,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c5c2096243809b56e7c0 HTTP/1.1" 200 None 2026-05-05 22:01:54,649 - lava_callback - ERROR - Error processing callback for node 69f7c5c2096243809b56e7c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:02:05,043 - lava_callback - INFO - Received callback for node 69fa6496a9d11f026cebf9a3 INFO: 172.21.0.1:40936 - "POST /node/69fa6496a9d11f026cebf9a3 HTTP/1.0" 202 Accepted 2026-05-05 22:02:05,050 - lava_callback - INFO - Starting async job submit for node 69fa6496a9d11f026cebf9a3 2026-05-05 22:02:05,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:02:05,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa6496a9d11f026cebf9a3 HTTP/1.1" 200 None 2026-05-05 22:02:05,090 - lava_callback - DEBUG - Processing node 69fa6496a9d11f026cebf9a3: baseline-nfs-arm64 2026-05-05 22:02:05,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 22:02:05,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 22:02:05,727 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa6496a9d11f026cebf9a3/log.txt.gz 2026-05-05 22:02:05,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 22:02:06,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 22:02:06,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa6496a9d11f026cebf9a3/lava-logs.yaml 2026-05-05 22:02:06,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-05 22:02:06,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-05 22:02:06,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69fa6496a9d11f026cebf9a3/lava_callback.json.gz 2026-05-05 22:02:06,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:02:06,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa6496a9d11f026cebf9a3 HTTP/1.1" 200 None 2026-05-05 22:02:06,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:02:06,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f9a7d05b7e826894bd2e68 HTTP/1.1" 200 None 2026-05-05 22:02:06,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:02:06,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fa6496a9d11f026cebf9a3 HTTP/1.1" 200 None 2026-05-05 22:02:06,401 - lava_callback - INFO - Completed processing callback for node 69fa6496a9d11f026cebf9a3 INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:02:13,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:02:13,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:03:14,592 - lava_callback - INFO - Received callback for node 69f7c60d096243809b56e7e6 INFO: 172.21.0.1:59606 - "POST /node/69f7c60d096243809b56e7e6 HTTP/1.0" 202 Accepted 2026-05-05 22:03:14,597 - lava_callback - INFO - Starting async job submit for node 69f7c60d096243809b56e7e6 2026-05-05 22:03:14,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:03:14,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c60d096243809b56e7e6 HTTP/1.1" 200 None 2026-05-05 22:03:14,612 - lava_callback - DEBUG - Processing node 69f7c60d096243809b56e7e6: baseline-arm64-clabbe 2026-05-05 22:03:14,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c60d096243809b56e7e6 2026-05-05 22:03:14,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:03:14,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c60d096243809b56e7e6 HTTP/1.1" 200 None 2026-05-05 22:03:14,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:03:14,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 22:03:14,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:03:14,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c60d096243809b56e7e6 HTTP/1.1" 200 None 2026-05-05 22:03:14,658 - lava_callback - ERROR - Error processing callback for node 69f7c60d096243809b56e7e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET /node/69943aad5ae459b9df3d551a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59630 - "GET /node/69ef6b4f8305534e97239d76%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57326 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:04:34,681 - lava_callback - INFO - Received callback for node 69f7c669096243809b56e80f INFO: 172.21.0.1:53608 - "POST /node/69f7c669096243809b56e80f HTTP/1.0" 202 Accepted 2026-05-05 22:04:34,687 - lava_callback - INFO - Starting async job submit for node 69f7c669096243809b56e80f 2026-05-05 22:04:34,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:04:34,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c669096243809b56e80f HTTP/1.1" 200 None 2026-05-05 22:04:34,705 - lava_callback - DEBUG - Processing node 69f7c669096243809b56e80f: baseline-arm64-clabbe 2026-05-05 22:04:34,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c669096243809b56e80f 2026-05-05 22:04:34,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:04:34,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c669096243809b56e80f HTTP/1.1" 200 None 2026-05-05 22:04:34,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:04:34,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 22:04:34,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:04:34,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c669096243809b56e80f HTTP/1.1" 200 None 2026-05-05 22:04:34,754 - lava_callback - ERROR - Error processing callback for node 69f7c669096243809b56e80f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53620 - "GET /node/69f5c6518cb8354ccaa5fabe%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET /node/69876d82e31b58f834f19d33%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53258 - "GET /node/69f4ea7946dc69a3a70b88f5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:08:35,049 - lava_callback - INFO - Received callback for node 69f7c75a096243809b56e83a INFO: 172.21.0.1:35496 - "POST /node/69f7c75a096243809b56e83a HTTP/1.0" 202 Accepted 2026-05-05 22:08:35,055 - lava_callback - INFO - Starting async job submit for node 69f7c75a096243809b56e83a 2026-05-05 22:08:35,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:08:35,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c75a096243809b56e83a HTTP/1.1" 200 None 2026-05-05 22:08:35,070 - lava_callback - DEBUG - Processing node 69f7c75a096243809b56e83a: baseline-arm64-clabbe 2026-05-05 22:08:35,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c75a096243809b56e83a 2026-05-05 22:08:35,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:08:35,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c75a096243809b56e83a HTTP/1.1" 200 None 2026-05-05 22:08:35,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:08:35,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 22:08:35,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:08:35,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c75a096243809b56e83a HTTP/1.1" 200 None 2026-05-05 22:08:35,115 - lava_callback - ERROR - Error processing callback for node 69f7c75a096243809b56e83a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49090 - "GET /node/69dbe4636a0b8baac20d109d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51614 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:16:55,834 - lava_callback - INFO - Received callback for node 69f7c942096243809b56e861 INFO: 172.21.0.1:47544 - "POST /node/69f7c942096243809b56e861 HTTP/1.0" 202 Accepted 2026-05-05 22:16:55,839 - lava_callback - INFO - Starting async job submit for node 69f7c942096243809b56e861 2026-05-05 22:16:55,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:16:55,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c942096243809b56e861 HTTP/1.1" 200 None 2026-05-05 22:16:55,855 - lava_callback - DEBUG - Processing node 69f7c942096243809b56e861: baseline-arm64-baylibre 2026-05-05 22:16:55,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c942096243809b56e861 2026-05-05 22:16:55,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:16:55,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c942096243809b56e861 HTTP/1.1" 200 None 2026-05-05 22:16:55,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:16:55,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 22:16:55,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:16:55,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c942096243809b56e861 HTTP/1.1" 200 None 2026-05-05 22:16:55,904 - lava_callback - ERROR - Error processing callback for node 69f7c942096243809b56e861: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:18:55,295 - lava_callback - INFO - Received callback for node 69f7c9c0096243809b56e88b INFO: 172.21.0.1:50306 - "POST /node/69f7c9c0096243809b56e88b HTTP/1.0" 202 Accepted 2026-05-05 22:18:55,303 - lava_callback - INFO - Starting async job submit for node 69f7c9c0096243809b56e88b 2026-05-05 22:18:55,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:18:55,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c9c0096243809b56e88b HTTP/1.1" 200 None 2026-05-05 22:18:55,321 - lava_callback - DEBUG - Processing node 69f7c9c0096243809b56e88b: baseline-arm64-clabbe 2026-05-05 22:18:55,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7c9c0096243809b56e88b 2026-05-05 22:18:55,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:18:55,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7c9c0096243809b56e88b HTTP/1.1" 200 None 2026-05-05 22:18:55,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:18:55,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 22:18:55,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:18:55,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7c9c0096243809b56e88b HTTP/1.1" 200 None 2026-05-05 22:18:55,392 - lava_callback - ERROR - Error processing callback for node 69f7c9c0096243809b56e88b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:20:55,332 - lava_callback - INFO - Received callback for node 69f7ca37096243809b56e8b6 INFO: 172.21.0.1:37498 - "POST /node/69f7ca37096243809b56e8b6 HTTP/1.0" 202 Accepted 2026-05-05 22:20:55,338 - lava_callback - INFO - Starting async job submit for node 69f7ca37096243809b56e8b6 2026-05-05 22:20:55,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:20:55,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ca37096243809b56e8b6 HTTP/1.1" 200 None 2026-05-05 22:20:55,357 - lava_callback - DEBUG - Processing node 69f7ca37096243809b56e8b6: baseline-arm64-clabbe 2026-05-05 22:20:55,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ca37096243809b56e8b6 2026-05-05 22:20:55,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:20:55,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ca37096243809b56e8b6 HTTP/1.1" 200 None 2026-05-05 22:20:55,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:20:55,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 22:20:55,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:20:55,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ca37096243809b56e8b6 HTTP/1.1" 200 None 2026-05-05 22:20:55,405 - lava_callback - ERROR - Error processing callback for node 69f7ca37096243809b56e8b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:23:35,565 - lava_callback - INFO - Received callback for node 69f7cad8096243809b56e8d5 INFO: 172.21.0.1:48348 - "POST /node/69f7cad8096243809b56e8d5 HTTP/1.0" 202 Accepted 2026-05-05 22:23:35,571 - lava_callback - INFO - Starting async job submit for node 69f7cad8096243809b56e8d5 2026-05-05 22:23:35,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:23:35,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7cad8096243809b56e8d5 HTTP/1.1" 200 None 2026-05-05 22:23:35,590 - lava_callback - DEBUG - Processing node 69f7cad8096243809b56e8d5: baseline-arm64-clabbe 2026-05-05 22:23:35,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7cad8096243809b56e8d5 2026-05-05 22:23:35,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:23:35,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7cad8096243809b56e8d5 HTTP/1.1" 200 None 2026-05-05 22:23:35,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:23:35,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 22:23:35,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:23:35,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7cad8096243809b56e8d5 HTTP/1.1" 200 None 2026-05-05 22:23:35,651 - lava_callback - ERROR - Error processing callback for node 69f7cad8096243809b56e8d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41504 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-05 22:26:15,512 - lava_callback - INFO - Received callback for node 69f7cb78096243809b56e8fe INFO: 172.21.0.1:41512 - "POST /node/69f7cb78096243809b56e8fe HTTP/1.0" 202 Accepted 2026-05-05 22:26:15,517 - lava_callback - INFO - Starting async job submit for node 69f7cb78096243809b56e8fe 2026-05-05 22:26:15,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:26:15,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7cb78096243809b56e8fe HTTP/1.1" 200 None 2026-05-05 22:26:15,550 - lava_callback - DEBUG - Processing node 69f7cb78096243809b56e8fe: baseline-arm64-clabbe 2026-05-05 22:26:15,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7cb78096243809b56e8fe 2026-05-05 22:26:15,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:26:15,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7cb78096243809b56e8fe HTTP/1.1" 200 None 2026-05-05 22:26:15,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:26:15,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 22:26:15,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:26:15,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7cb78096243809b56e8fe HTTP/1.1" 200 None 2026-05-05 22:26:15,606 - lava_callback - ERROR - Error processing callback for node 69f7cb78096243809b56e8fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40616 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-05 22:30:15,702 - lava_callback - INFO - Received callback for node 69f7cc6a096243809b56e91f INFO: 172.21.0.1:40620 - "POST /node/69f7cc6a096243809b56e91f HTTP/1.0" 202 Accepted 2026-05-05 22:30:15,708 - lava_callback - INFO - Starting async job submit for node 69f7cc6a096243809b56e91f 2026-05-05 22:30:15,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:30:15,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7cc6a096243809b56e91f HTTP/1.1" 200 None 2026-05-05 22:30:15,725 - lava_callback - DEBUG - Processing node 69f7cc6a096243809b56e91f: baseline-arm64-clabbe 2026-05-05 22:30:15,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7cc6a096243809b56e91f 2026-05-05 22:30:15,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:30:15,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7cc6a096243809b56e91f HTTP/1.1" 200 None 2026-05-05 22:30:15,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:30:15,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 22:30:15,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:30:15,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7cc6a096243809b56e91f HTTP/1.1" 200 None 2026-05-05 22:30:15,772 - lava_callback - ERROR - Error processing callback for node 69f7cc6a096243809b56e91f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:33:35,802 - lava_callback - INFO - Received callback for node 69f7cd31096243809b56e93a INFO: 172.21.0.1:51346 - "POST /node/69f7cd31096243809b56e93a HTTP/1.0" 202 Accepted 2026-05-05 22:33:35,807 - lava_callback - INFO - Starting async job submit for node 69f7cd31096243809b56e93a 2026-05-05 22:33:35,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:33:35,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7cd31096243809b56e93a HTTP/1.1" 200 None 2026-05-05 22:33:35,861 - lava_callback - DEBUG - Processing node 69f7cd31096243809b56e93a: baseline-arm64-clabbe 2026-05-05 22:33:35,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7cd31096243809b56e93a 2026-05-05 22:33:35,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:33:35,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7cd31096243809b56e93a HTTP/1.1" 200 None 2026-05-05 22:33:35,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:33:35,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4619e6f80da3b312261c0 HTTP/1.1" 200 None 2026-05-05 22:33:35,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:33:35,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7cd31096243809b56e93a HTTP/1.1" 200 None 2026-05-05 22:33:35,906 - lava_callback - ERROR - Error processing callback for node 69f7cd31096243809b56e93a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:47:36,304 - lava_callback - INFO - Received callback for node 69f7d073096243809b56e972 INFO: 172.21.0.1:48442 - "POST /node/69f7d073096243809b56e972 HTTP/1.0" 202 Accepted 2026-05-05 22:47:36,310 - lava_callback - INFO - Starting async job submit for node 69f7d073096243809b56e972 2026-05-05 22:47:36,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:47:36,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d073096243809b56e972 HTTP/1.1" 200 None 2026-05-05 22:47:36,324 - lava_callback - DEBUG - Processing node 69f7d073096243809b56e972: baseline-arm-clabbe 2026-05-05 22:47:36,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d073096243809b56e972 2026-05-05 22:47:36,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:47:36,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d073096243809b56e972 HTTP/1.1" 200 None 2026-05-05 22:47:36,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:47:36,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 22:47:36,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:47:36,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d073096243809b56e972 HTTP/1.1" 200 None 2026-05-05 22:47:36,391 - lava_callback - ERROR - Error processing callback for node 69f7d073096243809b56e972: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:48:36,252 - lava_callback - INFO - Received callback for node 69f7d0af096243809b56e981 INFO: 172.21.0.1:57282 - "POST /node/69f7d0af096243809b56e981 HTTP/1.0" 202 Accepted 2026-05-05 22:48:36,258 - lava_callback - INFO - Starting async job submit for node 69f7d0af096243809b56e981 2026-05-05 22:48:36,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:48:36,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d0af096243809b56e981 HTTP/1.1" 200 None 2026-05-05 22:48:36,273 - lava_callback - DEBUG - Processing node 69f7d0af096243809b56e981: baseline-arm-clabbe 2026-05-05 22:48:36,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d0af096243809b56e981 2026-05-05 22:48:36,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:48:36,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d0af096243809b56e981 HTTP/1.1" 200 None 2026-05-05 22:48:36,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:48:36,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 22:48:36,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:48:36,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d0af096243809b56e981 HTTP/1.1" 200 None 2026-05-05 22:48:36,345 - lava_callback - ERROR - Error processing callback for node 69f7d0af096243809b56e981: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:49:36,399 - lava_callback - INFO - Received callback for node 69f7d0ec096243809b56e99e INFO: 172.21.0.1:41166 - "POST /node/69f7d0ec096243809b56e99e HTTP/1.0" 202 Accepted 2026-05-05 22:49:36,404 - lava_callback - INFO - Starting async job submit for node 69f7d0ec096243809b56e99e 2026-05-05 22:49:36,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:49:36,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d0ec096243809b56e99e HTTP/1.1" 200 None 2026-05-05 22:49:36,421 - lava_callback - DEBUG - Processing node 69f7d0ec096243809b56e99e: baseline-arm-clabbe 2026-05-05 22:49:36,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d0ec096243809b56e99e 2026-05-05 22:49:36,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:49:36,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d0ec096243809b56e99e HTTP/1.1" 200 None 2026-05-05 22:49:36,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:49:36,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 22:49:36,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:49:36,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d0ec096243809b56e99e HTTP/1.1" 200 None 2026-05-05 22:49:36,474 - lava_callback - ERROR - Error processing callback for node 69f7d0ec096243809b56e99e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58870 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:55:16,542 - lava_callback - INFO - Received callback for node 69f7d24e096243809b56ea6c INFO: 172.21.0.1:58886 - "POST /node/69f7d24e096243809b56ea6c HTTP/1.0" 202 Accepted 2026-05-05 22:55:16,548 - lava_callback - INFO - Starting async job submit for node 69f7d24e096243809b56ea6c 2026-05-05 22:55:16,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:55:16,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d24e096243809b56ea6c HTTP/1.1" 200 None 2026-05-05 22:55:16,563 - lava_callback - DEBUG - Processing node 69f7d24e096243809b56ea6c: baseline-arm-clabbe 2026-05-05 22:55:16,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d24e096243809b56ea6c 2026-05-05 22:55:16,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:55:16,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d24e096243809b56ea6c HTTP/1.1" 200 None 2026-05-05 22:55:16,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:55:16,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 22:55:16,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:55:16,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d24e096243809b56ea6c HTTP/1.1" 200 None 2026-05-05 22:55:16,611 - lava_callback - ERROR - Error processing callback for node 69f7d24e096243809b56ea6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:55:58,316 - lava_callback - INFO - Received callback for node 69f7d27b096243809b56ea78 INFO: 172.21.0.1:55144 - "POST /node/69f7d27b096243809b56ea78 HTTP/1.0" 202 Accepted 2026-05-05 22:55:58,321 - lava_callback - INFO - Starting async job submit for node 69f7d27b096243809b56ea78 2026-05-05 22:55:58,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:55:58,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d27b096243809b56ea78 HTTP/1.1" 200 None 2026-05-05 22:55:58,337 - lava_callback - DEBUG - Processing node 69f7d27b096243809b56ea78: baseline-arm64-baylibre 2026-05-05 22:55:58,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d27b096243809b56ea78 2026-05-05 22:55:58,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:55:58,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d27b096243809b56ea78 HTTP/1.1" 200 None 2026-05-05 22:55:58,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:55:58,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 22:55:58,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:55:58,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d27b096243809b56ea78 HTTP/1.1" 200 None 2026-05-05 22:55:58,392 - lava_callback - ERROR - Error processing callback for node 69f7d27b096243809b56ea78: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:57:18,106 - lava_callback - INFO - Received callback for node 69f7d2c5096243809b56eab0 INFO: 172.21.0.1:36638 - "POST /node/69f7d2c5096243809b56eab0 HTTP/1.0" 202 Accepted 2026-05-05 22:57:18,111 - lava_callback - INFO - Starting async job submit for node 69f7d2c5096243809b56eab0 2026-05-05 22:57:18,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:57:18,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d2c5096243809b56eab0 HTTP/1.1" 200 None 2026-05-05 22:57:18,136 - lava_callback - DEBUG - Processing node 69f7d2c5096243809b56eab0: baseline-arm64-baylibre 2026-05-05 22:57:18,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d2c5096243809b56eab0 2026-05-05 22:57:18,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:57:18,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d2c5096243809b56eab0 HTTP/1.1" 200 None 2026-05-05 22:57:18,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:57:18,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 22:57:18,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:57:18,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d2c5096243809b56eab0 HTTP/1.1" 200 None 2026-05-05 22:57:18,182 - lava_callback - ERROR - Error processing callback for node 69f7d2c5096243809b56eab0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:58:36,702 - lava_callback - INFO - Received callback for node 69f7d30c096243809b56eacb INFO: 172.21.0.1:49408 - "POST /node/69f7d30c096243809b56eacb HTTP/1.0" 202 Accepted 2026-05-05 22:58:36,709 - lava_callback - INFO - Starting async job submit for node 69f7d30c096243809b56eacb 2026-05-05 22:58:36,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:58:36,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d30c096243809b56eacb HTTP/1.1" 200 None 2026-05-05 22:58:36,746 - lava_callback - DEBUG - Processing node 69f7d30c096243809b56eacb: baseline-arm-clabbe 2026-05-05 22:58:36,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d30c096243809b56eacb 2026-05-05 22:58:36,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:58:36,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d30c096243809b56eacb HTTP/1.1" 200 None 2026-05-05 22:58:36,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:58:36,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 22:58:36,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:58:36,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d30c096243809b56eacb HTTP/1.1" 200 None 2026-05-05 22:58:36,793 - lava_callback - ERROR - Error processing callback for node 69f7d30c096243809b56eacb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36650 - "GET / HTTP/1.0" 200 OK 2026-05-05 22:59:16,685 - lava_callback - INFO - Received callback for node 69f7d340096243809b56eada INFO: 172.21.0.1:36662 - "POST /node/69f7d340096243809b56eada HTTP/1.0" 202 Accepted 2026-05-05 22:59:16,690 - lava_callback - INFO - Starting async job submit for node 69f7d340096243809b56eada 2026-05-05 22:59:16,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:59:16,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d340096243809b56eada HTTP/1.1" 200 None 2026-05-05 22:59:16,705 - lava_callback - DEBUG - Processing node 69f7d340096243809b56eada: baseline-arm64-clabbe 2026-05-05 22:59:16,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d340096243809b56eada 2026-05-05 22:59:16,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:59:16,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d340096243809b56eada HTTP/1.1" 200 None 2026-05-05 22:59:16,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:59:16,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 22:59:16,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 22:59:16,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d340096243809b56eada HTTP/1.1" 200 None 2026-05-05 22:59:16,751 - lava_callback - ERROR - Error processing callback for node 69f7d340096243809b56eada: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:00:56,832 - lava_callback - INFO - Received callback for node 69f7d393096243809b56eafc INFO: 172.21.0.1:57446 - "POST /node/69f7d393096243809b56eafc HTTP/1.0" 202 Accepted 2026-05-05 23:00:56,841 - lava_callback - INFO - Starting async job submit for node 69f7d393096243809b56eafc 2026-05-05 23:00:56,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:00:56,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d393096243809b56eafc HTTP/1.1" 200 None 2026-05-05 23:00:56,863 - lava_callback - DEBUG - Processing node 69f7d393096243809b56eafc: baseline-arm64-clabbe 2026-05-05 23:00:56,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d393096243809b56eafc 2026-05-05 23:00:56,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:00:56,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d393096243809b56eafc HTTP/1.1" 200 None 2026-05-05 23:00:56,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:00:56,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 23:00:56,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:00:56,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d393096243809b56eafc HTTP/1.1" 200 None 2026-05-05 23:00:56,921 - lava_callback - ERROR - Error processing callback for node 69f7d393096243809b56eafc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:02:16,836 - lava_callback - INFO - Received callback for node 69f7d3e3096243809b56eb17 INFO: 172.21.0.1:50336 - "POST /node/69f7d3e3096243809b56eb17 HTTP/1.0" 202 Accepted 2026-05-05 23:02:16,842 - lava_callback - INFO - Starting async job submit for node 69f7d3e3096243809b56eb17 2026-05-05 23:02:16,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:02:16,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d3e3096243809b56eb17 HTTP/1.1" 200 None 2026-05-05 23:02:16,867 - lava_callback - DEBUG - Processing node 69f7d3e3096243809b56eb17: baseline-arm64-clabbe 2026-05-05 23:02:16,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d3e3096243809b56eb17 2026-05-05 23:02:16,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:02:16,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d3e3096243809b56eb17 HTTP/1.1" 200 None 2026-05-05 23:02:16,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:02:16,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 23:02:16,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:02:16,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d3e3096243809b56eb17 HTTP/1.1" 200 None 2026-05-05 23:02:16,912 - lava_callback - ERROR - Error processing callback for node 69f7d3e3096243809b56eb17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60274 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:03:36,841 - lava_callback - INFO - Received callback for node 69f7d436096243809b56eb37 INFO: 172.21.0.1:60282 - "POST /node/69f7d436096243809b56eb37 HTTP/1.0" 202 Accepted 2026-05-05 23:03:36,846 - lava_callback - INFO - Starting async job submit for node 69f7d436096243809b56eb37 2026-05-05 23:03:36,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:03:36,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d436096243809b56eb37 HTTP/1.1" 200 None 2026-05-05 23:03:36,868 - lava_callback - DEBUG - Processing node 69f7d436096243809b56eb37: baseline-arm64-clabbe 2026-05-05 23:03:36,868 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d436096243809b56eb37 2026-05-05 23:03:36,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:03:36,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d436096243809b56eb37 HTTP/1.1" 200 None 2026-05-05 23:03:36,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:03:36,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 23:03:36,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:03:36,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d436096243809b56eb37 HTTP/1.1" 200 None 2026-05-05 23:03:36,915 - lava_callback - ERROR - Error processing callback for node 69f7d436096243809b56eb37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:04:56,897 - lava_callback - INFO - Received callback for node 69f7d485096243809b56eb59 INFO: 172.21.0.1:53938 - "POST /node/69f7d485096243809b56eb59 HTTP/1.0" 202 Accepted 2026-05-05 23:04:56,903 - lava_callback - INFO - Starting async job submit for node 69f7d485096243809b56eb59 2026-05-05 23:04:56,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:04:56,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d485096243809b56eb59 HTTP/1.1" 200 None 2026-05-05 23:04:56,919 - lava_callback - DEBUG - Processing node 69f7d485096243809b56eb59: baseline-arm64-clabbe 2026-05-05 23:04:56,919 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d485096243809b56eb59 2026-05-05 23:04:56,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:04:56,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d485096243809b56eb59 HTTP/1.1" 200 None 2026-05-05 23:04:56,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:04:56,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 23:04:56,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:04:56,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d485096243809b56eb59 HTTP/1.1" 200 None 2026-05-05 23:04:56,965 - lava_callback - ERROR - Error processing callback for node 69f7d485096243809b56eb59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38670 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:05:56,894 - lava_callback - INFO - Received callback for node 69f7d4cc096243809b56eb8d INFO: 172.21.0.1:38680 - "POST /node/69f7d4cc096243809b56eb8d HTTP/1.0" 202 Accepted 2026-05-05 23:05:56,900 - lava_callback - INFO - Starting async job submit for node 69f7d4cc096243809b56eb8d 2026-05-05 23:05:56,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:05:56,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d4cc096243809b56eb8d HTTP/1.1" 200 None 2026-05-05 23:05:56,915 - lava_callback - DEBUG - Processing node 69f7d4cc096243809b56eb8d: baseline-arm64-clabbe 2026-05-05 23:05:56,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d4cc096243809b56eb8d 2026-05-05 23:05:56,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:05:56,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d4cc096243809b56eb8d HTTP/1.1" 200 None 2026-05-05 23:05:56,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:05:56,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7755f096243809b569932 HTTP/1.1" 200 None 2026-05-05 23:05:56,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:05:56,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d4cc096243809b56eb8d HTTP/1.1" 200 None 2026-05-05 23:05:56,961 - lava_callback - ERROR - Error processing callback for node 69f7d4cc096243809b56eb8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:09:17,018 - lava_callback - INFO - Received callback for node 69f7d595096243809b56ebf0 INFO: 172.21.0.1:44848 - "POST /node/69f7d595096243809b56ebf0 HTTP/1.0" 202 Accepted 2026-05-05 23:09:17,024 - lava_callback - INFO - Starting async job submit for node 69f7d595096243809b56ebf0 2026-05-05 23:09:17,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:09:17,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d595096243809b56ebf0 HTTP/1.1" 200 None 2026-05-05 23:09:17,040 - lava_callback - DEBUG - Processing node 69f7d595096243809b56ebf0: baseline-arm-clabbe 2026-05-05 23:09:17,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d595096243809b56ebf0 2026-05-05 23:09:17,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:09:17,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d595096243809b56ebf0 HTTP/1.1" 200 None 2026-05-05 23:09:17,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:09:17,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-05 23:09:17,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:09:17,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d595096243809b56ebf0 HTTP/1.1" 200 None 2026-05-05 23:09:17,086 - lava_callback - ERROR - Error processing callback for node 69f7d595096243809b56ebf0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38646 - "GET /node/69870d806e077e4126a7ec61%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:09:57,029 - lava_callback - INFO - Received callback for node 69f7d5ba096243809b56ebff INFO: 172.21.0.1:55306 - "POST /node/69f7d5ba096243809b56ebff HTTP/1.0" 202 Accepted 2026-05-05 23:09:57,034 - lava_callback - INFO - Starting async job submit for node 69f7d5ba096243809b56ebff 2026-05-05 23:09:57,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:09:57,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d5ba096243809b56ebff HTTP/1.1" 200 None 2026-05-05 23:09:57,050 - lava_callback - DEBUG - Processing node 69f7d5ba096243809b56ebff: baseline-arm-clabbe 2026-05-05 23:09:57,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d5ba096243809b56ebff 2026-05-05 23:09:57,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:09:57,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d5ba096243809b56ebff HTTP/1.1" 200 None 2026-05-05 23:09:57,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:09:57,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-05 23:09:57,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:09:57,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d5ba096243809b56ebff HTTP/1.1" 200 None 2026-05-05 23:09:57,101 - lava_callback - ERROR - Error processing callback for node 69f7d5ba096243809b56ebff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:10:37,092 - lava_callback - INFO - Received callback for node 69f7d5de096243809b56ec0b INFO: 172.21.0.1:35306 - "POST /node/69f7d5de096243809b56ec0b HTTP/1.0" 202 Accepted 2026-05-05 23:10:37,098 - lava_callback - INFO - Starting async job submit for node 69f7d5de096243809b56ec0b 2026-05-05 23:10:37,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:10:37,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d5de096243809b56ec0b HTTP/1.1" 200 None 2026-05-05 23:10:37,113 - lava_callback - DEBUG - Processing node 69f7d5de096243809b56ec0b: baseline-arm-clabbe 2026-05-05 23:10:37,113 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d5de096243809b56ec0b 2026-05-05 23:10:37,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:10:37,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d5de096243809b56ec0b HTTP/1.1" 200 None 2026-05-05 23:10:37,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:10:37,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-05 23:10:37,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:10:37,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d5de096243809b56ec0b HTTP/1.1" 200 None 2026-05-05 23:10:37,183 - lava_callback - ERROR - Error processing callback for node 69f7d5de096243809b56ec0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52512 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:11:17,080 - lava_callback - INFO - Received callback for node 69f7d603096243809b56ec18 INFO: 172.21.0.1:52520 - "POST /node/69f7d603096243809b56ec18 HTTP/1.0" 202 Accepted 2026-05-05 23:11:17,085 - lava_callback - INFO - Starting async job submit for node 69f7d603096243809b56ec18 2026-05-05 23:11:17,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:11:17,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d603096243809b56ec18 HTTP/1.1" 200 None 2026-05-05 23:11:17,101 - lava_callback - DEBUG - Processing node 69f7d603096243809b56ec18: baseline-arm-clabbe 2026-05-05 23:11:17,101 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d603096243809b56ec18 2026-05-05 23:11:17,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:11:17,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d603096243809b56ec18 HTTP/1.1" 200 None 2026-05-05 23:11:17,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:11:17,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-05 23:11:17,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:11:17,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d603096243809b56ec18 HTTP/1.1" 200 None 2026-05-05 23:11:17,147 - lava_callback - ERROR - Error processing callback for node 69f7d603096243809b56ec18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:11:37,122 - lava_callback - INFO - Received callback for node 69f7d626096243809b56ec24 INFO: 172.21.0.1:47516 - "POST /node/69f7d626096243809b56ec24 HTTP/1.0" 202 Accepted 2026-05-05 23:11:37,128 - lava_callback - INFO - Starting async job submit for node 69f7d626096243809b56ec24 2026-05-05 23:11:37,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:11:37,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d626096243809b56ec24 HTTP/1.1" 200 None 2026-05-05 23:11:37,150 - lava_callback - DEBUG - Processing node 69f7d626096243809b56ec24: baseline-arm-clabbe 2026-05-05 23:11:37,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d626096243809b56ec24 2026-05-05 23:11:37,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:11:37,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d626096243809b56ec24 HTTP/1.1" 200 None 2026-05-05 23:11:37,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:11:37,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-05 23:11:37,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:11:37,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d626096243809b56ec24 HTTP/1.1" 200 None 2026-05-05 23:11:37,200 - lava_callback - ERROR - Error processing callback for node 69f7d626096243809b56ec24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38720 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:12:19,000 - lava_callback - INFO - Received callback for node 69f7d64f096243809b56ec30 INFO: 172.21.0.1:38724 - "POST /node/69f7d64f096243809b56ec30 HTTP/1.0" 202 Accepted 2026-05-05 23:12:19,006 - lava_callback - INFO - Starting async job submit for node 69f7d64f096243809b56ec30 2026-05-05 23:12:19,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:12:19,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d64f096243809b56ec30 HTTP/1.1" 200 None 2026-05-05 23:12:19,021 - lava_callback - DEBUG - Processing node 69f7d64f096243809b56ec30: baseline-arm64-baylibre 2026-05-05 23:12:19,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d64f096243809b56ec30 2026-05-05 23:12:19,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:12:19,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d64f096243809b56ec30 HTTP/1.1" 200 None 2026-05-05 23:12:19,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:12:19,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 23:12:19,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:12:19,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d64f096243809b56ec30 HTTP/1.1" 200 None 2026-05-05 23:12:19,067 - lava_callback - ERROR - Error processing callback for node 69f7d64f096243809b56ec30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:13:38,985 - lava_callback - INFO - Received callback for node 69f7d69e096243809b56ec56 INFO: 172.21.0.1:35996 - "POST /node/69f7d69e096243809b56ec56 HTTP/1.0" 202 Accepted 2026-05-05 23:13:38,991 - lava_callback - INFO - Starting async job submit for node 69f7d69e096243809b56ec56 2026-05-05 23:13:38,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:13:39,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d69e096243809b56ec56 HTTP/1.1" 200 None 2026-05-05 23:13:39,006 - lava_callback - DEBUG - Processing node 69f7d69e096243809b56ec56: baseline-arm64-baylibre 2026-05-05 23:13:39,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d69e096243809b56ec56 2026-05-05 23:13:39,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:13:39,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d69e096243809b56ec56 HTTP/1.1" 200 None 2026-05-05 23:13:39,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:13:39,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 23:13:39,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:13:39,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d69e096243809b56ec56 HTTP/1.1" 200 None 2026-05-05 23:13:39,052 - lava_callback - ERROR - Error processing callback for node 69f7d69e096243809b56ec56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37922 - "GET /node/68eacbaa4c8d16b9360790b2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39602 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:14:59,072 - lava_callback - INFO - Received callback for node 69f7d6e5096243809b56ec88 INFO: 172.21.0.1:39612 - "POST /node/69f7d6e5096243809b56ec88 HTTP/1.0" 202 Accepted 2026-05-05 23:14:59,077 - lava_callback - INFO - Starting async job submit for node 69f7d6e5096243809b56ec88 2026-05-05 23:14:59,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:14:59,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d6e5096243809b56ec88 HTTP/1.1" 200 None 2026-05-05 23:14:59,093 - lava_callback - DEBUG - Processing node 69f7d6e5096243809b56ec88: baseline-arm64-baylibre 2026-05-05 23:14:59,093 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d6e5096243809b56ec88 2026-05-05 23:14:59,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:14:59,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d6e5096243809b56ec88 HTTP/1.1" 200 None 2026-05-05 23:14:59,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:14:59,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 23:14:59,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:14:59,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d6e5096243809b56ec88 HTTP/1.1" 200 None 2026-05-05 23:14:59,140 - lava_callback - ERROR - Error processing callback for node 69f7d6e5096243809b56ec88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET /node/69efa1558305534e9723b6f2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:16:19,073 - lava_callback - INFO - Received callback for node 69f7d72e096243809b56ecc6 INFO: 172.21.0.1:37412 - "POST /node/69f7d72e096243809b56ecc6 HTTP/1.0" 202 Accepted 2026-05-05 23:16:19,079 - lava_callback - INFO - Starting async job submit for node 69f7d72e096243809b56ecc6 2026-05-05 23:16:19,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:16:19,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d72e096243809b56ecc6 HTTP/1.1" 200 None 2026-05-05 23:16:19,094 - lava_callback - DEBUG - Processing node 69f7d72e096243809b56ecc6: baseline-arm64-baylibre 2026-05-05 23:16:19,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d72e096243809b56ecc6 2026-05-05 23:16:19,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:16:19,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d72e096243809b56ecc6 HTTP/1.1" 200 None 2026-05-05 23:16:19,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:16:19,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 23:16:19,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:16:19,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d72e096243809b56ecc6 HTTP/1.1" 200 None 2026-05-05 23:16:19,153 - lava_callback - ERROR - Error processing callback for node 69f7d72e096243809b56ecc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:17:19,132 - lava_callback - INFO - Received callback for node 69f7d77c096243809b56ece3 INFO: 172.21.0.1:43574 - "POST /node/69f7d77c096243809b56ece3 HTTP/1.0" 202 Accepted 2026-05-05 23:17:19,138 - lava_callback - INFO - Starting async job submit for node 69f7d77c096243809b56ece3 2026-05-05 23:17:19,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:17:19,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d77c096243809b56ece3 HTTP/1.1" 200 None 2026-05-05 23:17:19,157 - lava_callback - DEBUG - Processing node 69f7d77c096243809b56ece3: baseline-arm64-baylibre 2026-05-05 23:17:19,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d77c096243809b56ece3 2026-05-05 23:17:19,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:17:19,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d77c096243809b56ece3 HTTP/1.1" 200 None 2026-05-05 23:17:19,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:17:19,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 23:17:19,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:17:19,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d77c096243809b56ece3 HTTP/1.1" 200 None 2026-05-05 23:17:19,221 - lava_callback - ERROR - Error processing callback for node 69f7d77c096243809b56ece3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54474 - "GET /node/699352dc523507f3806a7c38%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET /node/69e50e249a34686dd62eb90e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:22:39,630 - lava_callback - INFO - Received callback for node 69f7d8b3096243809b56ed09 INFO: 172.21.0.1:42514 - "POST /node/69f7d8b3096243809b56ed09 HTTP/1.0" 202 Accepted 2026-05-05 23:22:39,639 - lava_callback - INFO - Starting async job submit for node 69f7d8b3096243809b56ed09 2026-05-05 23:22:39,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:22:39,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d8b3096243809b56ed09 HTTP/1.1" 200 None 2026-05-05 23:22:39,654 - lava_callback - DEBUG - Processing node 69f7d8b3096243809b56ed09: baseline-arm64-baylibre 2026-05-05 23:22:39,654 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7d8b3096243809b56ed09 2026-05-05 23:22:39,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:22:39,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7d8b3096243809b56ed09 HTTP/1.1" 200 None 2026-05-05 23:22:39,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:22:39,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-05 23:22:39,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:22:39,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7d8b3096243809b56ed09 HTTP/1.1" 200 None 2026-05-05 23:22:39,710 - lava_callback - ERROR - Error processing callback for node 69f7d8b3096243809b56ed09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53532 - "GET /node/6992da7531166481c8dd460c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET /node/69ef6af48305534e97239c15%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET /node/69e81d7dafb86e738cad02b6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET /node/699341a031166481c8dee349%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50822 - "GET /node/6952d6509912bd6bbcea478e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET /node/69934b1a523507f3806a5506%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51550 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:38:38,238 - lava_callback - INFO - Received callback for node 69f7dc6d096243809b56ed3c INFO: 172.21.0.1:51552 - "POST /node/69f7dc6d096243809b56ed3c HTTP/1.0" 202 Accepted 2026-05-05 23:38:38,243 - lava_callback - INFO - Starting async job submit for node 69f7dc6d096243809b56ed3c 2026-05-05 23:38:38,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:38:38,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dc6d096243809b56ed3c HTTP/1.1" 200 None 2026-05-05 23:38:38,259 - lava_callback - DEBUG - Processing node 69f7dc6d096243809b56ed3c: baseline-arm-clabbe 2026-05-05 23:38:38,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7dc6d096243809b56ed3c 2026-05-05 23:38:38,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:38:38,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dc6d096243809b56ed3c HTTP/1.1" 200 None 2026-05-05 23:38:38,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:38:38,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 23:38:38,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:38:38,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7dc6d096243809b56ed3c HTTP/1.1" 200 None 2026-05-05 23:38:38,306 - lava_callback - ERROR - Error processing callback for node 69f7dc6d096243809b56ed3c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:39:38,251 - lava_callback - INFO - Received callback for node 69f7dca8096243809b56ed4b INFO: 172.21.0.1:41508 - "POST /node/69f7dca8096243809b56ed4b HTTP/1.0" 202 Accepted 2026-05-05 23:39:38,256 - lava_callback - INFO - Starting async job submit for node 69f7dca8096243809b56ed4b 2026-05-05 23:39:38,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:39:38,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dca8096243809b56ed4b HTTP/1.1" 200 None 2026-05-05 23:39:38,271 - lava_callback - DEBUG - Processing node 69f7dca8096243809b56ed4b: baseline-arm-clabbe 2026-05-05 23:39:38,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7dca8096243809b56ed4b 2026-05-05 23:39:38,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:39:38,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dca8096243809b56ed4b HTTP/1.1" 200 None 2026-05-05 23:39:38,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:39:38,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 23:39:38,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:39:38,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7dca8096243809b56ed4b HTTP/1.1" 200 None 2026-05-05 23:39:38,330 - lava_callback - ERROR - Error processing callback for node 69f7dca8096243809b56ed4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32770 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:41:38,266 - lava_callback - INFO - Received callback for node 69f7dd21096243809b56ed5c INFO: 172.21.0.1:32782 - "POST /node/69f7dd21096243809b56ed5c HTTP/1.0" 202 Accepted 2026-05-05 23:41:38,272 - lava_callback - INFO - Starting async job submit for node 69f7dd21096243809b56ed5c 2026-05-05 23:41:38,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:41:38,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dd21096243809b56ed5c HTTP/1.1" 200 None 2026-05-05 23:41:38,290 - lava_callback - DEBUG - Processing node 69f7dd21096243809b56ed5c: baseline-arm-clabbe 2026-05-05 23:41:38,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7dd21096243809b56ed5c 2026-05-05 23:41:38,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:41:38,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dd21096243809b56ed5c HTTP/1.1" 200 None 2026-05-05 23:41:38,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:41:38,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 23:41:38,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:41:38,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7dd21096243809b56ed5c HTTP/1.1" 200 None 2026-05-05 23:41:38,347 - lava_callback - ERROR - Error processing callback for node 69f7dd21096243809b56ed5c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50854 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:42:38,318 - lava_callback - INFO - Received callback for node 69f7dd5c096243809b56ed6d INFO: 172.21.0.1:50862 - "POST /node/69f7dd5c096243809b56ed6d HTTP/1.0" 202 Accepted 2026-05-05 23:42:38,324 - lava_callback - INFO - Starting async job submit for node 69f7dd5c096243809b56ed6d 2026-05-05 23:42:38,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:42:38,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dd5c096243809b56ed6d HTTP/1.1" 200 None 2026-05-05 23:42:38,339 - lava_callback - DEBUG - Processing node 69f7dd5c096243809b56ed6d: baseline-arm-clabbe 2026-05-05 23:42:38,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7dd5c096243809b56ed6d 2026-05-05 23:42:38,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:42:38,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dd5c096243809b56ed6d HTTP/1.1" 200 None 2026-05-05 23:42:38,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:42:38,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 23:42:38,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:42:38,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7dd5c096243809b56ed6d HTTP/1.1" 200 None 2026-05-05 23:42:38,385 - lava_callback - ERROR - Error processing callback for node 69f7dd5c096243809b56ed6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37926 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:43:18,302 - lava_callback - INFO - Received callback for node 69f7dd82096243809b56ed7b INFO: 172.21.0.1:37928 - "POST /node/69f7dd82096243809b56ed7b HTTP/1.0" 202 Accepted 2026-05-05 23:43:18,311 - lava_callback - INFO - Starting async job submit for node 69f7dd82096243809b56ed7b 2026-05-05 23:43:18,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:43:18,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dd82096243809b56ed7b HTTP/1.1" 200 None 2026-05-05 23:43:18,328 - lava_callback - DEBUG - Processing node 69f7dd82096243809b56ed7b: baseline-arm-clabbe 2026-05-05 23:43:18,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7dd82096243809b56ed7b 2026-05-05 23:43:18,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:43:18,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dd82096243809b56ed7b HTTP/1.1" 200 None 2026-05-05 23:43:18,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:43:18,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 23:43:18,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:43:18,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7dd82096243809b56ed7b HTTP/1.1" 200 None 2026-05-05 23:43:18,397 - lava_callback - ERROR - Error processing callback for node 69f7dd82096243809b56ed7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:43:58,349 - lava_callback - INFO - Received callback for node 69f7dda8096243809b56ed87 INFO: 172.21.0.1:42532 - "POST /node/69f7dda8096243809b56ed87 HTTP/1.0" 202 Accepted 2026-05-05 23:43:58,354 - lava_callback - INFO - Starting async job submit for node 69f7dda8096243809b56ed87 2026-05-05 23:43:58,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:43:58,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dda8096243809b56ed87 HTTP/1.1" 200 None 2026-05-05 23:43:58,369 - lava_callback - DEBUG - Processing node 69f7dda8096243809b56ed87: baseline-arm-clabbe 2026-05-05 23:43:58,369 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7dda8096243809b56ed87 2026-05-05 23:43:58,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:43:58,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7dda8096243809b56ed87 HTTP/1.1" 200 None 2026-05-05 23:43:58,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:43:58,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 23:43:58,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:43:58,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7dda8096243809b56ed87 HTTP/1.1" 200 None 2026-05-05 23:43:58,419 - lava_callback - ERROR - Error processing callback for node 69f7dda8096243809b56ed87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37942 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:44:38,336 - lava_callback - INFO - Received callback for node 69f7ddd4096243809b56ed96 INFO: 172.21.0.1:37950 - "POST /node/69f7ddd4096243809b56ed96 HTTP/1.0" 202 Accepted 2026-05-05 23:44:38,342 - lava_callback - INFO - Starting async job submit for node 69f7ddd4096243809b56ed96 2026-05-05 23:44:38,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:44:38,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ddd4096243809b56ed96 HTTP/1.1" 200 None 2026-05-05 23:44:38,357 - lava_callback - DEBUG - Processing node 69f7ddd4096243809b56ed96: baseline-arm-clabbe 2026-05-05 23:44:38,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7ddd4096243809b56ed96 2026-05-05 23:44:38,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:44:38,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7ddd4096243809b56ed96 HTTP/1.1" 200 None 2026-05-05 23:44:38,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:44:38,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 23:44:38,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:44:38,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7ddd4096243809b56ed96 HTTP/1.1" 200 None 2026-05-05 23:44:38,403 - lava_callback - ERROR - Error processing callback for node 69f7ddd4096243809b56ed96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:45:38,423 - lava_callback - INFO - Received callback for node 69f7de11096243809b56eda5 INFO: 172.21.0.1:40060 - "POST /node/69f7de11096243809b56eda5 HTTP/1.0" 202 Accepted 2026-05-05 23:45:38,432 - lava_callback - INFO - Starting async job submit for node 69f7de11096243809b56eda5 2026-05-05 23:45:38,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:45:38,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7de11096243809b56eda5 HTTP/1.1" 200 None 2026-05-05 23:45:38,459 - lava_callback - DEBUG - Processing node 69f7de11096243809b56eda5: baseline-arm-clabbe 2026-05-05 23:45:38,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7de11096243809b56eda5 2026-05-05 23:45:38,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:45:38,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7de11096243809b56eda5 HTTP/1.1" 200 None 2026-05-05 23:45:38,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:45:38,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 23:45:38,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:45:38,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7de11096243809b56eda5 HTTP/1.1" 200 None 2026-05-05 23:45:38,519 - lava_callback - ERROR - Error processing callback for node 69f7de11096243809b56eda5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:46:38,504 - lava_callback - INFO - Received callback for node 69f7de4d096243809b56edb4 INFO: 172.21.0.1:55808 - "POST /node/69f7de4d096243809b56edb4 HTTP/1.0" 202 Accepted 2026-05-05 23:46:38,510 - lava_callback - INFO - Starting async job submit for node 69f7de4d096243809b56edb4 2026-05-05 23:46:38,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:46:38,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7de4d096243809b56edb4 HTTP/1.1" 200 None 2026-05-05 23:46:38,526 - lava_callback - DEBUG - Processing node 69f7de4d096243809b56edb4: baseline-arm-clabbe 2026-05-05 23:46:38,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7de4d096243809b56edb4 2026-05-05 23:46:38,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:46:38,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7de4d096243809b56edb4 HTTP/1.1" 200 None 2026-05-05 23:46:38,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:46:38,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 23:46:38,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:46:38,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7de4d096243809b56edb4 HTTP/1.1" 200 None 2026-05-05 23:46:38,571 - lava_callback - ERROR - Error processing callback for node 69f7de4d096243809b56edb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:47:38,493 - lava_callback - INFO - Received callback for node 69f7de89096243809b56edc2 INFO: 172.21.0.1:54956 - "POST /node/69f7de89096243809b56edc2 HTTP/1.0" 202 Accepted 2026-05-05 23:47:38,499 - lava_callback - INFO - Starting async job submit for node 69f7de89096243809b56edc2 2026-05-05 23:47:38,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:47:38,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7de89096243809b56edc2 HTTP/1.1" 200 None 2026-05-05 23:47:38,517 - lava_callback - DEBUG - Processing node 69f7de89096243809b56edc2: baseline-arm-clabbe 2026-05-05 23:47:38,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7de89096243809b56edc2 2026-05-05 23:47:38,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:47:38,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7de89096243809b56edc2 HTTP/1.1" 200 None 2026-05-05 23:47:38,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:47:38,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4878aec4729f146b42fb9 HTTP/1.1" 200 None 2026-05-05 23:47:38,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:47:38,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7de89096243809b56edc2 HTTP/1.1" 200 None 2026-05-05 23:47:38,573 - lava_callback - ERROR - Error processing callback for node 69f7de89096243809b56edc2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:48:40,968 - lava_callback - INFO - Received callback for node 69f7decd096243809b56edd9 INFO: 172.21.0.1:32952 - "POST /node/69f7decd096243809b56edd9 HTTP/1.0" 202 Accepted 2026-05-05 23:48:40,974 - lava_callback - INFO - Starting async job submit for node 69f7decd096243809b56edd9 2026-05-05 23:48:40,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:48:40,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7decd096243809b56edd9 HTTP/1.1" 200 None 2026-05-05 23:48:40,991 - lava_callback - DEBUG - Processing node 69f7decd096243809b56edd9: baseline-arm64-baylibre 2026-05-05 23:48:40,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7decd096243809b56edd9 2026-05-05 23:48:40,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:48:41,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7decd096243809b56edd9 HTTP/1.1" 200 None 2026-05-05 23:48:41,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:48:41,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 23:48:41,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:48:41,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7decd096243809b56edd9 HTTP/1.1" 200 None 2026-05-05 23:48:41,047 - lava_callback - ERROR - Error processing callback for node 69f7decd096243809b56edd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:50:38,603 - lava_callback - INFO - Received callback for node 69f7df4b096243809b56edfa INFO: 172.21.0.1:42996 - "POST /node/69f7df4b096243809b56edfa HTTP/1.0" 202 Accepted 2026-05-05 23:50:38,612 - lava_callback - INFO - Starting async job submit for node 69f7df4b096243809b56edfa 2026-05-05 23:50:38,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:50:38,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7df4b096243809b56edfa HTTP/1.1" 200 None 2026-05-05 23:50:38,628 - lava_callback - DEBUG - Processing node 69f7df4b096243809b56edfa: baseline-arm64-clabbe 2026-05-05 23:50:38,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7df4b096243809b56edfa 2026-05-05 23:50:38,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:50:38,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7df4b096243809b56edfa HTTP/1.1" 200 None 2026-05-05 23:50:38,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:50:38,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 23:50:38,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:50:38,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7df4b096243809b56edfa HTTP/1.1" 200 None 2026-05-05 23:50:38,675 - lava_callback - ERROR - Error processing callback for node 69f7df4b096243809b56edfa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52846 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:51:58,667 - lava_callback - INFO - Received callback for node 69f7df91096243809b56ee14 INFO: 172.21.0.1:52848 - "POST /node/69f7df91096243809b56ee14 HTTP/1.0" 202 Accepted 2026-05-05 23:51:58,673 - lava_callback - INFO - Starting async job submit for node 69f7df91096243809b56ee14 2026-05-05 23:51:58,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:51:58,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7df91096243809b56ee14 HTTP/1.1" 200 None 2026-05-05 23:51:58,694 - lava_callback - DEBUG - Processing node 69f7df91096243809b56ee14: baseline-arm-clabbe 2026-05-05 23:51:58,695 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7df91096243809b56ee14 2026-05-05 23:51:58,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:51:58,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7df91096243809b56ee14 HTTP/1.1" 200 None 2026-05-05 23:51:58,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:51:58,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 23:51:58,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:51:58,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7df91096243809b56ee14 HTTP/1.1" 200 None 2026-05-05 23:51:58,760 - lava_callback - ERROR - Error processing callback for node 69f7df91096243809b56ee14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:53:58,794 - lava_callback - INFO - Received callback for node 69f7e000096243809b56ee2a INFO: 172.21.0.1:33438 - "POST /node/69f7e000096243809b56ee2a HTTP/1.0" 202 Accepted 2026-05-05 23:53:58,800 - lava_callback - INFO - Starting async job submit for node 69f7e000096243809b56ee2a 2026-05-05 23:53:58,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:53:58,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e000096243809b56ee2a HTTP/1.1" 200 None 2026-05-05 23:53:58,817 - lava_callback - DEBUG - Processing node 69f7e000096243809b56ee2a: baseline-arm64-clabbe 2026-05-05 23:53:58,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e000096243809b56ee2a 2026-05-05 23:53:58,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:53:58,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e000096243809b56ee2a HTTP/1.1" 200 None 2026-05-05 23:53:58,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:53:58,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 23:53:58,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:53:58,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e000096243809b56ee2a HTTP/1.1" 200 None 2026-05-05 23:53:58,879 - lava_callback - ERROR - Error processing callback for node 69f7e000096243809b56ee2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:54:58,786 - lava_callback - INFO - Received callback for node 69f7e044096243809b56ee46 INFO: 172.21.0.1:51940 - "POST /node/69f7e044096243809b56ee46 HTTP/1.0" 202 Accepted 2026-05-05 23:54:58,796 - lava_callback - INFO - Starting async job submit for node 69f7e044096243809b56ee46 2026-05-05 23:54:58,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:54:58,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e044096243809b56ee46 HTTP/1.1" 200 None 2026-05-05 23:54:58,812 - lava_callback - DEBUG - Processing node 69f7e044096243809b56ee46: baseline-arm-clabbe 2026-05-05 23:54:58,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e044096243809b56ee46 2026-05-05 23:54:58,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:54:58,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e044096243809b56ee46 HTTP/1.1" 200 None 2026-05-05 23:54:58,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:54:58,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 23:54:58,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:54:58,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e044096243809b56ee46 HTTP/1.1" 200 None 2026-05-05 23:54:58,882 - lava_callback - ERROR - Error processing callback for node 69f7e044096243809b56ee46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45864 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:55:38,782 - lava_callback - INFO - Received callback for node 69f7e069096243809b56ee54 INFO: 172.21.0.1:45878 - "POST /node/69f7e069096243809b56ee54 HTTP/1.0" 202 Accepted 2026-05-05 23:55:38,788 - lava_callback - INFO - Starting async job submit for node 69f7e069096243809b56ee54 2026-05-05 23:55:38,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:55:38,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e069096243809b56ee54 HTTP/1.1" 200 None 2026-05-05 23:55:38,804 - lava_callback - DEBUG - Processing node 69f7e069096243809b56ee54: baseline-arm-clabbe 2026-05-05 23:55:38,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e069096243809b56ee54 2026-05-05 23:55:38,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:55:38,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e069096243809b56ee54 HTTP/1.1" 200 None 2026-05-05 23:55:38,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:55:38,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 23:55:38,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:55:38,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e069096243809b56ee54 HTTP/1.1" 200 None 2026-05-05 23:55:38,850 - lava_callback - ERROR - Error processing callback for node 69f7e069096243809b56ee54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58454 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:56:18,847 - lava_callback - INFO - Received callback for node 69f7e08c096243809b56ee5f INFO: 172.21.0.1:58464 - "POST /node/69f7e08c096243809b56ee5f HTTP/1.0" 202 Accepted 2026-05-05 23:56:18,853 - lava_callback - INFO - Starting async job submit for node 69f7e08c096243809b56ee5f 2026-05-05 23:56:18,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:56:18,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e08c096243809b56ee5f HTTP/1.1" 200 None 2026-05-05 23:56:18,872 - lava_callback - DEBUG - Processing node 69f7e08c096243809b56ee5f: baseline-arm-clabbe 2026-05-05 23:56:18,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e08c096243809b56ee5f 2026-05-05 23:56:18,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:56:18,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e08c096243809b56ee5f HTTP/1.1" 200 None 2026-05-05 23:56:18,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:56:18,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 23:56:18,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:56:18,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e08c096243809b56ee5f HTTP/1.1" 200 None 2026-05-05 23:56:18,928 - lava_callback - ERROR - Error processing callback for node 69f7e08c096243809b56ee5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:56:58,817 - lava_callback - INFO - Received callback for node 69f7e0bf096243809b56ee71 INFO: 172.21.0.1:36516 - "POST /node/69f7e0bf096243809b56ee71 HTTP/1.0" 202 Accepted 2026-05-05 23:56:58,823 - lava_callback - INFO - Starting async job submit for node 69f7e0bf096243809b56ee71 2026-05-05 23:56:58,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:56:58,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e0bf096243809b56ee71 HTTP/1.1" 200 None 2026-05-05 23:56:58,862 - lava_callback - DEBUG - Processing node 69f7e0bf096243809b56ee71: baseline-arm64-clabbe 2026-05-05 23:56:58,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e0bf096243809b56ee71 2026-05-05 23:56:58,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:56:58,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e0bf096243809b56ee71 HTTP/1.1" 200 None 2026-05-05 23:56:58,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:56:58,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-05 23:56:58,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:56:58,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e0bf096243809b56ee71 HTTP/1.1" 200 None 2026-05-05 23:56:58,913 - lava_callback - ERROR - Error processing callback for node 69f7e0bf096243809b56ee71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:58:21,489 - lava_callback - INFO - Received callback for node 69f7e10c096243809b56ee93 INFO: 172.21.0.1:58974 - "POST /node/69f7e10c096243809b56ee93 HTTP/1.0" 202 Accepted 2026-05-05 23:58:21,494 - lava_callback - INFO - Starting async job submit for node 69f7e10c096243809b56ee93 2026-05-05 23:58:21,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:58:21,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e10c096243809b56ee93 HTTP/1.1" 200 None 2026-05-05 23:58:21,510 - lava_callback - DEBUG - Processing node 69f7e10c096243809b56ee93: baseline-arm64-baylibre 2026-05-05 23:58:21,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e10c096243809b56ee93 2026-05-05 23:58:21,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:58:21,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e10c096243809b56ee93 HTTP/1.1" 200 None 2026-05-05 23:58:21,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:58:21,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-05 23:58:21,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:58:21,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e10c096243809b56ee93 HTTP/1.1" 200 None 2026-05-05 23:58:21,555 - lava_callback - ERROR - Error processing callback for node 69f7e10c096243809b56ee93: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44528 - "GET / HTTP/1.0" 200 OK 2026-05-05 23:59:38,989 - lava_callback - INFO - Received callback for node 69f7e155096243809b56eeb4 INFO: 172.21.0.1:44536 - "POST /node/69f7e155096243809b56eeb4 HTTP/1.0" 202 Accepted 2026-05-05 23:59:38,994 - lava_callback - INFO - Starting async job submit for node 69f7e155096243809b56eeb4 2026-05-05 23:59:38,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:59:39,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e155096243809b56eeb4 HTTP/1.1" 200 None 2026-05-05 23:59:39,014 - lava_callback - DEBUG - Processing node 69f7e155096243809b56eeb4: baseline-arm-clabbe 2026-05-05 23:59:39,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e155096243809b56eeb4 2026-05-05 23:59:39,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:59:39,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e155096243809b56eeb4 HTTP/1.1" 200 None 2026-05-05 23:59:39,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:59:39,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d33f46dc69a3a70b54bc HTTP/1.1" 200 None 2026-05-05 23:59:39,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 23:59:39,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e155096243809b56eeb4 HTTP/1.1" 200 None 2026-05-05 23:59:39,065 - lava_callback - ERROR - Error processing callback for node 69f7e155096243809b56eeb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK 2026-05-06 00:00:18,927 - lava_callback - INFO - Received callback for node 69f7e18a096243809b56eec5 INFO: 172.21.0.1:58638 - "POST /node/69f7e18a096243809b56eec5 HTTP/1.0" 202 Accepted 2026-05-06 00:00:18,937 - lava_callback - INFO - Starting async job submit for node 69f7e18a096243809b56eec5 2026-05-06 00:00:18,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:00:18,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e18a096243809b56eec5 HTTP/1.1" 200 None 2026-05-06 00:00:18,961 - lava_callback - DEBUG - Processing node 69f7e18a096243809b56eec5: baseline-arm64-clabbe 2026-05-06 00:00:18,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e18a096243809b56eec5 2026-05-06 00:00:18,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:00:18,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e18a096243809b56eec5 HTTP/1.1" 200 None 2026-05-06 00:00:18,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:00:19,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-06 00:00:19,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:00:19,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e18a096243809b56eec5 HTTP/1.1" 200 None 2026-05-06 00:00:19,046 - lava_callback - ERROR - Error processing callback for node 69f7e18a096243809b56eec5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35166 - "GET / HTTP/1.0" 200 OK 2026-05-06 00:01:59,128 - lava_callback - INFO - Received callback for node 69f7e1e2096243809b56eeea INFO: 172.21.0.1:35182 - "POST /node/69f7e1e2096243809b56eeea HTTP/1.0" 202 Accepted 2026-05-06 00:01:59,134 - lava_callback - INFO - Starting async job submit for node 69f7e1e2096243809b56eeea 2026-05-06 00:01:59,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:01:59,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e1e2096243809b56eeea HTTP/1.1" 200 None 2026-05-06 00:01:59,161 - lava_callback - DEBUG - Processing node 69f7e1e2096243809b56eeea: baseline-arm64-clabbe 2026-05-06 00:01:59,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e1e2096243809b56eeea 2026-05-06 00:01:59,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:01:59,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e1e2096243809b56eeea HTTP/1.1" 200 None 2026-05-06 00:01:59,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:01:59,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-06 00:01:59,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:01:59,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e1e2096243809b56eeea HTTP/1.1" 200 None 2026-05-06 00:01:59,229 - lava_callback - ERROR - Error processing callback for node 69f7e1e2096243809b56eeea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK 2026-05-06 00:03:19,121 - lava_callback - INFO - Received callback for node 69f7e236096243809b56ef0d INFO: 172.21.0.1:36998 - "POST /node/69f7e236096243809b56ef0d HTTP/1.0" 202 Accepted 2026-05-06 00:03:19,126 - lava_callback - INFO - Starting async job submit for node 69f7e236096243809b56ef0d 2026-05-06 00:03:19,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:03:19,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e236096243809b56ef0d HTTP/1.1" 200 None 2026-05-06 00:03:19,142 - lava_callback - DEBUG - Processing node 69f7e236096243809b56ef0d: baseline-arm64-clabbe 2026-05-06 00:03:19,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e236096243809b56ef0d 2026-05-06 00:03:19,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:03:19,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e236096243809b56ef0d HTTP/1.1" 200 None 2026-05-06 00:03:19,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:03:19,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-06 00:03:19,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:03:19,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e236096243809b56ef0d HTTP/1.1" 200 None 2026-05-06 00:03:19,189 - lava_callback - ERROR - Error processing callback for node 69f7e236096243809b56ef0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47892 - "GET / HTTP/1.0" 200 OK 2026-05-06 00:04:39,213 - lava_callback - INFO - Received callback for node 69f7e289096243809b56ef2b INFO: 172.21.0.1:47896 - "POST /node/69f7e289096243809b56ef2b HTTP/1.0" 202 Accepted 2026-05-06 00:04:39,220 - lava_callback - INFO - Starting async job submit for node 69f7e289096243809b56ef2b 2026-05-06 00:04:39,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:04:39,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e289096243809b56ef2b HTTP/1.1" 200 None 2026-05-06 00:04:39,235 - lava_callback - DEBUG - Processing node 69f7e289096243809b56ef2b: baseline-arm64-clabbe 2026-05-06 00:04:39,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e289096243809b56ef2b 2026-05-06 00:04:39,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:04:39,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e289096243809b56ef2b HTTP/1.1" 200 None 2026-05-06 00:04:39,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:04:39,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-06 00:04:39,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:04:39,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e289096243809b56ef2b HTTP/1.1" 200 None 2026-05-06 00:04:39,280 - lava_callback - ERROR - Error processing callback for node 69f7e289096243809b56ef2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38190 - "GET / HTTP/1.0" 200 OK 2026-05-06 00:05:59,289 - lava_callback - INFO - Received callback for node 69f7e2d9096243809b56ef50 INFO: 172.21.0.1:38192 - "POST /node/69f7e2d9096243809b56ef50 HTTP/1.0" 202 Accepted 2026-05-06 00:05:59,295 - lava_callback - INFO - Starting async job submit for node 69f7e2d9096243809b56ef50 2026-05-06 00:05:59,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:05:59,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e2d9096243809b56ef50 HTTP/1.1" 200 None 2026-05-06 00:05:59,325 - lava_callback - DEBUG - Processing node 69f7e2d9096243809b56ef50: baseline-arm64-clabbe 2026-05-06 00:05:59,325 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e2d9096243809b56ef50 2026-05-06 00:05:59,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:05:59,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e2d9096243809b56ef50 HTTP/1.1" 200 None 2026-05-06 00:05:59,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:05:59,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-06 00:05:59,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:05:59,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e2d9096243809b56ef50 HTTP/1.1" 200 None 2026-05-06 00:05:59,370 - lava_callback - ERROR - Error processing callback for node 69f7e2d9096243809b56ef50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45240 - "GET / HTTP/1.0" 200 OK 2026-05-06 00:07:19,340 - lava_callback - INFO - Received callback for node 69f7e329096243809b56ef7b INFO: 172.21.0.1:45250 - "POST /node/69f7e329096243809b56ef7b HTTP/1.0" 202 Accepted 2026-05-06 00:07:19,346 - lava_callback - INFO - Starting async job submit for node 69f7e329096243809b56ef7b 2026-05-06 00:07:19,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:07:19,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e329096243809b56ef7b HTTP/1.1" 200 None 2026-05-06 00:07:19,361 - lava_callback - DEBUG - Processing node 69f7e329096243809b56ef7b: baseline-arm64-clabbe 2026-05-06 00:07:19,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e329096243809b56ef7b 2026-05-06 00:07:19,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:07:19,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e329096243809b56ef7b HTTP/1.1" 200 None 2026-05-06 00:07:19,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:07:19,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4d34f46dc69a3a70b54cb HTTP/1.1" 200 None 2026-05-06 00:07:19,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:07:19,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e329096243809b56ef7b HTTP/1.1" 200 None 2026-05-06 00:07:19,408 - lava_callback - ERROR - Error processing callback for node 69f7e329096243809b56ef7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58386 - "GET / HTTP/1.0" 200 OK 2026-05-06 00:08:21,934 - lava_callback - INFO - Received callback for node 69f7e370096243809b56ef9c INFO: 172.21.0.1:51498 - "POST /node/69f7e370096243809b56ef9c HTTP/1.0" 202 Accepted 2026-05-06 00:08:21,939 - lava_callback - INFO - Starting async job submit for node 69f7e370096243809b56ef9c 2026-05-06 00:08:21,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:08:21,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e370096243809b56ef9c HTTP/1.1" 200 None 2026-05-06 00:08:21,955 - lava_callback - DEBUG - Processing node 69f7e370096243809b56ef9c: baseline-arm64-baylibre 2026-05-06 00:08:21,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e370096243809b56ef9c 2026-05-06 00:08:21,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:08:21,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e370096243809b56ef9c HTTP/1.1" 200 None 2026-05-06 00:08:21,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:08:21,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-06 00:08:21,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:08:22,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e370096243809b56ef9c HTTP/1.1" 200 None 2026-05-06 00:08:22,008 - lava_callback - ERROR - Error processing callback for node 69f7e370096243809b56ef9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK 2026-05-06 00:09:59,426 - lava_callback - INFO - Received callback for node 69f7e3c7096243809b56efc1 INFO: 172.21.0.1:36808 - "POST /node/69f7e3c7096243809b56efc1 HTTP/1.0" 202 Accepted 2026-05-06 00:09:59,431 - lava_callback - INFO - Starting async job submit for node 69f7e3c7096243809b56efc1 2026-05-06 00:09:59,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:09:59,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e3c7096243809b56efc1 HTTP/1.1" 200 None 2026-05-06 00:09:59,447 - lava_callback - DEBUG - Processing node 69f7e3c7096243809b56efc1: baseline-arm64-clabbe 2026-05-06 00:09:59,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e3c7096243809b56efc1 2026-05-06 00:09:59,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:09:59,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e3c7096243809b56efc1 HTTP/1.1" 200 None 2026-05-06 00:09:59,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:09:59,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-06 00:09:59,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:09:59,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e3c7096243809b56efc1 HTTP/1.1" 200 None 2026-05-06 00:09:59,511 - lava_callback - ERROR - Error processing callback for node 69f7e3c7096243809b56efc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56334 - "GET / HTTP/1.0" 200 OK 2026-05-06 00:11:19,496 - lava_callback - INFO - Received callback for node 69f7e416096243809b56efe8 INFO: 172.21.0.1:56338 - "POST /node/69f7e416096243809b56efe8 HTTP/1.0" 202 Accepted 2026-05-06 00:11:19,502 - lava_callback - INFO - Starting async job submit for node 69f7e416096243809b56efe8 2026-05-06 00:11:19,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:11:19,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e416096243809b56efe8 HTTP/1.1" 200 None 2026-05-06 00:11:19,519 - lava_callback - DEBUG - Processing node 69f7e416096243809b56efe8: baseline-arm64-clabbe 2026-05-06 00:11:19,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e416096243809b56efe8 2026-05-06 00:11:19,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:11:19,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e416096243809b56efe8 HTTP/1.1" 200 None 2026-05-06 00:11:19,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:11:19,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f4879fec4729f146b42fc9 HTTP/1.1" 200 None 2026-05-06 00:11:19,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:11:19,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e416096243809b56efe8 HTTP/1.1" 200 None 2026-05-06 00:11:19,565 - lava_callback - ERROR - Error processing callback for node 69f7e416096243809b56efe8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56130 - "GET / HTTP/1.0" 200 OK 2026-05-06 00:12:22,143 - lava_callback - INFO - Received callback for node 69f7e45d096243809b56f003 INFO: 172.21.0.1:42852 - "POST /node/69f7e45d096243809b56f003 HTTP/1.0" 202 Accepted 2026-05-06 00:12:22,149 - lava_callback - INFO - Starting async job submit for node 69f7e45d096243809b56f003 2026-05-06 00:12:22,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:12:22,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e45d096243809b56f003 HTTP/1.1" 200 None 2026-05-06 00:12:22,164 - lava_callback - DEBUG - Processing node 69f7e45d096243809b56f003: baseline-arm64-baylibre 2026-05-06 00:12:22,165 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f7e45d096243809b56f003 2026-05-06 00:12:22,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:12:22,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e45d096243809b56f003 HTTP/1.1" 200 None 2026-05-06 00:12:22,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:12:22,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f22f45f5ce4820821ef7fa HTTP/1.1" 200 None 2026-05-06 00:12:22,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-06 00:12:22,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f7e45d096243809b56f003 HTTP/1.1" 200 None 2026-05-06 00:12:22,211 - lava_callback - ERROR - Error processing callback for node 69f7e45d096243809b56f003: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]