INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50994 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:33:53,201 - lava_callback - INFO - Received callback for node 69b12878a870a1dc3343bac8 2026-03-11 08:33:53,208 - lava_callback - INFO - Starting async job submit for node 69b12878a870a1dc3343bac8 INFO: 172.21.0.1:39072 - "POST /node/69b12878a870a1dc3343bac8 HTTP/1.0" 202 Accepted 2026-03-11 08:33:53,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:33:53,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12878a870a1dc3343bac8 HTTP/1.1" 200 None 2026-03-11 08:33:53,281 - lava_callback - DEBUG - Processing node 69b12878a870a1dc3343bac8: baseline-arm 2026-03-11 08:33:53,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:33:53,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:33:53,727 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b12878a870a1dc3343bac8/log.txt.gz 2026-03-11 08:33:53,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:33:54,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:33:54,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b12878a870a1dc3343bac8/lava-logs.yaml 2026-03-11 08:33:54,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:33:54,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:33:54,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b12878a870a1dc3343bac8/lava_callback.json.gz 2026-03-11 08:33:54,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:33:54,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12878a870a1dc3343bac8 HTTP/1.1" 200 None 2026-03-11 08:33:54,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:33:54,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12599a870a1dc3343ba8b HTTP/1.1" 200 None 2026-03-11 08:33:54,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:33:54,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12878a870a1dc3343bac8 HTTP/1.1" 200 None 2026-03-11 08:33:54,286 - lava_callback - INFO - Completed processing callback for node 69b12878a870a1dc3343bac8 INFO: 172.21.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36774 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:34:24,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:34:24,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:38:35,443 - lava_callback - INFO - Received callback for node 69b129eea870a1dc3343bae8 INFO: 172.21.0.1:52416 - "POST /node/69b129eea870a1dc3343bae8 HTTP/1.0" 202 Accepted 2026-03-11 08:38:35,490 - lava_callback - INFO - Starting async job submit for node 69b129eea870a1dc3343bae8 2026-03-11 08:38:35,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:35,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eea870a1dc3343bae8 HTTP/1.1" 200 None 2026-03-11 08:38:35,525 - lava_callback - DEBUG - Processing node 69b129eea870a1dc3343bae8: baseline-arm 2026-03-11 08:38:35,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:35,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:35,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343bae8/log.txt.gz 2026-03-11 08:38:35,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:36,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:36,186 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343bae8/lava-logs.yaml 2026-03-11 08:38:36,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:36,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:36,318 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343bae8/lava_callback.json.gz 2026-03-11 08:38:36,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:36,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eea870a1dc3343bae8 HTTP/1.1" 200 None 2026-03-11 08:38:36,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:36,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:38:36,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:36,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129eea870a1dc3343bae8 HTTP/1.1" 200 None 2026-03-11 08:38:36,410 - lava_callback - INFO - Completed processing callback for node 69b129eea870a1dc3343bae8 INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:38:36,558 - lava_callback - INFO - Received callback for node 69b129eda870a1dc3343bae5 INFO: 172.21.0.1:52424 - "POST /node/69b129eda870a1dc3343bae5 HTTP/1.0" 202 Accepted 2026-03-11 08:38:36,568 - lava_callback - INFO - Starting async job submit for node 69b129eda870a1dc3343bae5 2026-03-11 08:38:36,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:36,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eda870a1dc3343bae5 HTTP/1.1" 200 None 2026-03-11 08:38:36,603 - lava_callback - DEBUG - Processing node 69b129eda870a1dc3343bae5: baseline-arm 2026-03-11 08:38:36,611 - lava_callback - WARNING - Failed to upload log 2026-03-11 08:38:36,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:36,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:36,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eda870a1dc3343bae5/lava-logs.yaml 2026-03-11 08:38:36,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:36,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:36,959 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eda870a1dc3343bae5/lava_callback.json.gz 2026-03-11 08:38:36,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:36,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eda870a1dc3343bae5 HTTP/1.1" 200 None 2026-03-11 08:38:36,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:37,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:38:37,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:37,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129eda870a1dc3343bae5 HTTP/1.1" 200 None 2026-03-11 08:38:37,037 - lava_callback - INFO - Completed processing callback for node 69b129eda870a1dc3343bae5 INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:38:54,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:54,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 08:38:54,632 - lava_callback - INFO - Received callback for node 69b129f1a870a1dc3343baf1 INFO: 172.21.0.1:46210 - "POST /node/69b129f1a870a1dc3343baf1 HTTP/1.0" 202 Accepted 2026-03-11 08:38:54,681 - lava_callback - INFO - Starting async job submit for node 69b129f1a870a1dc3343baf1 2026-03-11 08:38:54,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:54,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f1a870a1dc3343baf1 HTTP/1.1" 200 None 2026-03-11 08:38:54,714 - lava_callback - DEBUG - Processing node 69b129f1a870a1dc3343baf1: baseline-arm 2026-03-11 08:38:54,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:54,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:54,981 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f1a870a1dc3343baf1/log.txt.gz 2026-03-11 08:38:55,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:55,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:55,315 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f1a870a1dc3343baf1/lava-logs.yaml 2026-03-11 08:38:55,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:55,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:55,437 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f1a870a1dc3343baf1/lava_callback.json.gz 2026-03-11 08:38:55,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:55,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f1a870a1dc3343baf1 HTTP/1.1" 200 None 2026-03-11 08:38:55,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:55,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:38:55,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:55,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129f1a870a1dc3343baf1 HTTP/1.1" 200 None 2026-03-11 08:38:55,521 - lava_callback - INFO - Completed processing callback for node 69b129f1a870a1dc3343baf1 INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:39:24,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:24,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:39:39,300 - lava_callback - INFO - Received callback for node 69b12a0ea870a1dc3343bb77 INFO: 172.21.0.1:56802 - "POST /node/69b12a0ea870a1dc3343bb77 HTTP/1.0" 202 Accepted 2026-03-11 08:39:39,345 - lava_callback - INFO - Starting async job submit for node 69b12a0ea870a1dc3343bb77 2026-03-11 08:39:39,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:39,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0ea870a1dc3343bb77 HTTP/1.1" 200 None 2026-03-11 08:39:39,392 - lava_callback - DEBUG - Processing node 69b12a0ea870a1dc3343bb77: baseline-arm-pengutronix 2026-03-11 08:39:39,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:39,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:39,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ea870a1dc3343bb77/log.txt.gz 2026-03-11 08:39:39,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:39,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:39,897 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ea870a1dc3343bb77/lava-logs.yaml 2026-03-11 08:39:39,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:40,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:40,049 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ea870a1dc3343bb77/lava_callback.json.gz 2026-03-11 08:39:40,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:40,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0ea870a1dc3343bb77 HTTP/1.1" 200 None 2026-03-11 08:39:40,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:40,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:39:40,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:40,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a0ea870a1dc3343bb77 HTTP/1.1" 200 None 2026-03-11 08:39:40,153 - lava_callback - INFO - Completed processing callback for node 69b12a0ea870a1dc3343bb77 2026-03-11 08:39:44,972 - lava_callback - INFO - Received callback for node 69b12a0ba870a1dc3343bb6b INFO: 172.21.0.1:59564 - "POST /node/69b12a0ba870a1dc3343bb6b HTTP/1.0" 202 Accepted 2026-03-11 08:39:44,978 - lava_callback - INFO - Starting async job submit for node 69b12a0ba870a1dc3343bb6b 2026-03-11 08:39:44,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:45,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0ba870a1dc3343bb6b HTTP/1.1" 200 None 2026-03-11 08:39:45,012 - lava_callback - DEBUG - Processing node 69b12a0ba870a1dc3343bb6b: baseline-arm-pengutronix 2026-03-11 08:39:45,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:45,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:45,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ba870a1dc3343bb6b/log.txt.gz 2026-03-11 08:39:45,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:45,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:45,642 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ba870a1dc3343bb6b/lava-logs.yaml 2026-03-11 08:39:45,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:45,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:45,778 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ba870a1dc3343bb6b/lava_callback.json.gz 2026-03-11 08:39:45,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:45,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0ba870a1dc3343bb6b HTTP/1.1" 200 None 2026-03-11 08:39:45,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:45,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:39:45,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:45,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a0ba870a1dc3343bb6b HTTP/1.1" 200 None 2026-03-11 08:39:45,908 - lava_callback - INFO - Completed processing callback for node 69b12a0ba870a1dc3343bb6b INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:39:53,416 - lava_callback - INFO - Received callback for node 69b129fba870a1dc3343bb06 INFO: 172.21.0.1:38496 - "POST /node/69b129fba870a1dc3343bb06 HTTP/1.0" 202 Accepted 2026-03-11 08:39:53,424 - lava_callback - INFO - Starting async job submit for node 69b129fba870a1dc3343bb06 2026-03-11 08:39:53,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:53,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129fba870a1dc3343bb06 HTTP/1.1" 200 None 2026-03-11 08:39:53,461 - lava_callback - DEBUG - Processing node 69b129fba870a1dc3343bb06: baseline-arm-broonie 2026-03-11 08:39:53,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:53,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:53,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fba870a1dc3343bb06/log.txt.gz 2026-03-11 08:39:53,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:54,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:54,113 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fba870a1dc3343bb06/lava-logs.yaml 2026-03-11 08:39:54,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:54,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:54,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fba870a1dc3343bb06/lava_callback.json.gz 2026-03-11 08:39:54,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:54,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129fba870a1dc3343bb06 HTTP/1.1" 200 None 2026-03-11 08:39:54,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:54,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:39:54,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:54,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129fba870a1dc3343bb06 HTTP/1.1" 200 None 2026-03-11 08:39:54,334 - lava_callback - INFO - Completed processing callback for node 69b129fba870a1dc3343bb06 2026-03-11 08:39:54,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:54,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 08:39:54,883 - lava_callback - INFO - Received callback for node 69b129eca870a1dc3343bae2 INFO: 172.21.0.1:38504 - "POST /node/69b129eca870a1dc3343bae2 HTTP/1.0" 202 Accepted 2026-03-11 08:39:54,889 - lava_callback - INFO - Starting async job submit for node 69b129eca870a1dc3343bae2 2026-03-11 08:39:54,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:54,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eca870a1dc3343bae2 HTTP/1.1" 200 None 2026-03-11 08:39:54,935 - lava_callback - DEBUG - Processing node 69b129eca870a1dc3343bae2: baseline-arm 2026-03-11 08:39:55,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:55,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:55,235 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eca870a1dc3343bae2/log.txt.gz 2026-03-11 08:39:55,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:55,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:55,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eca870a1dc3343bae2/lava-logs.yaml 2026-03-11 08:39:55,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:55,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:55,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eca870a1dc3343bae2/lava_callback.json.gz 2026-03-11 08:39:55,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:55,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eca870a1dc3343bae2 HTTP/1.1" 200 None 2026-03-11 08:39:55,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:55,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:39:55,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:55,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129eca870a1dc3343bae2 HTTP/1.1" 200 None 2026-03-11 08:39:55,765 - lava_callback - INFO - Completed processing callback for node 69b129eca870a1dc3343bae2 INFO: 172.21.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:40:09,937 - lava_callback - INFO - Received callback for node 69b12a00a870a1dc3343bb18 INFO: 172.21.0.1:40794 - "POST /node/69b12a00a870a1dc3343bb18 HTTP/1.0" 202 Accepted 2026-03-11 08:40:09,943 - lava_callback - INFO - Starting async job submit for node 69b12a00a870a1dc3343bb18 2026-03-11 08:40:09,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:09,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a00a870a1dc3343bb18 HTTP/1.1" 200 None 2026-03-11 08:40:09,978 - lava_callback - DEBUG - Processing node 69b12a00a870a1dc3343bb18: baseline-arm-clabbe 2026-03-11 08:40:10,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:10,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:10,353 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a00a870a1dc3343bb18/log.txt.gz 2026-03-11 08:40:10,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:10,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:10,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a00a870a1dc3343bb18/lava-logs.yaml 2026-03-11 08:40:10,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:10,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:10,828 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a00a870a1dc3343bb18/lava_callback.json.gz 2026-03-11 08:40:10,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:10,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a00a870a1dc3343bb18 HTTP/1.1" 200 None 2026-03-11 08:40:10,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:10,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:40:10,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:10,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a00a870a1dc3343bb18 HTTP/1.1" 200 None 2026-03-11 08:40:10,912 - lava_callback - INFO - Completed processing callback for node 69b12a00a870a1dc3343bb18 2026-03-11 08:40:13,662 - lava_callback - INFO - Received callback for node 69b129faa870a1dc3343baff INFO: 172.21.0.1:40796 - "POST /node/69b129faa870a1dc3343baff HTTP/1.0" 202 Accepted 2026-03-11 08:40:13,668 - lava_callback - INFO - Starting async job submit for node 69b129faa870a1dc3343baff 2026-03-11 08:40:13,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:13,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129faa870a1dc3343baff HTTP/1.1" 200 None 2026-03-11 08:40:13,705 - lava_callback - DEBUG - Processing node 69b129faa870a1dc3343baff: baseline-arm-broonie 2026-03-11 08:40:13,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:14,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:14,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129faa870a1dc3343baff/log.txt.gz 2026-03-11 08:40:14,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:14,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:14,327 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129faa870a1dc3343baff/lava-logs.yaml 2026-03-11 08:40:14,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:14,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:14,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129faa870a1dc3343baff/lava_callback.json.gz 2026-03-11 08:40:14,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:14,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129faa870a1dc3343baff HTTP/1.1" 200 None 2026-03-11 08:40:14,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:14,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:40:14,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:14,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129faa870a1dc3343baff HTTP/1.1" 200 None 2026-03-11 08:40:14,568 - lava_callback - INFO - Completed processing callback for node 69b129faa870a1dc3343baff INFO: 172.21.0.1:40812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40828 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:40:19,106 - lava_callback - INFO - Received callback for node 69b129fca870a1dc3343bb09 INFO: 172.21.0.1:40844 - "POST /node/69b129fca870a1dc3343bb09 HTTP/1.0" 202 Accepted 2026-03-11 08:40:19,112 - lava_callback - INFO - Starting async job submit for node 69b129fca870a1dc3343bb09 2026-03-11 08:40:19,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:19,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129fca870a1dc3343bb09 HTTP/1.1" 200 None 2026-03-11 08:40:19,151 - lava_callback - DEBUG - Processing node 69b129fca870a1dc3343bb09: baseline-arm-broonie 2026-03-11 08:40:19,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:19,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:19,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fca870a1dc3343bb09/log.txt.gz 2026-03-11 08:40:19,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:19,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:19,861 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fca870a1dc3343bb09/lava-logs.yaml 2026-03-11 08:40:19,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:20,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:20,026 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fca870a1dc3343bb09/lava_callback.json.gz 2026-03-11 08:40:20,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:20,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129fca870a1dc3343bb09 HTTP/1.1" 200 None 2026-03-11 08:40:20,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:20,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:40:20,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:20,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129fca870a1dc3343bb09 HTTP/1.1" 200 None 2026-03-11 08:40:20,106 - lava_callback - INFO - Completed processing callback for node 69b129fca870a1dc3343bb09 2026-03-11 08:40:20,432 - lava_callback - INFO - Received callback for node 69b12a09a870a1dc3343bb60 INFO: 172.21.0.1:48176 - "POST /node/69b12a09a870a1dc3343bb60 HTTP/1.0" 202 Accepted 2026-03-11 08:40:20,442 - lava_callback - INFO - Starting async job submit for node 69b12a09a870a1dc3343bb60 2026-03-11 08:40:20,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:20,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a09a870a1dc3343bb60 HTTP/1.1" 200 None 2026-03-11 08:40:20,493 - lava_callback - DEBUG - Processing node 69b12a09a870a1dc3343bb60: baseline-arm-kontron 2026-03-11 08:40:20,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:20,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:20,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b12a09a870a1dc3343bb60/log.txt.gz 2026-03-11 08:40:20,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:21,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:21,090 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b12a09a870a1dc3343bb60/lava-logs.yaml 2026-03-11 08:40:21,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:21,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:21,242 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b12a09a870a1dc3343bb60/lava_callback.json.gz 2026-03-11 08:40:21,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:21,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a09a870a1dc3343bb60 HTTP/1.1" 200 None 2026-03-11 08:40:21,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:21,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:40:21,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:21,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a09a870a1dc3343bb60 HTTP/1.1" 200 None 2026-03-11 08:40:21,327 - lava_callback - INFO - Completed processing callback for node 69b12a09a870a1dc3343bb60 2026-03-11 08:40:24,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:24,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:40:59,096 - lava_callback - INFO - Received callback for node 69b129f8a870a1dc3343bafc INFO: 172.21.0.1:53260 - "POST /node/69b129f8a870a1dc3343bafc HTTP/1.0" 202 Accepted 2026-03-11 08:40:59,103 - lava_callback - INFO - Starting async job submit for node 69b129f8a870a1dc3343bafc 2026-03-11 08:40:59,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:59,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f8a870a1dc3343bafc HTTP/1.1" 200 None 2026-03-11 08:40:59,142 - lava_callback - DEBUG - Processing node 69b129f8a870a1dc3343bafc: baseline-arm-broonie 2026-03-11 08:40:59,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:59,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:59,499 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129f8a870a1dc3343bafc/log.txt.gz 2026-03-11 08:40:59,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:59,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:59,814 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129f8a870a1dc3343bafc/lava-logs.yaml 2026-03-11 08:40:59,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:59,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:59,958 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129f8a870a1dc3343bafc/lava_callback.json.gz 2026-03-11 08:40:59,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:59,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f8a870a1dc3343bafc HTTP/1.1" 200 None 2026-03-11 08:40:59,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:00,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:41:00,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:00,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129f8a870a1dc3343bafc HTTP/1.1" 200 None 2026-03-11 08:41:00,073 - lava_callback - INFO - Completed processing callback for node 69b129f8a870a1dc3343bafc INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:41:24,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:24,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:41:57,190 - lava_callback - INFO - Received callback for node 69b12a01a870a1dc3343bb1c INFO: 172.21.0.1:47432 - "POST /node/69b12a01a870a1dc3343bb1c HTTP/1.0" 202 Accepted 2026-03-11 08:41:57,199 - lava_callback - INFO - Starting async job submit for node 69b12a01a870a1dc3343bb1c 2026-03-11 08:41:57,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:57,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a01a870a1dc3343bb1c HTTP/1.1" 200 None 2026-03-11 08:41:57,272 - lava_callback - DEBUG - Processing node 69b12a01a870a1dc3343bb1c: baseline-arm-clabbe 2026-03-11 08:41:57,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:41:57,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:41:57,990 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a01a870a1dc3343bb1c/log.txt.gz 2026-03-11 08:41:58,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:41:58,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:41:58,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a01a870a1dc3343bb1c/lava-logs.yaml 2026-03-11 08:41:58,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:41:59,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:41:59,173 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a01a870a1dc3343bb1c/lava_callback.json.gz 2026-03-11 08:41:59,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:59,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a01a870a1dc3343bb1c HTTP/1.1" 200 None 2026-03-11 08:41:59,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:59,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:41:59,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:59,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a01a870a1dc3343bb1c HTTP/1.1" 200 None 2026-03-11 08:41:59,309 - lava_callback - INFO - Completed processing callback for node 69b12a01a870a1dc3343bb1c INFO: 172.21.0.1:39266 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:42:09,596 - lava_callback - INFO - Received callback for node 69b12ad9a870a1dc3343bc68 INFO: 172.21.0.1:39282 - "POST /node/69b12ad9a870a1dc3343bc68 HTTP/1.0" 202 Accepted 2026-03-11 08:42:09,605 - lava_callback - INFO - Starting async job submit for node 69b12ad9a870a1dc3343bc68 2026-03-11 08:42:09,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:42:09,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ad9a870a1dc3343bc68 HTTP/1.1" 200 None 2026-03-11 08:42:09,638 - lava_callback - DEBUG - Processing node 69b12ad9a870a1dc3343bc68: baseline-arm 2026-03-11 08:42:09,646 - lava_callback - WARNING - Failed to upload log 2026-03-11 08:42:09,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:42:10,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:42:10,052 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b12ad9a870a1dc3343bc68/lava-logs.yaml 2026-03-11 08:42:10,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:42:10,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:42:10,449 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b12ad9a870a1dc3343bc68/lava_callback.json.gz 2026-03-11 08:42:10,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:42:10,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ad9a870a1dc3343bc68 HTTP/1.1" 200 None 2026-03-11 08:42:10,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:42:10,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:42:10,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:42:10,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12ad9a870a1dc3343bc68 HTTP/1.1" 200 None 2026-03-11 08:42:10,563 - lava_callback - INFO - Completed processing callback for node 69b12ad9a870a1dc3343bc68 INFO: 172.21.0.1:58908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:42:24,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:42:24,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:43:36,045 - lava_callback - INFO - Received callback for node 69b12a05a870a1dc3343bb29 INFO: 172.21.0.1:35608 - "POST /node/69b12a05a870a1dc3343bb29 HTTP/1.0" 202 Accepted 2026-03-11 08:43:36,051 - lava_callback - INFO - Starting async job submit for node 69b12a05a870a1dc3343bb29 2026-03-11 08:43:36,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:36,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a05a870a1dc3343bb29 HTTP/1.1" 200 None 2026-03-11 08:43:36,088 - lava_callback - DEBUG - Processing node 69b12a05a870a1dc3343bb29: baseline-arm-clabbe 2026-03-11 08:43:36,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:43:36,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:43:36,443 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a05a870a1dc3343bb29/log.txt.gz INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:43:36,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:43:36,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:43:36,797 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a05a870a1dc3343bb29/lava-logs.yaml 2026-03-11 08:43:36,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:43:36,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:43:36,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a05a870a1dc3343bb29/lava_callback.json.gz 2026-03-11 08:43:36,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:36,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a05a870a1dc3343bb29 HTTP/1.1" 200 None 2026-03-11 08:43:36,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:37,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:43:37,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:37,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a05a870a1dc3343bb29 HTTP/1.1" 200 None 2026-03-11 08:43:37,040 - lava_callback - INFO - Completed processing callback for node 69b12a05a870a1dc3343bb29 INFO: 172.21.0.1:36348 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:43:54,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:54,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55412 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:43:59,337 - lava_callback - INFO - Received callback for node 69b12a36a870a1dc3343bbc6 INFO: 172.21.0.1:55414 - "POST /node/69b12a36a870a1dc3343bbc6 HTTP/1.0" 202 Accepted 2026-03-11 08:43:59,347 - lava_callback - INFO - Starting async job submit for node 69b12a36a870a1dc3343bbc6 2026-03-11 08:43:59,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:59,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a36a870a1dc3343bbc6 HTTP/1.1" 200 None 2026-03-11 08:43:59,403 - lava_callback - DEBUG - Processing node 69b12a36a870a1dc3343bbc6: ltp-syscalls 2026-03-11 08:44:00,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:00,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:00,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b12a36a870a1dc3343bbc6/log.txt.gz 2026-03-11 08:44:00,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:01,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:01,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b12a36a870a1dc3343bbc6/lava-logs.yaml 2026-03-11 08:44:01,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:01,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:01,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b12a36a870a1dc3343bbc6/lava_callback.json.gz 2026-03-11 08:44:01,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:01,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a36a870a1dc3343bbc6 HTTP/1.1" 200 None 2026-03-11 08:44:01,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:01,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:44:01,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:01,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a36a870a1dc3343bbc6 HTTP/1.1" 200 None 2026-03-11 08:44:01,363 - lava_callback - INFO - Completed processing callback for node 69b12a36a870a1dc3343bbc6 INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:44:19,164 - lava_callback - INFO - Received callback for node 69b12a1ea870a1dc3343bb82 INFO: 172.21.0.1:42200 - "POST /node/69b12a1ea870a1dc3343bb82 HTTP/1.0" 202 Accepted 2026-03-11 08:44:19,170 - lava_callback - INFO - Starting async job submit for node 69b12a1ea870a1dc3343bb82 2026-03-11 08:44:19,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:19,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a1ea870a1dc3343bb82 HTTP/1.1" 200 None 2026-03-11 08:44:19,211 - lava_callback - DEBUG - Processing node 69b12a1ea870a1dc3343bb82: ltp-cap_bounds 2026-03-11 08:44:19,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:19,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:19,752 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b12a1ea870a1dc3343bb82/log.txt.gz 2026-03-11 08:44:19,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:20,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:20,188 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b12a1ea870a1dc3343bb82/lava-logs.yaml 2026-03-11 08:44:20,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:20,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:20,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b12a1ea870a1dc3343bb82/lava_callback.json.gz 2026-03-11 08:44:20,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:20,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a1ea870a1dc3343bb82 HTTP/1.1" 200 None 2026-03-11 08:44:20,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:20,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:44:20,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:20,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a1ea870a1dc3343bb82 HTTP/1.1" 200 None 2026-03-11 08:44:20,443 - lava_callback - INFO - Completed processing callback for node 69b12a1ea870a1dc3343bb82 2026-03-11 08:44:24,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:24,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:45:13,709 - lava_callback - INFO - Received callback for node 69b12a20a870a1dc3343bb89 INFO: 172.21.0.1:43960 - "POST /node/69b12a20a870a1dc3343bb89 HTTP/1.0" 202 Accepted 2026-03-11 08:45:13,715 - lava_callback - INFO - Starting async job submit for node 69b12a20a870a1dc3343bb89 2026-03-11 08:45:13,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:13,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a20a870a1dc3343bb89 HTTP/1.1" 200 None 2026-03-11 08:45:13,754 - lava_callback - DEBUG - Processing node 69b12a20a870a1dc3343bb89: ltp-containers 2026-03-11 08:45:14,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:14,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:14,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69b12a20a870a1dc3343bb89/log.txt.gz 2026-03-11 08:45:14,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:14,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:14,731 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69b12a20a870a1dc3343bb89/lava-logs.yaml 2026-03-11 08:45:14,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:14,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:14,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69b12a20a870a1dc3343bb89/lava_callback.json.gz 2026-03-11 08:45:14,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:14,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a20a870a1dc3343bb89 HTTP/1.1" 200 None 2026-03-11 08:45:14,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:14,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:45:14,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:15,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a20a870a1dc3343bb89 HTTP/1.1" 200 None 2026-03-11 08:45:15,032 - lava_callback - INFO - Completed processing callback for node 69b12a20a870a1dc3343bb89 INFO: 172.21.0.1:43962 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 08:45:15,208 - lava_callback - INFO - Received callback for node 69b12a06a870a1dc3343bb2c INFO: 172.21.0.1:43970 - "POST /node/69b12a06a870a1dc3343bb2c HTTP/1.0" 202 Accepted 2026-03-11 08:45:15,218 - lava_callback - INFO - Starting async job submit for node 69b12a06a870a1dc3343bb2c 2026-03-11 08:45:15,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:15,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a06a870a1dc3343bb2c HTTP/1.1" 200 None 2026-03-11 08:45:15,271 - lava_callback - DEBUG - Processing node 69b12a06a870a1dc3343bb2c: baseline-arm-clabbe 2026-03-11 08:45:15,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:15,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:15,651 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a06a870a1dc3343bb2c/log.txt.gz 2026-03-11 08:45:15,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:15,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:15,973 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a06a870a1dc3343bb2c/lava-logs.yaml 2026-03-11 08:45:15,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:16,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:16,154 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a06a870a1dc3343bb2c/lava_callback.json.gz 2026-03-11 08:45:16,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:16,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a06a870a1dc3343bb2c HTTP/1.1" 200 None 2026-03-11 08:45:16,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:16,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:45:16,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:16,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a06a870a1dc3343bb2c HTTP/1.1" 200 None 2026-03-11 08:45:16,242 - lava_callback - INFO - Completed processing callback for node 69b12a06a870a1dc3343bb2c INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:45:19,467 - lava_callback - INFO - Received callback for node 69b12a21a870a1dc3343bb90 INFO: 172.21.0.1:43982 - "POST /node/69b12a21a870a1dc3343bb90 HTTP/1.0" 202 Accepted 2026-03-11 08:45:19,475 - lava_callback - INFO - Starting async job submit for node 69b12a21a870a1dc3343bb90 2026-03-11 08:45:19,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:19,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a21a870a1dc3343bb90 HTTP/1.1" 200 None 2026-03-11 08:45:19,524 - lava_callback - DEBUG - Processing node 69b12a21a870a1dc3343bb90: ltp-controllers 2026-03-11 08:45:19,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:20,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:20,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69b12a21a870a1dc3343bb90/log.txt.gz 2026-03-11 08:45:20,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:20,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:20,598 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69b12a21a870a1dc3343bb90/lava-logs.yaml 2026-03-11 08:45:20,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:20,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:20,768 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69b12a21a870a1dc3343bb90/lava_callback.json.gz 2026-03-11 08:45:20,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:20,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a21a870a1dc3343bb90 HTTP/1.1" 200 None 2026-03-11 08:45:20,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:20,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:45:20,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:20,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a21a870a1dc3343bb90 HTTP/1.1" 200 None 2026-03-11 08:45:20,870 - lava_callback - INFO - Completed processing callback for node 69b12a21a870a1dc3343bb90 2026-03-11 08:45:24,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:24,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:45:39,828 - lava_callback - INFO - Received callback for node 69b12a24a870a1dc3343bbab INFO: 172.21.0.1:42584 - "POST /node/69b12a24a870a1dc3343bbab HTTP/1.0" 202 Accepted 2026-03-11 08:45:39,835 - lava_callback - INFO - Starting async job submit for node 69b12a24a870a1dc3343bbab 2026-03-11 08:45:39,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:39,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a24a870a1dc3343bbab HTTP/1.1" 200 None 2026-03-11 08:45:39,875 - lava_callback - DEBUG - Processing node 69b12a24a870a1dc3343bbab: ltp-cve 2026-03-11 08:45:40,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:40,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:40,379 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69b12a24a870a1dc3343bbab/log.txt.gz 2026-03-11 08:45:40,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:40,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:40,887 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69b12a24a870a1dc3343bbab/lava-logs.yaml 2026-03-11 08:45:40,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:41,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:41,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69b12a24a870a1dc3343bbab/lava_callback.json.gz 2026-03-11 08:45:41,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:41,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a24a870a1dc3343bbab HTTP/1.1" 200 None 2026-03-11 08:45:41,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:41,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:45:41,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:41,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a24a870a1dc3343bbab HTTP/1.1" 200 None 2026-03-11 08:45:41,200 - lava_callback - INFO - Completed processing callback for node 69b12a24a870a1dc3343bbab INFO: 172.21.0.1:42600 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:45:54,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:54,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:46:51,683 - lava_callback - INFO - Received callback for node 69b12be7a870a1dc3343bd14 INFO: 172.21.0.1:40862 - "POST /node/69b12be7a870a1dc3343bd14 HTTP/1.0" 202 Accepted 2026-03-11 08:46:51,689 - lava_callback - INFO - Starting async job submit for node 69b12be7a870a1dc3343bd14 2026-03-11 08:46:51,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:46:51,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12be7a870a1dc3343bd14 HTTP/1.1" 200 None 2026-03-11 08:46:51,709 - lava_callback - DEBUG - Processing node 69b12be7a870a1dc3343bd14: baseline-arm 2026-03-11 08:46:51,714 - lava_callback - WARNING - Failed to upload log 2026-03-11 08:46:51,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:46:51,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:46:51,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b12be7a870a1dc3343bd14/lava-logs.yaml 2026-03-11 08:46:51,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:46:52,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:46:52,037 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b12be7a870a1dc3343bd14/lava_callback.json.gz 2026-03-11 08:46:52,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:46:52,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12be7a870a1dc3343bd14 HTTP/1.1" 200 None 2026-03-11 08:46:52,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:46:52,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:46:52,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:46:52,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12be7a870a1dc3343bd14 HTTP/1.1" 200 None 2026-03-11 08:46:52,102 - lava_callback - INFO - Completed processing callback for node 69b12be7a870a1dc3343bd14 2026-03-11 08:46:54,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:46:54,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:47:55,713 - lava_callback - INFO - Received callback for node 69ae8928c660ead8a389aebd INFO: 172.21.0.1:46496 - "POST /node/69ae8928c660ead8a389aebd HTTP/1.0" 202 Accepted 2026-03-11 08:47:55,718 - lava_callback - INFO - Starting async job submit for node 69ae8928c660ead8a389aebd 2026-03-11 08:47:55,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:55,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8928c660ead8a389aebd HTTP/1.1" 200 None 2026-03-11 08:47:55,734 - lava_callback - DEBUG - Processing node 69ae8928c660ead8a389aebd: baseline-arm-baylibre 2026-03-11 08:47:55,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8928c660ead8a389aebd 2026-03-11 08:47:55,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:55,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8928c660ead8a389aebd HTTP/1.1" 200 None 2026-03-11 08:47:55,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:55,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:55,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:55,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8928c660ead8a389aebd HTTP/1.1" 200 None 2026-03-11 08:47:55,810 - lava_callback - ERROR - Error processing callback for node 69ae8928c660ead8a389aebd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:47:56,376 - lava_callback - INFO - Received callback for node 69ae8929c660ead8a389aec0 INFO: 172.21.0.1:46510 - "POST /node/69ae8929c660ead8a389aec0 HTTP/1.0" 202 Accepted 2026-03-11 08:47:56,383 - lava_callback - INFO - Starting async job submit for node 69ae8929c660ead8a389aec0 2026-03-11 08:47:56,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:56,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8929c660ead8a389aec0 HTTP/1.1" 200 None 2026-03-11 08:47:56,399 - lava_callback - DEBUG - Processing node 69ae8929c660ead8a389aec0: baseline-arm-baylibre 2026-03-11 08:47:56,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8929c660ead8a389aec0 2026-03-11 08:47:56,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:56,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8929c660ead8a389aec0 HTTP/1.1" 200 None 2026-03-11 08:47:56,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:56,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:56,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:56,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8929c660ead8a389aec0 HTTP/1.1" 200 None 2026-03-11 08:47:56,453 - lava_callback - ERROR - Error processing callback for node 69ae8929c660ead8a389aec0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:47:57,050 - lava_callback - INFO - Received callback for node 69ae892bc660ead8a389aec7 INFO: 172.21.0.1:46534 - "POST /node/69ae892bc660ead8a389aec7 HTTP/1.0" 202 Accepted 2026-03-11 08:47:57,056 - lava_callback - INFO - Starting async job submit for node 69ae892bc660ead8a389aec7 2026-03-11 08:47:57,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892bc660ead8a389aec7 HTTP/1.1" 200 None 2026-03-11 08:47:57,072 - lava_callback - DEBUG - Processing node 69ae892bc660ead8a389aec7: baseline-arm-baylibre 2026-03-11 08:47:57,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae892bc660ead8a389aec7 2026-03-11 08:47:57,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892bc660ead8a389aec7 HTTP/1.1" 200 None 2026-03-11 08:47:57,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:57,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae892bc660ead8a389aec7 HTTP/1.1" 200 None 2026-03-11 08:47:57,131 - lava_callback - ERROR - Error processing callback for node 69ae892bc660ead8a389aec7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:47:57,695 - lava_callback - INFO - Received callback for node 69ae892cc660ead8a389aece INFO: 172.21.0.1:46540 - "POST /node/69ae892cc660ead8a389aece HTTP/1.0" 202 Accepted 2026-03-11 08:47:57,701 - lava_callback - INFO - Starting async job submit for node 69ae892cc660ead8a389aece 2026-03-11 08:47:57,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892cc660ead8a389aece HTTP/1.1" 200 None 2026-03-11 08:47:57,728 - lava_callback - DEBUG - Processing node 69ae892cc660ead8a389aece: baseline-arm-baylibre 2026-03-11 08:47:57,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae892cc660ead8a389aece 2026-03-11 08:47:57,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892cc660ead8a389aece HTTP/1.1" 200 None 2026-03-11 08:47:57,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:57,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae892cc660ead8a389aece HTTP/1.1" 200 None 2026-03-11 08:47:57,794 - lava_callback - ERROR - Error processing callback for node 69ae892cc660ead8a389aece: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:47:58,385 - lava_callback - INFO - Received callback for node 69ae892dc660ead8a389aed0 INFO: 172.21.0.1:46548 - "POST /node/69ae892dc660ead8a389aed0 HTTP/1.0" 202 Accepted 2026-03-11 08:47:58,390 - lava_callback - INFO - Starting async job submit for node 69ae892dc660ead8a389aed0 2026-03-11 08:47:58,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:58,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892dc660ead8a389aed0 HTTP/1.1" 200 None 2026-03-11 08:47:58,418 - lava_callback - DEBUG - Processing node 69ae892dc660ead8a389aed0: baseline-arm-baylibre 2026-03-11 08:47:58,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae892dc660ead8a389aed0 2026-03-11 08:47:58,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:58,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892dc660ead8a389aed0 HTTP/1.1" 200 None 2026-03-11 08:47:58,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:58,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:47:58,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:58,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae892dc660ead8a389aed0 HTTP/1.1" 200 None 2026-03-11 08:47:58,471 - lava_callback - ERROR - Error processing callback for node 69ae892dc660ead8a389aed0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:47:59,054 - lava_callback - INFO - Received callback for node 69ae8930c660ead8a389aedc INFO: 172.21.0.1:46558 - "POST /node/69ae8930c660ead8a389aedc HTTP/1.0" 202 Accepted 2026-03-11 08:47:59,060 - lava_callback - INFO - Starting async job submit for node 69ae8930c660ead8a389aedc 2026-03-11 08:47:59,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8930c660ead8a389aedc HTTP/1.1" 200 None 2026-03-11 08:47:59,075 - lava_callback - DEBUG - Processing node 69ae8930c660ead8a389aedc: baseline-arm-baylibre 2026-03-11 08:47:59,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8930c660ead8a389aedc 2026-03-11 08:47:59,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8930c660ead8a389aedc HTTP/1.1" 200 None 2026-03-11 08:47:59,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:59,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8930c660ead8a389aedc HTTP/1.1" 200 None 2026-03-11 08:47:59,137 - lava_callback - ERROR - Error processing callback for node 69ae8930c660ead8a389aedc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:47:59,697 - lava_callback - INFO - Received callback for node 69ae8931c660ead8a389aedf INFO: 172.21.0.1:47906 - "POST /node/69ae8931c660ead8a389aedf HTTP/1.0" 202 Accepted 2026-03-11 08:47:59,703 - lava_callback - INFO - Starting async job submit for node 69ae8931c660ead8a389aedf 2026-03-11 08:47:59,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8931c660ead8a389aedf HTTP/1.1" 200 None 2026-03-11 08:47:59,719 - lava_callback - DEBUG - Processing node 69ae8931c660ead8a389aedf: baseline-arm-baylibre 2026-03-11 08:47:59,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8931c660ead8a389aedf 2026-03-11 08:47:59,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8931c660ead8a389aedf HTTP/1.1" 200 None 2026-03-11 08:47:59,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:59,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8931c660ead8a389aedf HTTP/1.1" 200 None 2026-03-11 08:47:59,783 - lava_callback - ERROR - Error processing callback for node 69ae8931c660ead8a389aedf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:48:01,031 - lava_callback - INFO - Received callback for node 69ae893cc660ead8a389af17 INFO: 172.21.0.1:47922 - "POST /node/69ae893cc660ead8a389af17 HTTP/1.0" 202 Accepted 2026-03-11 08:48:01,036 - lava_callback - INFO - Starting async job submit for node 69ae893cc660ead8a389af17 2026-03-11 08:48:01,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:01,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae893cc660ead8a389af17 HTTP/1.1" 200 None 2026-03-11 08:48:01,053 - lava_callback - DEBUG - Processing node 69ae893cc660ead8a389af17: baseline-arm-clabbe 2026-03-11 08:48:01,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae893cc660ead8a389af17 2026-03-11 08:48:01,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:01,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae893cc660ead8a389af17 HTTP/1.1" 200 None 2026-03-11 08:48:01,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:01,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:48:01,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:01,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae893cc660ead8a389af17 HTTP/1.1" 200 None 2026-03-11 08:48:01,113 - lava_callback - ERROR - Error processing callback for node 69ae893cc660ead8a389af17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41404 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:48:21,007 - lava_callback - INFO - Received callback for node 69ae8941c660ead8a389af2d INFO: 172.21.0.1:35938 - "POST /node/69ae8941c660ead8a389af2d HTTP/1.0" 202 Accepted 2026-03-11 08:48:21,013 - lava_callback - INFO - Starting async job submit for node 69ae8941c660ead8a389af2d 2026-03-11 08:48:21,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8941c660ead8a389af2d HTTP/1.1" 200 None 2026-03-11 08:48:21,029 - lava_callback - DEBUG - Processing node 69ae8941c660ead8a389af2d: baseline-arm-clabbe 2026-03-11 08:48:21,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8941c660ead8a389af2d 2026-03-11 08:48:21,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8941c660ead8a389af2d HTTP/1.1" 200 None 2026-03-11 08:48:21,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:48:21,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8941c660ead8a389af2d HTTP/1.1" 200 None 2026-03-11 08:48:21,091 - lava_callback - ERROR - Error processing callback for node 69ae8941c660ead8a389af2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:48:21,673 - lava_callback - INFO - Received callback for node 69ae8943c660ead8a389af30 INFO: 172.21.0.1:35954 - "POST /node/69ae8943c660ead8a389af30 HTTP/1.0" 202 Accepted 2026-03-11 08:48:21,679 - lava_callback - INFO - Starting async job submit for node 69ae8943c660ead8a389af30 2026-03-11 08:48:21,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8943c660ead8a389af30 HTTP/1.1" 200 None 2026-03-11 08:48:21,694 - lava_callback - DEBUG - Processing node 69ae8943c660ead8a389af30: baseline-arm-clabbe 2026-03-11 08:48:21,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8943c660ead8a389af30 2026-03-11 08:48:21,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8943c660ead8a389af30 HTTP/1.1" 200 None 2026-03-11 08:48:21,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:48:21,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8943c660ead8a389af30 HTTP/1.1" 200 None 2026-03-11 08:48:21,755 - lava_callback - ERROR - Error processing callback for node 69ae8943c660ead8a389af30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:48:22,334 - lava_callback - INFO - Received callback for node 69ae8943c660ead8a389af33 INFO: 172.21.0.1:35966 - "POST /node/69ae8943c660ead8a389af33 HTTP/1.0" 202 Accepted 2026-03-11 08:48:22,339 - lava_callback - INFO - Starting async job submit for node 69ae8943c660ead8a389af33 2026-03-11 08:48:22,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:22,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8943c660ead8a389af33 HTTP/1.1" 200 None 2026-03-11 08:48:22,355 - lava_callback - DEBUG - Processing node 69ae8943c660ead8a389af33: baseline-arm-clabbe 2026-03-11 08:48:22,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8943c660ead8a389af33 2026-03-11 08:48:22,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:22,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8943c660ead8a389af33 HTTP/1.1" 200 None 2026-03-11 08:48:22,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:22,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:48:22,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:22,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8943c660ead8a389af33 HTTP/1.1" 200 None 2026-03-11 08:48:22,414 - lava_callback - ERROR - Error processing callback for node 69ae8943c660ead8a389af33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:48:22,991 - lava_callback - INFO - Received callback for node 69ae8947c660ead8a389af3d INFO: 172.21.0.1:35980 - "POST /node/69ae8947c660ead8a389af3d HTTP/1.0" 202 Accepted 2026-03-11 08:48:22,997 - lava_callback - INFO - Starting async job submit for node 69ae8947c660ead8a389af3d 2026-03-11 08:48:22,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:23,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8947c660ead8a389af3d HTTP/1.1" 200 None 2026-03-11 08:48:23,026 - lava_callback - DEBUG - Processing node 69ae8947c660ead8a389af3d: baseline-arm-clabbe 2026-03-11 08:48:23,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8947c660ead8a389af3d 2026-03-11 08:48:23,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:23,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8947c660ead8a389af3d HTTP/1.1" 200 None 2026-03-11 08:48:23,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:23,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:48:23,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:23,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8947c660ead8a389af3d HTTP/1.1" 200 None 2026-03-11 08:48:23,084 - lava_callback - ERROR - Error processing callback for node 69ae8947c660ead8a389af3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:48:35,600 - lava_callback - INFO - Received callback for node 69ae8957c660ead8a389af66 INFO: 172.21.0.1:48058 - "POST /node/69ae8957c660ead8a389af66 HTTP/1.0" 202 Accepted 2026-03-11 08:48:35,606 - lava_callback - INFO - Starting async job submit for node 69ae8957c660ead8a389af66 2026-03-11 08:48:35,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:35,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8957c660ead8a389af66 HTTP/1.1" 200 None 2026-03-11 08:48:35,622 - lava_callback - DEBUG - Processing node 69ae8957c660ead8a389af66: baseline-arm-baylibre 2026-03-11 08:48:35,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8957c660ead8a389af66 2026-03-11 08:48:35,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:35,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8957c660ead8a389af66 HTTP/1.1" 200 None 2026-03-11 08:48:35,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:35,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:48:35,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:35,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8957c660ead8a389af66 HTTP/1.1" 200 None 2026-03-11 08:48:35,681 - lava_callback - ERROR - Error processing callback for node 69ae8957c660ead8a389af66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:49:14,453 - lava_callback - INFO - Received callback for node 69b12a2ba870a1dc3343bbb1 INFO: 172.21.0.1:44812 - "POST /node/69b12a2ba870a1dc3343bbb1 HTTP/1.0" 202 Accepted 2026-03-11 08:49:14,460 - lava_callback - INFO - Starting async job submit for node 69b12a2ba870a1dc3343bbb1 2026-03-11 08:49:14,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:14,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2ba870a1dc3343bbb1 HTTP/1.1" 200 None 2026-03-11 08:49:14,502 - lava_callback - DEBUG - Processing node 69b12a2ba870a1dc3343bbb1: ltp-fs_bind 2026-03-11 08:49:15,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44824 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 08:49:15,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:15,196 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b12a2ba870a1dc3343bbb1/log.txt.gz 2026-03-11 08:49:15,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:15,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:15,663 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b12a2ba870a1dc3343bbb1/lava-logs.yaml 2026-03-11 08:49:15,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:15,687 - lava_callback - INFO - Received callback for node 69ae8981c660ead8a389afd5 2026-03-11 08:49:15,693 - lava_callback - INFO - Starting async job submit for node 69ae8981c660ead8a389afd5 INFO: 172.21.0.1:44832 - "POST /node/69ae8981c660ead8a389afd5 HTTP/1.0" 202 Accepted 2026-03-11 08:49:15,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8981c660ead8a389afd5 HTTP/1.1" 200 None 2026-03-11 08:49:15,712 - lava_callback - DEBUG - Processing node 69ae8981c660ead8a389afd5: baseline-arm-baylibre 2026-03-11 08:49:15,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8981c660ead8a389afd5 2026-03-11 08:49:15,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8981c660ead8a389afd5 HTTP/1.1" 200 None 2026-03-11 08:49:15,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:49:15,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8981c660ead8a389afd5 HTTP/1.1" 200 None 2026-03-11 08:49:15,781 - lava_callback - ERROR - Error processing callback for node 69ae8981c660ead8a389afd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:49:15,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:15,865 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b12a2ba870a1dc3343bbb1/lava_callback.json.gz 2026-03-11 08:49:15,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2ba870a1dc3343bbb1 HTTP/1.1" 200 None 2026-03-11 08:49:15,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:49:15,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a2ba870a1dc3343bbb1 HTTP/1.1" 200 None 2026-03-11 08:49:15,974 - lava_callback - INFO - Completed processing callback for node 69b12a2ba870a1dc3343bbb1 INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:49:24,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:24,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:49:39,437 - lava_callback - INFO - Received callback for node 69b12a2da870a1dc3343bbb4 INFO: 172.21.0.1:48090 - "POST /node/69b12a2da870a1dc3343bbb4 HTTP/1.0" 202 Accepted 2026-03-11 08:49:39,443 - lava_callback - INFO - Starting async job submit for node 69b12a2da870a1dc3343bbb4 2026-03-11 08:49:39,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:39,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2da870a1dc3343bbb4 HTTP/1.1" 200 None 2026-03-11 08:49:39,482 - lava_callback - DEBUG - Processing node 69b12a2da870a1dc3343bbb4: ltp-fsx 2026-03-11 08:49:39,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:39,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:39,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69b12a2da870a1dc3343bbb4/log.txt.gz 2026-03-11 08:49:40,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:40,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:40,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69b12a2da870a1dc3343bbb4/lava-logs.yaml 2026-03-11 08:49:40,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:40,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:40,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69b12a2da870a1dc3343bbb4/lava_callback.json.gz 2026-03-11 08:49:40,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:40,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2da870a1dc3343bbb4 HTTP/1.1" 200 None 2026-03-11 08:49:40,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:40,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:49:40,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:40,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a2da870a1dc3343bbb4 HTTP/1.1" 200 None 2026-03-11 08:49:40,724 - lava_callback - INFO - Completed processing callback for node 69b12a2da870a1dc3343bbb4 INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:49:54,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:54,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 08:49:55,674 - lava_callback - INFO - Received callback for node 69ae89a9c660ead8a389b022 INFO: 172.21.0.1:37612 - "POST /node/69ae89a9c660ead8a389b022 HTTP/1.0" 202 Accepted 2026-03-11 08:49:55,679 - lava_callback - INFO - Starting async job submit for node 69ae89a9c660ead8a389b022 2026-03-11 08:49:55,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:55,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae89a9c660ead8a389b022 HTTP/1.1" 200 None 2026-03-11 08:49:55,716 - lava_callback - DEBUG - Processing node 69ae89a9c660ead8a389b022: baseline-arm-baylibre 2026-03-11 08:49:55,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae89a9c660ead8a389b022 2026-03-11 08:49:55,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:55,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae89a9c660ead8a389b022 HTTP/1.1" 200 None 2026-03-11 08:49:55,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:55,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:49:55,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:55,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae89a9c660ead8a389b022 HTTP/1.1" 200 None 2026-03-11 08:49:55,810 - lava_callback - ERROR - Error processing callback for node 69ae89a9c660ead8a389b022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:49:59,431 - lava_callback - INFO - Received callback for node 69b12a2fa870a1dc3343bbb7 INFO: 172.21.0.1:37634 - "POST /node/69b12a2fa870a1dc3343bbb7 HTTP/1.0" 202 Accepted 2026-03-11 08:49:59,437 - lava_callback - INFO - Starting async job submit for node 69b12a2fa870a1dc3343bbb7 2026-03-11 08:49:59,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:59,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2fa870a1dc3343bbb7 HTTP/1.1" 200 None 2026-03-11 08:49:59,484 - lava_callback - DEBUG - Processing node 69b12a2fa870a1dc3343bbb7: ltp-input 2026-03-11 08:49:59,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:59,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:59,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69b12a2fa870a1dc3343bbb7/log.txt.gz 2026-03-11 08:50:00,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:50:00,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:50:00,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69b12a2fa870a1dc3343bbb7/lava-logs.yaml 2026-03-11 08:50:00,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:50:00,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:50:00,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69b12a2fa870a1dc3343bbb7/lava_callback.json.gz 2026-03-11 08:50:00,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:00,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2fa870a1dc3343bbb7 HTTP/1.1" 200 None 2026-03-11 08:50:00,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:00,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:50:00,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:00,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a2fa870a1dc3343bbb7 HTTP/1.1" 200 None 2026-03-11 08:50:00,694 - lava_callback - INFO - Completed processing callback for node 69b12a2fa870a1dc3343bbb7 INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57452 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:50:24,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:24,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51576 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:50:32,681 - lava_callback - INFO - Received callback for node 69b12cd1a870a1dc3343bd94 INFO: 172.21.0.1:51582 - "POST /node/69b12cd1a870a1dc3343bd94 HTTP/1.0" 202 Accepted 2026-03-11 08:50:32,688 - lava_callback - INFO - Starting async job submit for node 69b12cd1a870a1dc3343bd94 2026-03-11 08:50:32,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:32,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12cd1a870a1dc3343bd94 HTTP/1.1" 200 None 2026-03-11 08:50:32,707 - lava_callback - DEBUG - Processing node 69b12cd1a870a1dc3343bd94: baseline-arm 2026-03-11 08:50:32,713 - lava_callback - WARNING - Failed to upload log 2026-03-11 08:50:32,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:50:33,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:50:33,077 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b12cd1a870a1dc3343bd94/lava-logs.yaml 2026-03-11 08:50:33,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:50:33,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:50:33,265 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b12cd1a870a1dc3343bd94/lava_callback.json.gz 2026-03-11 08:50:33,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:33,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12cd1a870a1dc3343bd94 HTTP/1.1" 200 None 2026-03-11 08:50:33,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:33,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:50:33,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:33,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12cd1a870a1dc3343bd94 HTTP/1.1" 200 None 2026-03-11 08:50:33,345 - lava_callback - INFO - Completed processing callback for node 69b12cd1a870a1dc3343bd94 INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:50:54,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:54,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:51:33,959 - lava_callback - INFO - Received callback for node 69b1287aa870a1dc3343bacb INFO: 172.21.0.1:34858 - "POST /node/69b1287aa870a1dc3343bacb HTTP/1.0" 202 Accepted 2026-03-11 08:51:33,969 - lava_callback - INFO - Starting async job submit for node 69b1287aa870a1dc3343bacb 2026-03-11 08:51:34,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:34,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1287aa870a1dc3343bacb HTTP/1.1" 200 None 2026-03-11 08:51:34,122 - lava_callback - DEBUG - Processing node 69b1287aa870a1dc3343bacb: ltp-smoke 2026-03-11 08:51:34,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:51:35,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:35,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1287aa870a1dc3343bacb/log.txt.gz 2026-03-11 08:51:35,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:51:36,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:36,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1287aa870a1dc3343bacb/lava-logs.yaml 2026-03-11 08:51:36,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:51:37,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:37,316 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1287aa870a1dc3343bacb/lava_callback.json.gz 2026-03-11 08:51:37,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:37,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1287aa870a1dc3343bacb HTTP/1.1" 200 None 2026-03-11 08:51:37,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:37,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12599a870a1dc3343ba8b HTTP/1.1" 200 None 2026-03-11 08:51:37,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:37,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1287aa870a1dc3343bacb HTTP/1.1" 200 None 2026-03-11 08:51:37,812 - lava_callback - INFO - Completed processing callback for node 69b1287aa870a1dc3343bacb 2026-03-11 08:51:39,386 - lava_callback - INFO - Received callback for node 69b12a30a870a1dc3343bbba INFO: 172.21.0.1:34868 - "POST /node/69b12a30a870a1dc3343bbba HTTP/1.0" 202 Accepted 2026-03-11 08:51:39,398 - lava_callback - INFO - Starting async job submit for node 69b12a30a870a1dc3343bbba 2026-03-11 08:51:39,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:39,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a30a870a1dc3343bbba HTTP/1.1" 200 None 2026-03-11 08:51:39,478 - lava_callback - DEBUG - Processing node 69b12a30a870a1dc3343bbba: ltp-ipc 2026-03-11 08:51:40,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:51:40,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:40,670 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69b12a30a870a1dc3343bbba/log.txt.gz 2026-03-11 08:51:40,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:51:41,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:41,822 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69b12a30a870a1dc3343bbba/lava-logs.yaml 2026-03-11 08:51:41,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:51:42,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:42,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69b12a30a870a1dc3343bbba/lava_callback.json.gz 2026-03-11 08:51:42,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:42,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a30a870a1dc3343bbba HTTP/1.1" 200 None 2026-03-11 08:51:42,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:42,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:51:42,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:42,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a30a870a1dc3343bbba HTTP/1.1" 200 None 2026-03-11 08:51:42,212 - lava_callback - INFO - Completed processing callback for node 69b12a30a870a1dc3343bbba INFO: 172.21.0.1:32876 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:51:54,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:54,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47560 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:52:41,459 - lava_callback - INFO - Received callback for node 69ae8a49c660ead8a389b127 INFO: 172.21.0.1:38332 - "POST /node/69ae8a49c660ead8a389b127 HTTP/1.0" 202 Accepted 2026-03-11 08:52:41,465 - lava_callback - INFO - Starting async job submit for node 69ae8a49c660ead8a389b127 2026-03-11 08:52:41,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:52:41,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a49c660ead8a389b127 HTTP/1.1" 200 None 2026-03-11 08:52:41,495 - lava_callback - DEBUG - Processing node 69ae8a49c660ead8a389b127: baseline-arm-clabbe 2026-03-11 08:52:41,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8a49c660ead8a389b127 2026-03-11 08:52:41,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:52:41,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a49c660ead8a389b127 HTTP/1.1" 200 None 2026-03-11 08:52:41,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:52:41,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:52:41,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:52:41,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8a49c660ead8a389b127 HTTP/1.1" 200 None 2026-03-11 08:52:41,552 - lava_callback - ERROR - Error processing callback for node 69ae8a49c660ead8a389b127: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:53:14,011 - lava_callback - INFO - Received callback for node 69b12a32a870a1dc3343bbbd INFO: 172.21.0.1:41186 - "POST /node/69b12a32a870a1dc3343bbbd HTTP/1.0" 202 Accepted 2026-03-11 08:53:14,017 - lava_callback - INFO - Starting async job submit for node 69b12a32a870a1dc3343bbbd 2026-03-11 08:53:14,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:14,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a32a870a1dc3343bbbd HTTP/1.1" 200 None 2026-03-11 08:53:14,057 - lava_callback - DEBUG - Processing node 69b12a32a870a1dc3343bbbd: ltp-pty 2026-03-11 08:53:14,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:53:14,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:53:14,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69b12a32a870a1dc3343bbbd/log.txt.gz 2026-03-11 08:53:14,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:53:14,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:53:14,964 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69b12a32a870a1dc3343bbbd/lava-logs.yaml 2026-03-11 08:53:14,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:53:15,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:53:15,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69b12a32a870a1dc3343bbbd/lava_callback.json.gz INFO: 172.21.0.1:41200 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 08:53:15,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:15,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a32a870a1dc3343bbbd HTTP/1.1" 200 None 2026-03-11 08:53:15,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:15,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:53:15,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:15,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a32a870a1dc3343bbbd HTTP/1.1" 200 None 2026-03-11 08:53:15,228 - lava_callback - INFO - Completed processing callback for node 69b12a32a870a1dc3343bbbd INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:53:21,225 - lava_callback - INFO - Received callback for node 69ae8a72c660ead8a389b142 INFO: 172.21.0.1:49240 - "POST /node/69ae8a72c660ead8a389b142 HTTP/1.0" 202 Accepted 2026-03-11 08:53:21,232 - lava_callback - INFO - Starting async job submit for node 69ae8a72c660ead8a389b142 2026-03-11 08:53:21,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:21,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a72c660ead8a389b142 HTTP/1.1" 200 None 2026-03-11 08:53:21,263 - lava_callback - DEBUG - Processing node 69ae8a72c660ead8a389b142: baseline-arm-clabbe 2026-03-11 08:53:21,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8a72c660ead8a389b142 2026-03-11 08:53:21,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:21,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a72c660ead8a389b142 HTTP/1.1" 200 None 2026-03-11 08:53:21,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:21,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:53:21,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:21,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8a72c660ead8a389b142 HTTP/1.1" 200 None 2026-03-11 08:53:21,389 - lava_callback - ERROR - Error processing callback for node 69ae8a72c660ead8a389b142: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:53:24,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:24,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:53:55,930 - lava_callback - INFO - Received callback for node 69ae8a98c660ead8a389b158 INFO: 172.21.0.1:37174 - "POST /node/69ae8a98c660ead8a389b158 HTTP/1.0" 202 Accepted 2026-03-11 08:53:55,938 - lava_callback - INFO - Starting async job submit for node 69ae8a98c660ead8a389b158 2026-03-11 08:53:55,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:55,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a98c660ead8a389b158 HTTP/1.1" 200 None 2026-03-11 08:53:55,966 - lava_callback - DEBUG - Processing node 69ae8a98c660ead8a389b158: baseline-arm-baylibre 2026-03-11 08:53:55,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8a98c660ead8a389b158 2026-03-11 08:53:55,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:55,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a98c660ead8a389b158 HTTP/1.1" 200 None 2026-03-11 08:53:55,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:56,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:53:56,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:56,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8a98c660ead8a389b158 HTTP/1.1" 200 None 2026-03-11 08:53:56,071 - lava_callback - ERROR - Error processing callback for node 69ae8a98c660ead8a389b158: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:53:59,464 - lava_callback - INFO - Received callback for node 69b12a33a870a1dc3343bbc0 INFO: 172.21.0.1:37184 - "POST /node/69b12a33a870a1dc3343bbc0 HTTP/1.0" 202 Accepted 2026-03-11 08:53:59,475 - lava_callback - INFO - Starting async job submit for node 69b12a33a870a1dc3343bbc0 2026-03-11 08:53:59,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:59,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a33a870a1dc3343bbc0 HTTP/1.1" 200 None 2026-03-11 08:53:59,557 - lava_callback - DEBUG - Processing node 69b12a33a870a1dc3343bbc0: ltp-sched 2026-03-11 08:54:00,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:00,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:00,545 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b12a33a870a1dc3343bbc0/log.txt.gz 2026-03-11 08:54:00,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:01,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:01,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b12a33a870a1dc3343bbc0/lava-logs.yaml 2026-03-11 08:54:01,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:01,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:01,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b12a33a870a1dc3343bbc0/lava_callback.json.gz 2026-03-11 08:54:01,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:01,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a33a870a1dc3343bbc0 HTTP/1.1" 200 None 2026-03-11 08:54:01,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:02,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:54:02,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:02,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a33a870a1dc3343bbc0 HTTP/1.1" 200 None 2026-03-11 08:54:02,060 - lava_callback - INFO - Completed processing callback for node 69b12a33a870a1dc3343bbc0 INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:54:19,537 - lava_callback - INFO - Received callback for node 69b12a35a870a1dc3343bbc3 INFO: 172.21.0.1:38602 - "POST /node/69b12a35a870a1dc3343bbc3 HTTP/1.0" 202 Accepted 2026-03-11 08:54:19,548 - lava_callback - INFO - Starting async job submit for node 69b12a35a870a1dc3343bbc3 2026-03-11 08:54:19,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:19,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a35a870a1dc3343bbc3 HTTP/1.1" 200 None 2026-03-11 08:54:19,622 - lava_callback - DEBUG - Processing node 69b12a35a870a1dc3343bbc3: ltp-smoke 2026-03-11 08:54:20,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:20,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:20,549 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12a35a870a1dc3343bbc3/log.txt.gz 2026-03-11 08:54:20,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:21,433 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:21,435 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12a35a870a1dc3343bbc3/lava-logs.yaml 2026-03-11 08:54:21,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:21,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:21,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12a35a870a1dc3343bbc3/lava_callback.json.gz 2026-03-11 08:54:21,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:21,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a35a870a1dc3343bbc3 HTTP/1.1" 200 None 2026-03-11 08:54:21,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:21,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:54:21,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:22,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a35a870a1dc3343bbc3 HTTP/1.1" 200 None 2026-03-11 08:54:22,010 - lava_callback - INFO - Completed processing callback for node 69b12a35a870a1dc3343bbc3 2026-03-11 08:54:24,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:24,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:54:35,927 - lava_callback - INFO - Received callback for node 69ae8ac0c660ead8a389b171 INFO: 172.21.0.1:51674 - "POST /node/69ae8ac0c660ead8a389b171 HTTP/1.0" 202 Accepted 2026-03-11 08:54:35,932 - lava_callback - INFO - Starting async job submit for node 69ae8ac0c660ead8a389b171 2026-03-11 08:54:35,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:35,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8ac0c660ead8a389b171 HTTP/1.1" 200 None 2026-03-11 08:54:35,948 - lava_callback - DEBUG - Processing node 69ae8ac0c660ead8a389b171: baseline-arm-baylibre 2026-03-11 08:54:35,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8ac0c660ead8a389b171 2026-03-11 08:54:35,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:35,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8ac0c660ead8a389b171 HTTP/1.1" 200 None 2026-03-11 08:54:35,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:35,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:54:35,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:36,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8ac0c660ead8a389b171 HTTP/1.1" 200 None 2026-03-11 08:54:36,016 - lava_callback - ERROR - Error processing callback for node 69ae8ac0c660ead8a389b171: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:55:34,979 - lava_callback - INFO - Received callback for node 69b129eea870a1dc3343baeb INFO: 172.21.0.1:60380 - "POST /node/69b129eea870a1dc3343baeb HTTP/1.0" 202 Accepted 2026-03-11 08:55:34,986 - lava_callback - INFO - Starting async job submit for node 69b129eea870a1dc3343baeb 2026-03-11 08:55:35,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:55:35,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eea870a1dc3343baeb HTTP/1.1" 200 None 2026-03-11 08:55:35,068 - lava_callback - DEBUG - Processing node 69b129eea870a1dc3343baeb: baseline-arm 2026-03-11 08:55:35,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:55:35,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:55:35,779 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343baeb/log.txt.gz 2026-03-11 08:55:36,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:55:36,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:55:36,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343baeb/lava-logs.yaml 2026-03-11 08:55:36,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:60388 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:55:36,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:55:36,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343baeb/lava_callback.json.gz DEBUG: Setup failed for 69b129eea870a1dc3343baeb. Transitting job node result: incomplete -> fail 2026-03-11 08:55:36,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:55:36,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eea870a1dc3343baeb HTTP/1.1" 200 None 2026-03-11 08:55:36,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:55:36,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:55:36,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:55:36,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129eea870a1dc3343baeb HTTP/1.1" 200 None 2026-03-11 08:55:36,910 - lava_callback - INFO - Completed processing callback for node 69b129eea870a1dc3343baeb INFO: 172.21.0.1:54372 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:55:54,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:55:54,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:56:19,679 - lava_callback - INFO - Received callback for node 69b12a38a870a1dc3343bbc9 INFO: 172.21.0.1:56118 - "POST /node/69b12a38a870a1dc3343bbc9 HTTP/1.0" 202 Accepted 2026-03-11 08:56:19,686 - lava_callback - INFO - Starting async job submit for node 69b12a38a870a1dc3343bbc9 2026-03-11 08:56:19,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:56:19,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a38a870a1dc3343bbc9 HTTP/1.1" 200 None 2026-03-11 08:56:19,730 - lava_callback - DEBUG - Processing node 69b12a38a870a1dc3343bbc9: ltp-syscalls-ipc 2026-03-11 08:56:20,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:56:20,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:56:20,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b12a38a870a1dc3343bbc9/log.txt.gz 2026-03-11 08:56:20,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:56:20,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:56:20,726 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b12a38a870a1dc3343bbc9/lava-logs.yaml 2026-03-11 08:56:20,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:56:20,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:56:20,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b12a38a870a1dc3343bbc9/lava_callback.json.gz 2026-03-11 08:56:20,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:56:20,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a38a870a1dc3343bbc9 HTTP/1.1" 200 None 2026-03-11 08:56:20,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:56:21,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:56:21,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:56:21,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a38a870a1dc3343bbc9 HTTP/1.1" 200 None 2026-03-11 08:56:21,041 - lava_callback - INFO - Completed processing callback for node 69b12a38a870a1dc3343bbc9 2026-03-11 08:56:24,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:56:24,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:57:14,239 - lava_callback - INFO - Received callback for node 69b12a39a870a1dc3343bbcc INFO: 172.21.0.1:49278 - "POST /node/69b12a39a870a1dc3343bbcc HTTP/1.0" 202 Accepted 2026-03-11 08:57:14,246 - lava_callback - INFO - Starting async job submit for node 69b12a39a870a1dc3343bbcc 2026-03-11 08:57:14,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:14,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a39a870a1dc3343bbcc HTTP/1.1" 200 None 2026-03-11 08:57:14,286 - lava_callback - DEBUG - Processing node 69b12a39a870a1dc3343bbcc: ltp-timers 2026-03-11 08:57:14,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:57:14,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:57:14,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69b12a39a870a1dc3343bbcc/log.txt.gz 2026-03-11 08:57:15,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49294 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 08:57:15,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:57:15,235 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69b12a39a870a1dc3343bbcc/lava-logs.yaml 2026-03-11 08:57:15,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:57:15,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:57:15,401 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69b12a39a870a1dc3343bbcc/lava_callback.json.gz 2026-03-11 08:57:15,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:15,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a39a870a1dc3343bbcc HTTP/1.1" 200 None 2026-03-11 08:57:15,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:15,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:57:15,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:15,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a39a870a1dc3343bbcc HTTP/1.1" 200 None 2026-03-11 08:57:15,489 - lava_callback - INFO - Completed processing callback for node 69b12a39a870a1dc3343bbcc INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:57:16,530 - lava_callback - INFO - Received callback for node 69ae8b5dc660ead8a389b25f INFO: 172.21.0.1:49318 - "POST /node/69ae8b5dc660ead8a389b25f HTTP/1.0" 202 Accepted 2026-03-11 08:57:16,535 - lava_callback - INFO - Starting async job submit for node 69ae8b5dc660ead8a389b25f 2026-03-11 08:57:16,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:16,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b5dc660ead8a389b25f HTTP/1.1" 200 None 2026-03-11 08:57:16,552 - lava_callback - DEBUG - Processing node 69ae8b5dc660ead8a389b25f: baseline-arm64-baylibre 2026-03-11 08:57:16,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b5dc660ead8a389b25f 2026-03-11 08:57:16,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:16,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b5dc660ead8a389b25f HTTP/1.1" 200 None 2026-03-11 08:57:16,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:16,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:16,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:16,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b5dc660ead8a389b25f HTTP/1.1" 200 None 2026-03-11 08:57:16,610 - lava_callback - ERROR - Error processing callback for node 69ae8b5dc660ead8a389b25f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:17,174 - lava_callback - INFO - Received callback for node 69ae8b5fc660ead8a389b263 INFO: 172.21.0.1:49328 - "POST /node/69ae8b5fc660ead8a389b263 HTTP/1.0" 202 Accepted 2026-03-11 08:57:17,180 - lava_callback - INFO - Starting async job submit for node 69ae8b5fc660ead8a389b263 2026-03-11 08:57:17,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b5fc660ead8a389b263 HTTP/1.1" 200 None 2026-03-11 08:57:17,201 - lava_callback - DEBUG - Processing node 69ae8b5fc660ead8a389b263: baseline-arm64-baylibre 2026-03-11 08:57:17,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b5fc660ead8a389b263 2026-03-11 08:57:17,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b5fc660ead8a389b263 HTTP/1.1" 200 None 2026-03-11 08:57:17,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:17,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b5fc660ead8a389b263 HTTP/1.1" 200 None 2026-03-11 08:57:17,269 - lava_callback - ERROR - Error processing callback for node 69ae8b5fc660ead8a389b263: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:17,837 - lava_callback - INFO - Received callback for node 69ae8b60c660ead8a389b266 INFO: 172.21.0.1:49334 - "POST /node/69ae8b60c660ead8a389b266 HTTP/1.0" 202 Accepted 2026-03-11 08:57:17,843 - lava_callback - INFO - Starting async job submit for node 69ae8b60c660ead8a389b266 2026-03-11 08:57:17,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b60c660ead8a389b266 HTTP/1.1" 200 None 2026-03-11 08:57:17,859 - lava_callback - DEBUG - Processing node 69ae8b60c660ead8a389b266: baseline-arm64-baylibre 2026-03-11 08:57:17,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b60c660ead8a389b266 2026-03-11 08:57:17,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b60c660ead8a389b266 HTTP/1.1" 200 None 2026-03-11 08:57:17,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:17,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b60c660ead8a389b266 HTTP/1.1" 200 None 2026-03-11 08:57:17,923 - lava_callback - ERROR - Error processing callback for node 69ae8b60c660ead8a389b266: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:18,498 - lava_callback - INFO - Received callback for node 69ae8b62c660ead8a389b26f INFO: 172.21.0.1:49342 - "POST /node/69ae8b62c660ead8a389b26f HTTP/1.0" 202 Accepted 2026-03-11 08:57:18,504 - lava_callback - INFO - Starting async job submit for node 69ae8b62c660ead8a389b26f 2026-03-11 08:57:18,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:18,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b62c660ead8a389b26f HTTP/1.1" 200 None 2026-03-11 08:57:18,524 - lava_callback - DEBUG - Processing node 69ae8b62c660ead8a389b26f: baseline-arm64-baylibre 2026-03-11 08:57:18,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b62c660ead8a389b26f 2026-03-11 08:57:18,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:18,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b62c660ead8a389b26f HTTP/1.1" 200 None 2026-03-11 08:57:18,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:18,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:18,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:18,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b62c660ead8a389b26f HTTP/1.1" 200 None 2026-03-11 08:57:18,579 - lava_callback - ERROR - Error processing callback for node 69ae8b62c660ead8a389b26f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:19,159 - lava_callback - INFO - Received callback for node 69ae8b64c660ead8a389b273 INFO: 172.21.0.1:49350 - "POST /node/69ae8b64c660ead8a389b273 HTTP/1.0" 202 Accepted 2026-03-11 08:57:19,165 - lava_callback - INFO - Starting async job submit for node 69ae8b64c660ead8a389b273 2026-03-11 08:57:19,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b64c660ead8a389b273 HTTP/1.1" 200 None 2026-03-11 08:57:19,181 - lava_callback - DEBUG - Processing node 69ae8b64c660ead8a389b273: baseline-arm64-baylibre 2026-03-11 08:57:19,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b64c660ead8a389b273 2026-03-11 08:57:19,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b64c660ead8a389b273 HTTP/1.1" 200 None 2026-03-11 08:57:19,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:19,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b64c660ead8a389b273 HTTP/1.1" 200 None 2026-03-11 08:57:19,237 - lava_callback - ERROR - Error processing callback for node 69ae8b64c660ead8a389b273: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:19,802 - lava_callback - INFO - Received callback for node 69ae8b65c660ead8a389b277 INFO: 172.21.0.1:60630 - "POST /node/69ae8b65c660ead8a389b277 HTTP/1.0" 202 Accepted 2026-03-11 08:57:19,807 - lava_callback - INFO - Starting async job submit for node 69ae8b65c660ead8a389b277 2026-03-11 08:57:19,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b65c660ead8a389b277 HTTP/1.1" 200 None 2026-03-11 08:57:19,826 - lava_callback - DEBUG - Processing node 69ae8b65c660ead8a389b277: baseline-arm64-baylibre 2026-03-11 08:57:19,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b65c660ead8a389b277 2026-03-11 08:57:19,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b65c660ead8a389b277 HTTP/1.1" 200 None 2026-03-11 08:57:19,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:19,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b65c660ead8a389b277 HTTP/1.1" 200 None 2026-03-11 08:57:19,884 - lava_callback - ERROR - Error processing callback for node 69ae8b65c660ead8a389b277: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:21,421 - lava_callback - INFO - Received callback for node 69ae8b62c660ead8a389b26d INFO: 172.21.0.1:60632 - "POST /node/69ae8b62c660ead8a389b26d HTTP/1.0" 202 Accepted 2026-03-11 08:57:21,426 - lava_callback - INFO - Starting async job submit for node 69ae8b62c660ead8a389b26d 2026-03-11 08:57:21,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:21,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b62c660ead8a389b26d HTTP/1.1" 200 None 2026-03-11 08:57:21,442 - lava_callback - DEBUG - Processing node 69ae8b62c660ead8a389b26d: baseline-arm-clabbe 2026-03-11 08:57:21,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b62c660ead8a389b26d 2026-03-11 08:57:21,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:21,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b62c660ead8a389b26d HTTP/1.1" 200 None 2026-03-11 08:57:21,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:21,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:57:21,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:21,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b62c660ead8a389b26d HTTP/1.1" 200 None 2026-03-11 08:57:21,499 - lava_callback - ERROR - Error processing callback for node 69ae8b62c660ead8a389b26d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:24,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:24,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:57:41,389 - lava_callback - INFO - Received callback for node 69ae8b75c660ead8a389b2a1 INFO: 172.21.0.1:36760 - "POST /node/69ae8b75c660ead8a389b2a1 HTTP/1.0" 202 Accepted 2026-03-11 08:57:41,395 - lava_callback - INFO - Starting async job submit for node 69ae8b75c660ead8a389b2a1 2026-03-11 08:57:41,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:41,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b75c660ead8a389b2a1 HTTP/1.1" 200 None 2026-03-11 08:57:41,411 - lava_callback - DEBUG - Processing node 69ae8b75c660ead8a389b2a1: baseline-arm64-clabbe 2026-03-11 08:57:41,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b75c660ead8a389b2a1 2026-03-11 08:57:41,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:41,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b75c660ead8a389b2a1 HTTP/1.1" 200 None 2026-03-11 08:57:41,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:41,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:41,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:41,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b75c660ead8a389b2a1 HTTP/1.1" 200 None 2026-03-11 08:57:41,475 - lava_callback - ERROR - Error processing callback for node 69ae8b75c660ead8a389b2a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:42,048 - lava_callback - INFO - Received callback for node 69ae8b77c660ead8a389b2c3 INFO: 172.21.0.1:36768 - "POST /node/69ae8b77c660ead8a389b2c3 HTTP/1.0" 202 Accepted 2026-03-11 08:57:42,054 - lava_callback - INFO - Starting async job submit for node 69ae8b77c660ead8a389b2c3 2026-03-11 08:57:42,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b77c660ead8a389b2c3 HTTP/1.1" 200 None 2026-03-11 08:57:42,077 - lava_callback - DEBUG - Processing node 69ae8b77c660ead8a389b2c3: baseline-arm64-clabbe 2026-03-11 08:57:42,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b77c660ead8a389b2c3 2026-03-11 08:57:42,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b77c660ead8a389b2c3 HTTP/1.1" 200 None 2026-03-11 08:57:42,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:42,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b77c660ead8a389b2c3 HTTP/1.1" 200 None 2026-03-11 08:57:42,134 - lava_callback - ERROR - Error processing callback for node 69ae8b77c660ead8a389b2c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:42,704 - lava_callback - INFO - Received callback for node 69ae8b78c660ead8a389b2c6 INFO: 172.21.0.1:36776 - "POST /node/69ae8b78c660ead8a389b2c6 HTTP/1.0" 202 Accepted 2026-03-11 08:57:42,710 - lava_callback - INFO - Starting async job submit for node 69ae8b78c660ead8a389b2c6 2026-03-11 08:57:42,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b78c660ead8a389b2c6 HTTP/1.1" 200 None 2026-03-11 08:57:42,726 - lava_callback - DEBUG - Processing node 69ae8b78c660ead8a389b2c6: baseline-arm64-clabbe 2026-03-11 08:57:42,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b78c660ead8a389b2c6 2026-03-11 08:57:42,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b78c660ead8a389b2c6 HTTP/1.1" 200 None 2026-03-11 08:57:42,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:42,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b78c660ead8a389b2c6 HTTP/1.1" 200 None 2026-03-11 08:57:42,786 - lava_callback - ERROR - Error processing callback for node 69ae8b78c660ead8a389b2c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:43,358 - lava_callback - INFO - Received callback for node 69ae8b79c660ead8a389b2c9 INFO: 172.21.0.1:36788 - "POST /node/69ae8b79c660ead8a389b2c9 HTTP/1.0" 202 Accepted 2026-03-11 08:57:43,364 - lava_callback - INFO - Starting async job submit for node 69ae8b79c660ead8a389b2c9 2026-03-11 08:57:43,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:43,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b79c660ead8a389b2c9 HTTP/1.1" 200 None 2026-03-11 08:57:43,380 - lava_callback - DEBUG - Processing node 69ae8b79c660ead8a389b2c9: baseline-arm64-clabbe 2026-03-11 08:57:43,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b79c660ead8a389b2c9 2026-03-11 08:57:43,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:43,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b79c660ead8a389b2c9 HTTP/1.1" 200 None 2026-03-11 08:57:43,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:43,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:43,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:43,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b79c660ead8a389b2c9 HTTP/1.1" 200 None 2026-03-11 08:57:43,431 - lava_callback - ERROR - Error processing callback for node 69ae8b79c660ead8a389b2c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:44,018 - lava_callback - INFO - Received callback for node 69ae8b7cc660ead8a389b2d7 INFO: 172.21.0.1:36794 - "POST /node/69ae8b7cc660ead8a389b2d7 HTTP/1.0" 202 Accepted 2026-03-11 08:57:44,025 - lava_callback - INFO - Starting async job submit for node 69ae8b7cc660ead8a389b2d7 2026-03-11 08:57:44,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b7cc660ead8a389b2d7 HTTP/1.1" 200 None 2026-03-11 08:57:44,041 - lava_callback - DEBUG - Processing node 69ae8b7cc660ead8a389b2d7: baseline-arm64-clabbe 2026-03-11 08:57:44,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b7cc660ead8a389b2d7 2026-03-11 08:57:44,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b7cc660ead8a389b2d7 HTTP/1.1" 200 None 2026-03-11 08:57:44,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:44,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b7cc660ead8a389b2d7 HTTP/1.1" 200 None 2026-03-11 08:57:44,107 - lava_callback - ERROR - Error processing callback for node 69ae8b7cc660ead8a389b2d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:44,693 - lava_callback - INFO - Received callback for node 69ae8b7bc660ead8a389b2d4 INFO: 172.21.0.1:36802 - "POST /node/69ae8b7bc660ead8a389b2d4 HTTP/1.0" 202 Accepted 2026-03-11 08:57:44,698 - lava_callback - INFO - Starting async job submit for node 69ae8b7bc660ead8a389b2d4 2026-03-11 08:57:44,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b7bc660ead8a389b2d4 HTTP/1.1" 200 None 2026-03-11 08:57:44,716 - lava_callback - DEBUG - Processing node 69ae8b7bc660ead8a389b2d4: baseline-arm64-clabbe 2026-03-11 08:57:44,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b7bc660ead8a389b2d4 2026-03-11 08:57:44,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b7bc660ead8a389b2d4 HTTP/1.1" 200 None 2026-03-11 08:57:44,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:44,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b7bc660ead8a389b2d4 HTTP/1.1" 200 None 2026-03-11 08:57:44,795 - lava_callback - ERROR - Error processing callback for node 69ae8b7bc660ead8a389b2d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44408 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:58:19,658 - lava_callback - INFO - Received callback for node 69b12a3aa870a1dc3343bbcf INFO: 172.21.0.1:44414 - "POST /node/69b12a3aa870a1dc3343bbcf HTTP/1.0" 202 Accepted 2026-03-11 08:58:19,665 - lava_callback - INFO - Starting async job submit for node 69b12a3aa870a1dc3343bbcf 2026-03-11 08:58:19,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:19,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a3aa870a1dc3343bbcf HTTP/1.1" 200 None 2026-03-11 08:58:19,710 - lava_callback - DEBUG - Processing node 69b12a3aa870a1dc3343bbcf: ltp-watchqueue 2026-03-11 08:58:20,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:58:20,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:58:20,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b12a3aa870a1dc3343bbcf/log.txt.gz 2026-03-11 08:58:20,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:58:20,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:58:20,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b12a3aa870a1dc3343bbcf/lava-logs.yaml 2026-03-11 08:58:20,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:58:20,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:58:20,902 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b12a3aa870a1dc3343bbcf/lava_callback.json.gz 2026-03-11 08:58:20,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:20,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a3aa870a1dc3343bbcf HTTP/1.1" 200 None 2026-03-11 08:58:20,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:20,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:58:20,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:21,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a3aa870a1dc3343bbcf HTTP/1.1" 200 None 2026-03-11 08:58:21,016 - lava_callback - INFO - Completed processing callback for node 69b12a3aa870a1dc3343bbcf 2026-03-11 08:58:24,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:24,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45684 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:58:36,215 - lava_callback - INFO - Received callback for node 69ae8bb7c660ead8a389b32f INFO: 172.21.0.1:45696 - "POST /node/69ae8bb7c660ead8a389b32f HTTP/1.0" 202 Accepted 2026-03-11 08:58:36,220 - lava_callback - INFO - Starting async job submit for node 69ae8bb7c660ead8a389b32f 2026-03-11 08:58:36,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:36,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8bb7c660ead8a389b32f HTTP/1.1" 200 None 2026-03-11 08:58:36,241 - lava_callback - DEBUG - Processing node 69ae8bb7c660ead8a389b32f: baseline-arm64-baylibre 2026-03-11 08:58:36,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8bb7c660ead8a389b32f 2026-03-11 08:58:36,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:36,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8bb7c660ead8a389b32f HTTP/1.1" 200 None 2026-03-11 08:58:36,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:36,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 08:58:36,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:36,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8bb7c660ead8a389b32f HTTP/1.1" 200 None 2026-03-11 08:58:36,298 - lava_callback - ERROR - Error processing callback for node 69ae8bb7c660ead8a389b32f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53586 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:01:56,389 - lava_callback - INFO - Received callback for node 69ae8c7dc660ead8a389b450 INFO: 172.21.0.1:52486 - "POST /node/69ae8c7dc660ead8a389b450 HTTP/1.0" 202 Accepted 2026-03-11 09:01:56,402 - lava_callback - INFO - Starting async job submit for node 69ae8c7dc660ead8a389b450 2026-03-11 09:01:56,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:01:56,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8c7dc660ead8a389b450 HTTP/1.1" 200 None 2026-03-11 09:01:56,433 - lava_callback - DEBUG - Processing node 69ae8c7dc660ead8a389b450: baseline-arm64-baylibre 2026-03-11 09:01:56,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8c7dc660ead8a389b450 2026-03-11 09:01:56,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:01:56,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8c7dc660ead8a389b450 HTTP/1.1" 200 None 2026-03-11 09:01:56,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:01:56,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:01:56,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:01:56,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8c7dc660ead8a389b450 HTTP/1.1" 200 None 2026-03-11 09:01:56,512 - lava_callback - ERROR - Error processing callback for node 69ae8c7dc660ead8a389b450: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:03:40,123 - lava_callback - INFO - Received callback for node 69b129f0a870a1dc3343baee INFO: 172.21.0.1:44302 - "POST /node/69b129f0a870a1dc3343baee HTTP/1.0" 202 Accepted 2026-03-11 09:03:40,129 - lava_callback - INFO - Starting async job submit for node 69b129f0a870a1dc3343baee 2026-03-11 09:03:40,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:03:40,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f0a870a1dc3343baee HTTP/1.1" 200 None 2026-03-11 09:03:40,176 - lava_callback - DEBUG - Processing node 69b129f0a870a1dc3343baee: baseline-arm 2026-03-11 09:03:40,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:03:41,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:03:41,448 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f0a870a1dc3343baee/log.txt.gz 2026-03-11 09:03:41,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:03:41,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:03:41,782 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f0a870a1dc3343baee/lava-logs.yaml 2026-03-11 09:03:41,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:03:41,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:03:41,967 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f0a870a1dc3343baee/lava_callback.json.gz 2026-03-11 09:03:41,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:03:42,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f0a870a1dc3343baee HTTP/1.1" 200 None 2026-03-11 09:03:42,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:03:42,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:03:42,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:03:42,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129f0a870a1dc3343baee HTTP/1.1" 200 None 2026-03-11 09:03:42,086 - lava_callback - INFO - Completed processing callback for node 69b129f0a870a1dc3343baee INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:03:54,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:03:54,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:04:36,511 - lava_callback - INFO - Received callback for node 69ae8d13c660ead8a389b49e INFO: 172.21.0.1:49774 - "POST /node/69ae8d13c660ead8a389b49e HTTP/1.0" 202 Accepted 2026-03-11 09:04:36,517 - lava_callback - INFO - Starting async job submit for node 69ae8d13c660ead8a389b49e 2026-03-11 09:04:36,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:04:36,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d13c660ead8a389b49e HTTP/1.1" 200 None 2026-03-11 09:04:36,534 - lava_callback - DEBUG - Processing node 69ae8d13c660ead8a389b49e: baseline-arm64-baylibre 2026-03-11 09:04:36,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8d13c660ead8a389b49e 2026-03-11 09:04:36,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:36,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d13c660ead8a389b49e HTTP/1.1" 200 None 2026-03-11 09:04:36,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:36,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:04:36,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:36,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8d13c660ead8a389b49e HTTP/1.1" 200 None 2026-03-11 09:04:36,595 - lava_callback - ERROR - Error processing callback for node 69ae8d13c660ead8a389b49e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 09:04:43,719 - lava_callback - INFO - Received callback for node 69b12a26a870a1dc3343bbae INFO: 172.21.0.1:51592 - "POST /node/69b12a26a870a1dc3343bbae HTTP/1.0" 202 Accepted 2026-03-11 09:04:43,725 - lava_callback - INFO - Starting async job submit for node 69b12a26a870a1dc3343bbae 2026-03-11 09:04:43,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:43,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a26a870a1dc3343bbae HTTP/1.1" 200 None 2026-03-11 09:04:43,765 - lava_callback - DEBUG - Processing node 69b12a26a870a1dc3343bbae: ltp-dio 2026-03-11 09:04:44,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:04:44,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:04:44,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69b12a26a870a1dc3343bbae/log.txt.gz 2026-03-11 09:04:44,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:04:44,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:04:44,780 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69b12a26a870a1dc3343bbae/lava-logs.yaml 2026-03-11 09:04:44,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:04:44,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:04:44,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69b12a26a870a1dc3343bbae/lava_callback.json.gz 2026-03-11 09:04:44,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:45,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a26a870a1dc3343bbae HTTP/1.1" 200 None 2026-03-11 09:04:45,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:45,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:04:45,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:45,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a26a870a1dc3343bbae HTTP/1.1" 200 None 2026-03-11 09:04:45,054 - lava_callback - INFO - Completed processing callback for node 69b12a26a870a1dc3343bbae INFO: 172.21.0.1:51600 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:04:54,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:54,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52076 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:05:36,508 - lava_callback - INFO - Received callback for node 69ae8d50c660ead8a389b4b7 INFO: 172.21.0.1:52086 - "POST /node/69ae8d50c660ead8a389b4b7 HTTP/1.0" 202 Accepted 2026-03-11 09:05:36,514 - lava_callback - INFO - Starting async job submit for node 69ae8d50c660ead8a389b4b7 2026-03-11 09:05:36,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:05:36,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d50c660ead8a389b4b7 HTTP/1.1" 200 None 2026-03-11 09:05:36,532 - lava_callback - DEBUG - Processing node 69ae8d50c660ead8a389b4b7: baseline-arm-baylibre 2026-03-11 09:05:36,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8d50c660ead8a389b4b7 2026-03-11 09:05:36,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:05:36,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d50c660ead8a389b4b7 HTTP/1.1" 200 None 2026-03-11 09:05:36,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:05:36,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:05:36,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:05:36,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8d50c660ead8a389b4b7 HTTP/1.1" 200 None 2026-03-11 09:05:36,585 - lava_callback - ERROR - Error processing callback for node 69ae8d50c660ead8a389b4b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:06:16,577 - lava_callback - INFO - Received callback for node 69ae8d78c660ead8a389b4e0 INFO: 172.21.0.1:34858 - "POST /node/69ae8d78c660ead8a389b4e0 HTTP/1.0" 202 Accepted 2026-03-11 09:06:16,582 - lava_callback - INFO - Starting async job submit for node 69ae8d78c660ead8a389b4e0 2026-03-11 09:06:16,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:06:16,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d78c660ead8a389b4e0 HTTP/1.1" 200 None 2026-03-11 09:06:16,601 - lava_callback - DEBUG - Processing node 69ae8d78c660ead8a389b4e0: baseline-arm-baylibre 2026-03-11 09:06:16,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8d78c660ead8a389b4e0 2026-03-11 09:06:16,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:06:16,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d78c660ead8a389b4e0 HTTP/1.1" 200 None 2026-03-11 09:06:16,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:06:16,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:06:16,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:06:16,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8d78c660ead8a389b4e0 HTTP/1.1" 200 None 2026-03-11 09:06:16,657 - lava_callback - ERROR - Error processing callback for node 69ae8d78c660ead8a389b4e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:07:36,653 - lava_callback - INFO - Received callback for node 69ae8dc7c660ead8a389b515 INFO: 172.21.0.1:60542 - "POST /node/69ae8dc7c660ead8a389b515 HTTP/1.0" 202 Accepted 2026-03-11 09:07:36,659 - lava_callback - INFO - Starting async job submit for node 69ae8dc7c660ead8a389b515 2026-03-11 09:07:36,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:07:36,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8dc7c660ead8a389b515 HTTP/1.1" 200 None 2026-03-11 09:07:36,675 - lava_callback - DEBUG - Processing node 69ae8dc7c660ead8a389b515: baseline-arm-baylibre 2026-03-11 09:07:36,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8dc7c660ead8a389b515 2026-03-11 09:07:36,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:07:36,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8dc7c660ead8a389b515 HTTP/1.1" 200 None 2026-03-11 09:07:36,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:07:36,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:07:36,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:07:36,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8dc7c660ead8a389b515 HTTP/1.1" 200 None 2026-03-11 09:07:36,734 - lava_callback - ERROR - Error processing callback for node 69ae8dc7c660ead8a389b515: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:09:01,930 - lava_callback - INFO - Received callback for node 69ae8e28c660ead8a389b544 INFO: 172.21.0.1:60052 - "POST /node/69ae8e28c660ead8a389b544 HTTP/1.0" 202 Accepted 2026-03-11 09:09:01,936 - lava_callback - INFO - Starting async job submit for node 69ae8e28c660ead8a389b544 2026-03-11 09:09:01,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:01,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8e28c660ead8a389b544 HTTP/1.1" 200 None 2026-03-11 09:09:01,952 - lava_callback - DEBUG - Processing node 69ae8e28c660ead8a389b544: baseline-arm64-clabbe 2026-03-11 09:09:01,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8e28c660ead8a389b544 2026-03-11 09:09:01,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:01,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8e28c660ead8a389b544 HTTP/1.1" 200 None 2026-03-11 09:09:01,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:01,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:09:01,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:02,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8e28c660ead8a389b544 HTTP/1.1" 200 None 2026-03-11 09:09:02,011 - lava_callback - ERROR - Error processing callback for node 69ae8e28c660ead8a389b544: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:09:56,819 - lava_callback - INFO - Received callback for node 69ae8e61c660ead8a389b551 INFO: 172.21.0.1:47338 - "POST /node/69ae8e61c660ead8a389b551 HTTP/1.0" 202 Accepted 2026-03-11 09:09:56,825 - lava_callback - INFO - Starting async job submit for node 69ae8e61c660ead8a389b551 2026-03-11 09:09:56,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:56,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8e61c660ead8a389b551 HTTP/1.1" 200 None 2026-03-11 09:09:56,841 - lava_callback - DEBUG - Processing node 69ae8e61c660ead8a389b551: baseline-arm-baylibre 2026-03-11 09:09:56,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8e61c660ead8a389b551 2026-03-11 09:09:56,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:56,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8e61c660ead8a389b551 HTTP/1.1" 200 None 2026-03-11 09:09:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:56,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:09:56,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:56,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8e61c660ead8a389b551 HTTP/1.1" 200 None 2026-03-11 09:09:56,897 - lava_callback - ERROR - Error processing callback for node 69ae8e61c660ead8a389b551: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:11:37,116 - lava_callback - INFO - Received callback for node 69ae8eb4c660ead8a389b583 INFO: 172.21.0.1:41704 - "POST /node/69ae8eb4c660ead8a389b583 HTTP/1.0" 202 Accepted 2026-03-11 09:11:37,122 - lava_callback - INFO - Starting async job submit for node 69ae8eb4c660ead8a389b583 2026-03-11 09:11:37,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:11:37,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8eb4c660ead8a389b583 HTTP/1.1" 200 None 2026-03-11 09:11:37,146 - lava_callback - DEBUG - Processing node 69ae8eb4c660ead8a389b583: baseline-arm-baylibre 2026-03-11 09:11:37,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8eb4c660ead8a389b583 2026-03-11 09:11:37,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:11:37,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8eb4c660ead8a389b583 HTTP/1.1" 200 None 2026-03-11 09:11:37,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:11:37,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:11:37,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:11:37,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8eb4c660ead8a389b583 HTTP/1.1" 200 None 2026-03-11 09:11:37,204 - lava_callback - ERROR - Error processing callback for node 69ae8eb4c660ead8a389b583: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:15:57,269 - lava_callback - INFO - Received callback for node 69ae8fbac660ead8a389b5eb INFO: 172.21.0.1:41538 - "POST /node/69ae8fbac660ead8a389b5eb HTTP/1.0" 202 Accepted 2026-03-11 09:15:57,274 - lava_callback - INFO - Starting async job submit for node 69ae8fbac660ead8a389b5eb 2026-03-11 09:15:57,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:15:57,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8fbac660ead8a389b5eb HTTP/1.1" 200 None 2026-03-11 09:15:57,291 - lava_callback - DEBUG - Processing node 69ae8fbac660ead8a389b5eb: baseline-arm-baylibre 2026-03-11 09:15:57,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8fbac660ead8a389b5eb 2026-03-11 09:15:57,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:15:57,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8fbac660ead8a389b5eb HTTP/1.1" 200 None 2026-03-11 09:15:57,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:15:57,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:15:57,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:15:57,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8fbac660ead8a389b5eb HTTP/1.1" 200 None 2026-03-11 09:15:57,361 - lava_callback - ERROR - Error processing callback for node 69ae8fbac660ead8a389b5eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:18:27,568 - lava_callback - INFO - Received callback for node 69b12ffca870a1dc3343bf0f INFO: 172.21.0.1:39916 - "POST /node/69b12ffca870a1dc3343bf0f HTTP/1.0" 202 Accepted 2026-03-11 09:18:27,575 - lava_callback - INFO - Starting async job submit for node 69b12ffca870a1dc3343bf0f 2026-03-11 09:18:27,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:18:27,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ffca870a1dc3343bf0f HTTP/1.1" 200 None 2026-03-11 09:18:27,654 - lava_callback - DEBUG - Processing node 69b12ffca870a1dc3343bf0f: baseline-arm 2026-03-11 09:18:28,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:18:28,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:18:28,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b12ffca870a1dc3343bf0f/log.txt.gz 2026-03-11 09:18:28,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:18:28,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:18:28,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b12ffca870a1dc3343bf0f/lava-logs.yaml 2026-03-11 09:18:28,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:18:28,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:18:28,937 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b12ffca870a1dc3343bf0f/lava_callback.json.gz DEBUG: Setup failed for 69b12ffca870a1dc3343bf0f. Transitting job node result: incomplete -> fail 2026-03-11 09:18:29,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:18:29,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ffca870a1dc3343bf0f HTTP/1.1" 200 None 2026-03-11 09:18:29,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:18:29,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:18:29,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:18:29,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12ffca870a1dc3343bf0f HTTP/1.1" 200 None 2026-03-11 09:18:29,221 - lava_callback - INFO - Completed processing callback for node 69b12ffca870a1dc3343bf0f INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:18:54,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:18:54,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42514 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 09:19:15,358 - lava_callback - INFO - Received callback for node 69b12f61a870a1dc3343bebd INFO: 172.21.0.1:42518 - "POST /node/69b12f61a870a1dc3343bebd HTTP/1.0" 202 Accepted 2026-03-11 09:19:15,366 - lava_callback - INFO - Starting async job submit for node 69b12f61a870a1dc3343bebd 2026-03-11 09:19:15,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:15,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f61a870a1dc3343bebd HTTP/1.1" 200 None 2026-03-11 09:19:15,440 - lava_callback - DEBUG - Processing node 69b12f61a870a1dc3343bebd: ltp-smoke 2026-03-11 09:19:15,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:19:16,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:19:16,065 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12f61a870a1dc3343bebd/log.txt.gz 2026-03-11 09:19:16,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:19:16,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:19:16,638 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12f61a870a1dc3343bebd/lava-logs.yaml 2026-03-11 09:19:16,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:19:16,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:19:16,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12f61a870a1dc3343bebd/lava_callback.json.gz 2026-03-11 09:19:16,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:16,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f61a870a1dc3343bebd HTTP/1.1" 200 None 2026-03-11 09:19:16,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:16,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12599a870a1dc3343ba8b HTTP/1.1" 200 None 2026-03-11 09:19:16,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:17,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12f61a870a1dc3343bebd HTTP/1.1" 200 None 2026-03-11 09:19:17,130 - lava_callback - INFO - Completed processing callback for node 69b12f61a870a1dc3343bebd 2026-03-11 09:19:24,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:24,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:19:34,548 - lava_callback - INFO - Received callback for node 69b13397a870a1dc3343c379 INFO: 172.21.0.1:36492 - "POST /node/69b13397a870a1dc3343c379 HTTP/1.0" 202 Accepted 2026-03-11 09:19:34,558 - lava_callback - INFO - Starting async job submit for node 69b13397a870a1dc3343c379 2026-03-11 09:19:34,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:34,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13397a870a1dc3343c379 HTTP/1.1" 200 None 2026-03-11 09:19:34,588 - lava_callback - DEBUG - Processing node 69b13397a870a1dc3343c379: baseline-x86 2026-03-11 09:19:34,595 - lava_callback - WARNING - Failed to upload log 2026-03-11 09:19:34,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:19:34,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:19:34,783 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b13397a870a1dc3343c379/lava-logs.yaml 2026-03-11 09:19:34,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:19:34,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:19:34,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b13397a870a1dc3343c379/lava_callback.json.gz 2026-03-11 09:19:34,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:34,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13397a870a1dc3343c379 HTTP/1.1" 200 None 2026-03-11 09:19:34,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:34,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:19:34,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:34,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13397a870a1dc3343c379 HTTP/1.1" 200 None 2026-03-11 09:19:35,011 - lava_callback - INFO - Completed processing callback for node 69b13397a870a1dc3343c379 INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:19:42,419 - lava_callback - INFO - Received callback for node 69ae90abc660ead8a389b665 INFO: 172.21.0.1:56974 - "POST /node/69ae90abc660ead8a389b665 HTTP/1.0" 202 Accepted 2026-03-11 09:19:42,425 - lava_callback - INFO - Starting async job submit for node 69ae90abc660ead8a389b665 2026-03-11 09:19:42,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:42,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae90abc660ead8a389b665 HTTP/1.1" 200 None 2026-03-11 09:19:42,441 - lava_callback - DEBUG - Processing node 69ae90abc660ead8a389b665: baseline-arm64-clabbe 2026-03-11 09:19:42,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae90abc660ead8a389b665 2026-03-11 09:19:42,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:42,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae90abc660ead8a389b665 HTTP/1.1" 200 None 2026-03-11 09:19:42,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:42,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:19:42,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:42,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae90abc660ead8a389b665 HTTP/1.1" 200 None 2026-03-11 09:19:42,504 - lava_callback - ERROR - Error processing callback for node 69ae90abc660ead8a389b665: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:19:54,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:54,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54134 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:20:02,529 - lava_callback - INFO - Received callback for node 69b13399a870a1dc3343c382 INFO: 172.21.0.1:58522 - "POST /node/69b13399a870a1dc3343c382 HTTP/1.0" 202 Accepted 2026-03-11 09:20:02,535 - lava_callback - INFO - Starting async job submit for node 69b13399a870a1dc3343c382 2026-03-11 09:20:02,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:02,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13399a870a1dc3343c382 HTTP/1.1" 200 None 2026-03-11 09:20:02,572 - lava_callback - DEBUG - Processing node 69b13399a870a1dc3343c382: baseline-x86 2026-03-11 09:20:02,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:02,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:02,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b13399a870a1dc3343c382/log.txt.gz 2026-03-11 09:20:02,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:03,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:03,179 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b13399a870a1dc3343c382/lava-logs.yaml 2026-03-11 09:20:03,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:03,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:03,319 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b13399a870a1dc3343c382/lava_callback.json.gz 2026-03-11 09:20:03,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:03,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13399a870a1dc3343c382 HTTP/1.1" 200 None 2026-03-11 09:20:03,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:03,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:20:03,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:03,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13399a870a1dc3343c382 HTTP/1.1" 200 None 2026-03-11 09:20:03,405 - lava_callback - INFO - Completed processing callback for node 69b13399a870a1dc3343c382 INFO: 172.21.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48068 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:20:24,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:24,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:20:38,948 - lava_callback - INFO - Received callback for node 69b13398a870a1dc3343c37c INFO: 172.21.0.1:42304 - "POST /node/69b13398a870a1dc3343c37c HTTP/1.0" 202 Accepted 2026-03-11 09:20:38,955 - lava_callback - INFO - Starting async job submit for node 69b13398a870a1dc3343c37c 2026-03-11 09:20:38,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:39,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13398a870a1dc3343c37c HTTP/1.1" 200 None 2026-03-11 09:20:39,014 - lava_callback - DEBUG - Processing node 69b13398a870a1dc3343c37c: baseline-x86 2026-03-11 09:20:39,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:39,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:39,574 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37c/log.txt.gz 2026-03-11 09:20:39,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:40,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:40,166 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37c/lava-logs.yaml 2026-03-11 09:20:40,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:40,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:40,328 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37c/lava_callback.json.gz 2026-03-11 09:20:40,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:40,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13398a870a1dc3343c37c HTTP/1.1" 200 None 2026-03-11 09:20:40,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:40,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:20:40,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:40,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13398a870a1dc3343c37c HTTP/1.1" 200 None 2026-03-11 09:20:40,429 - lava_callback - INFO - Completed processing callback for node 69b13398a870a1dc3343c37c INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:20:54,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:54,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51200 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:21:02,469 - lava_callback - INFO - Received callback for node 69ae90e8c660ead8a389b674 INFO: 172.21.0.1:47876 - "POST /node/69ae90e8c660ead8a389b674 HTTP/1.0" 202 Accepted 2026-03-11 09:21:02,479 - lava_callback - INFO - Starting async job submit for node 69ae90e8c660ead8a389b674 2026-03-11 09:21:02,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:21:02,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae90e8c660ead8a389b674 HTTP/1.1" 200 None 2026-03-11 09:21:02,529 - lava_callback - DEBUG - Processing node 69ae90e8c660ead8a389b674: baseline-arm-clabbe 2026-03-11 09:21:02,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae90e8c660ead8a389b674 2026-03-11 09:21:02,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:21:02,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae90e8c660ead8a389b674 HTTP/1.1" 200 None 2026-03-11 09:21:02,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:21:02,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:21:02,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:21:02,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae90e8c660ead8a389b674 HTTP/1.1" 200 None 2026-03-11 09:21:02,637 - lava_callback - ERROR - Error processing callback for node 69ae90e8c660ead8a389b674: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:22:42,588 - lava_callback - INFO - Received callback for node 69ae9159c660ead8a389b6a8 INFO: 172.21.0.1:53306 - "POST /node/69ae9159c660ead8a389b6a8 HTTP/1.0" 202 Accepted 2026-03-11 09:22:42,594 - lava_callback - INFO - Starting async job submit for node 69ae9159c660ead8a389b6a8 2026-03-11 09:22:42,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:22:42,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9159c660ead8a389b6a8 HTTP/1.1" 200 None 2026-03-11 09:22:42,614 - lava_callback - DEBUG - Processing node 69ae9159c660ead8a389b6a8: baseline-arm-clabbe 2026-03-11 09:22:42,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9159c660ead8a389b6a8 2026-03-11 09:22:42,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:22:42,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9159c660ead8a389b6a8 HTTP/1.1" 200 None 2026-03-11 09:22:42,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:22:42,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:22:42,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:22:42,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9159c660ead8a389b6a8 HTTP/1.1" 200 None 2026-03-11 09:22:42,685 - lava_callback - ERROR - Error processing callback for node 69ae9159c660ead8a389b6a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:23:37,634 - lava_callback - INFO - Received callback for node 69ae9189c660ead8a389b6ba INFO: 172.21.0.1:56466 - "POST /node/69ae9189c660ead8a389b6ba HTTP/1.0" 202 Accepted 2026-03-11 09:23:37,639 - lava_callback - INFO - Starting async job submit for node 69ae9189c660ead8a389b6ba 2026-03-11 09:23:37,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:23:37,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9189c660ead8a389b6ba HTTP/1.1" 200 None 2026-03-11 09:23:37,655 - lava_callback - DEBUG - Processing node 69ae9189c660ead8a389b6ba: baseline-arm64-baylibre 2026-03-11 09:23:37,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9189c660ead8a389b6ba 2026-03-11 09:23:37,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:23:37,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9189c660ead8a389b6ba HTTP/1.1" 200 None 2026-03-11 09:23:37,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:23:37,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:23:37,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:23:37,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9189c660ead8a389b6ba HTTP/1.1" 200 None 2026-03-11 09:23:37,711 - lava_callback - ERROR - Error processing callback for node 69ae9189c660ead8a389b6ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48520 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:26:02,669 - lava_callback - INFO - Received callback for node 69ae9227c660ead8a389b6f8 INFO: 172.21.0.1:47700 - "POST /node/69ae9227c660ead8a389b6f8 HTTP/1.0" 202 Accepted 2026-03-11 09:26:02,675 - lava_callback - INFO - Starting async job submit for node 69ae9227c660ead8a389b6f8 2026-03-11 09:26:02,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:26:02,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9227c660ead8a389b6f8 HTTP/1.1" 200 None 2026-03-11 09:26:02,691 - lava_callback - DEBUG - Processing node 69ae9227c660ead8a389b6f8: baseline-arm64-clabbe 2026-03-11 09:26:02,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9227c660ead8a389b6f8 2026-03-11 09:26:02,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:26:02,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9227c660ead8a389b6f8 HTTP/1.1" 200 None 2026-03-11 09:26:02,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:26:02,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:26:02,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:26:02,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9227c660ead8a389b6f8 HTTP/1.1" 200 None 2026-03-11 09:26:02,777 - lava_callback - ERROR - Error processing callback for node 69ae9227c660ead8a389b6f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50502 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:27:06,465 - lava_callback - INFO - Received callback for node 69b1354fa870a1dc3343c42b INFO: 172.21.0.1:38024 - "POST /node/69b1354fa870a1dc3343c42b HTTP/1.0" 202 Accepted 2026-03-11 09:27:06,471 - lava_callback - INFO - Starting async job submit for node 69b1354fa870a1dc3343c42b 2026-03-11 09:27:06,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:06,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1354fa870a1dc3343c42b HTTP/1.1" 200 None 2026-03-11 09:27:06,504 - lava_callback - DEBUG - Processing node 69b1354fa870a1dc3343c42b: baseline-x86 INFO: 172.21.0.1:38036 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:27:06,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:27:06,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:06,849 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1354fa870a1dc3343c42b/log.txt.gz 2026-03-11 09:27:06,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:27:07,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:07,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1354fa870a1dc3343c42b/lava-logs.yaml 2026-03-11 09:27:07,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:27:07,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:07,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1354fa870a1dc3343c42b/lava_callback.json.gz 2026-03-11 09:27:07,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:07,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1354fa870a1dc3343c42b HTTP/1.1" 200 None 2026-03-11 09:27:07,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:07,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:27:07,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:07,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1354fa870a1dc3343c42b HTTP/1.1" 200 None 2026-03-11 09:27:07,425 - lava_callback - INFO - Completed processing callback for node 69b1354fa870a1dc3343c42b INFO: 172.21.0.1:44660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:27:24,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:25,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 09:27:25,824 - lava_callback - INFO - Received callback for node 69b13550a870a1dc3343c42e INFO: 172.21.0.1:39010 - "POST /node/69b13550a870a1dc3343c42e HTTP/1.0" 202 Accepted 2026-03-11 09:27:25,830 - lava_callback - INFO - Starting async job submit for node 69b13550a870a1dc3343c42e 2026-03-11 09:27:25,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:25,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13550a870a1dc3343c42e HTTP/1.1" 200 None 2026-03-11 09:27:25,864 - lava_callback - DEBUG - Processing node 69b13550a870a1dc3343c42e: baseline-x86 2026-03-11 09:27:26,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:27:26,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:26,172 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b13550a870a1dc3343c42e/log.txt.gz 2026-03-11 09:27:26,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:27:26,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:26,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b13550a870a1dc3343c42e/lava-logs.yaml 2026-03-11 09:27:26,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:27:26,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:26,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b13550a870a1dc3343c42e/lava_callback.json.gz 2026-03-11 09:27:26,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:26,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13550a870a1dc3343c42e HTTP/1.1" 200 None 2026-03-11 09:27:26,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:26,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:27:26,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:26,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13550a870a1dc3343c42e HTTP/1.1" 200 None 2026-03-11 09:27:26,735 - lava_callback - INFO - Completed processing callback for node 69b13550a870a1dc3343c42e INFO: 172.21.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:27:55,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:55,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53314 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:28:42,769 - lava_callback - INFO - Received callback for node 69ae92c1c660ead8a389b73b INFO: 172.21.0.1:59312 - "POST /node/69ae92c1c660ead8a389b73b HTTP/1.0" 202 Accepted 2026-03-11 09:28:42,774 - lava_callback - INFO - Starting async job submit for node 69ae92c1c660ead8a389b73b 2026-03-11 09:28:42,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:28:42,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae92c1c660ead8a389b73b HTTP/1.1" 200 None 2026-03-11 09:28:42,790 - lava_callback - DEBUG - Processing node 69ae92c1c660ead8a389b73b: baseline-arm64-clabbe 2026-03-11 09:28:42,790 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae92c1c660ead8a389b73b 2026-03-11 09:28:42,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:28:42,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae92c1c660ead8a389b73b HTTP/1.1" 200 None 2026-03-11 09:28:42,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:28:42,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:28:42,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:28:42,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae92c1c660ead8a389b73b HTTP/1.1" 200 None 2026-03-11 09:28:42,853 - lava_callback - ERROR - Error processing callback for node 69ae92c1c660ead8a389b73b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47900 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:29:04,004 - lava_callback - INFO - Received callback for node 69b12a0da870a1dc3343bb74 INFO: 172.21.0.1:37284 - "POST /node/69b12a0da870a1dc3343bb74 HTTP/1.0" 202 Accepted 2026-03-11 09:29:04,053 - lava_callback - INFO - Starting async job submit for node 69b12a0da870a1dc3343bb74 2026-03-11 09:29:04,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:04,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0da870a1dc3343bb74 HTTP/1.1" 200 None 2026-03-11 09:29:04,100 - lava_callback - DEBUG - Processing node 69b12a0da870a1dc3343bb74: baseline-arm-pengutronix 2026-03-11 09:29:04,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:29:04,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:29:04,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0da870a1dc3343bb74/log.txt.gz 2026-03-11 09:29:04,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:29:04,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:29:04,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0da870a1dc3343bb74/lava-logs.yaml 2026-03-11 09:29:04,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:29:04,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:29:04,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0da870a1dc3343bb74/lava_callback.json.gz DEBUG: Setup failed for 69b12a0da870a1dc3343bb74. Transitting job node result: incomplete -> fail 2026-03-11 09:29:04,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:04,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0da870a1dc3343bb74 HTTP/1.1" 200 None 2026-03-11 09:29:04,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:04,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:29:04,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:04,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a0da870a1dc3343bb74 HTTP/1.1" 200 None 2026-03-11 09:29:04,968 - lava_callback - INFO - Completed processing callback for node 69b12a0da870a1dc3343bb74 INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:29:25,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:25,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:29:57,963 - lava_callback - INFO - Received callback for node 69ae9304c660ead8a389b749 INFO: 172.21.0.1:56620 - "POST /node/69ae9304c660ead8a389b749 HTTP/1.0" 202 Accepted 2026-03-11 09:29:57,969 - lava_callback - INFO - Starting async job submit for node 69ae9304c660ead8a389b749 2026-03-11 09:29:57,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:57,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9304c660ead8a389b749 HTTP/1.1" 200 None 2026-03-11 09:29:57,986 - lava_callback - DEBUG - Processing node 69ae9304c660ead8a389b749: baseline-arm64-baylibre 2026-03-11 09:29:57,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9304c660ead8a389b749 2026-03-11 09:29:57,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:58,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9304c660ead8a389b749 HTTP/1.1" 200 None 2026-03-11 09:29:58,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:58,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:29:58,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:58,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9304c660ead8a389b749 HTTP/1.1" 200 None 2026-03-11 09:29:58,045 - lava_callback - ERROR - Error processing callback for node 69ae9304c660ead8a389b749: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:30:57,940 - lava_callback - INFO - Received callback for node 69ae934ec660ead8a389b75c INFO: 172.21.0.1:39144 - "POST /node/69ae934ec660ead8a389b75c HTTP/1.0" 202 Accepted 2026-03-11 09:30:57,945 - lava_callback - INFO - Starting async job submit for node 69ae934ec660ead8a389b75c 2026-03-11 09:30:57,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:30:57,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae934ec660ead8a389b75c HTTP/1.1" 200 None 2026-03-11 09:30:57,961 - lava_callback - DEBUG - Processing node 69ae934ec660ead8a389b75c: baseline-arm64-baylibre 2026-03-11 09:30:57,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae934ec660ead8a389b75c 2026-03-11 09:30:57,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:30:57,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae934ec660ead8a389b75c HTTP/1.1" 200 None 2026-03-11 09:30:57,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:30:57,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:30:57,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:30:58,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae934ec660ead8a389b75c HTTP/1.1" 200 None 2026-03-11 09:30:58,014 - lava_callback - ERROR - Error processing callback for node 69ae934ec660ead8a389b75c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:32:18,109 - lava_callback - INFO - Received callback for node 69ae9399c660ead8a389b778 INFO: 172.21.0.1:36212 - "POST /node/69ae9399c660ead8a389b778 HTTP/1.0" 202 Accepted 2026-03-11 09:32:18,115 - lava_callback - INFO - Starting async job submit for node 69ae9399c660ead8a389b778 2026-03-11 09:32:18,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:32:18,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9399c660ead8a389b778 HTTP/1.1" 200 None 2026-03-11 09:32:18,137 - lava_callback - DEBUG - Processing node 69ae9399c660ead8a389b778: baseline-arm64-baylibre 2026-03-11 09:32:18,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9399c660ead8a389b778 2026-03-11 09:32:18,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:32:18,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9399c660ead8a389b778 HTTP/1.1" 200 None 2026-03-11 09:32:18,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:32:18,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:32:18,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:32:18,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9399c660ead8a389b778 HTTP/1.1" 200 None 2026-03-11 09:32:18,234 - lava_callback - ERROR - Error processing callback for node 69ae9399c660ead8a389b778: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:33:38,151 - lava_callback - INFO - Received callback for node 69ae93e5c660ead8a389b787 INFO: 172.21.0.1:45086 - "POST /node/69ae93e5c660ead8a389b787 HTTP/1.0" 202 Accepted 2026-03-11 09:33:38,157 - lava_callback - INFO - Starting async job submit for node 69ae93e5c660ead8a389b787 2026-03-11 09:33:38,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:33:38,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae93e5c660ead8a389b787 HTTP/1.1" 200 None 2026-03-11 09:33:38,174 - lava_callback - DEBUG - Processing node 69ae93e5c660ead8a389b787: baseline-arm64-baylibre 2026-03-11 09:33:38,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae93e5c660ead8a389b787 2026-03-11 09:33:38,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:33:38,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae93e5c660ead8a389b787 HTTP/1.1" 200 None 2026-03-11 09:33:38,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:33:38,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:33:38,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:33:38,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae93e5c660ead8a389b787 HTTP/1.1" 200 None 2026-03-11 09:33:38,237 - lava_callback - ERROR - Error processing callback for node 69ae93e5c660ead8a389b787: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:34:58,197 - lava_callback - INFO - Received callback for node 69ae942fc660ead8a389b7ad INFO: 172.21.0.1:57998 - "POST /node/69ae942fc660ead8a389b7ad HTTP/1.0" 202 Accepted 2026-03-11 09:34:58,203 - lava_callback - INFO - Starting async job submit for node 69ae942fc660ead8a389b7ad 2026-03-11 09:34:58,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:34:58,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae942fc660ead8a389b7ad HTTP/1.1" 200 None 2026-03-11 09:34:58,219 - lava_callback - DEBUG - Processing node 69ae942fc660ead8a389b7ad: baseline-arm64-baylibre 2026-03-11 09:34:58,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae942fc660ead8a389b7ad 2026-03-11 09:34:58,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:34:58,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae942fc660ead8a389b7ad HTTP/1.1" 200 None 2026-03-11 09:34:58,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:34:58,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:34:58,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:34:58,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae942fc660ead8a389b7ad HTTP/1.1" 200 None 2026-03-11 09:34:58,280 - lava_callback - ERROR - Error processing callback for node 69ae942fc660ead8a389b7ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:35:07,846 - lava_callback - INFO - Received callback for node 69b13398a870a1dc3343c37f INFO: 172.21.0.1:33212 - "POST /node/69b13398a870a1dc3343c37f HTTP/1.0" 202 Accepted 2026-03-11 09:35:07,853 - lava_callback - INFO - Starting async job submit for node 69b13398a870a1dc3343c37f 2026-03-11 09:35:07,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:07,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13398a870a1dc3343c37f HTTP/1.1" 200 None 2026-03-11 09:35:07,913 - lava_callback - DEBUG - Processing node 69b13398a870a1dc3343c37f: baseline-x86 2026-03-11 09:35:08,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:35:08,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:35:08,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37f/log.txt.gz 2026-03-11 09:35:09,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:35:09,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:35:09,541 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37f/lava-logs.yaml 2026-03-11 09:35:09,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:35:09,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:35:09,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37f/lava_callback.json.gz DEBUG: Setup failed for 69b13398a870a1dc3343c37f. Transitting job node result: incomplete -> fail 2026-03-11 09:35:09,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:09,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13398a870a1dc3343c37f HTTP/1.1" 200 None 2026-03-11 09:35:09,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:09,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:35:09,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:09,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13398a870a1dc3343c37f HTTP/1.1" 200 None 2026-03-11 09:35:10,000 - lava_callback - INFO - Completed processing callback for node 69b13398a870a1dc3343c37f INFO: 172.21.0.1:39930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:35:25,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:25,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:35:58,275 - lava_callback - INFO - Received callback for node 69ae947ac660ead8a389b7ba INFO: 172.21.0.1:56426 - "POST /node/69ae947ac660ead8a389b7ba HTTP/1.0" 202 Accepted 2026-03-11 09:35:58,281 - lava_callback - INFO - Starting async job submit for node 69ae947ac660ead8a389b7ba 2026-03-11 09:35:58,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:58,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae947ac660ead8a389b7ba HTTP/1.1" 200 None 2026-03-11 09:35:58,298 - lava_callback - DEBUG - Processing node 69ae947ac660ead8a389b7ba: baseline-arm64-baylibre 2026-03-11 09:35:58,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae947ac660ead8a389b7ba 2026-03-11 09:35:58,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:58,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae947ac660ead8a389b7ba HTTP/1.1" 200 None 2026-03-11 09:35:58,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:58,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:35:58,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:58,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae947ac660ead8a389b7ba HTTP/1.1" 200 None 2026-03-11 09:35:58,363 - lava_callback - ERROR - Error processing callback for node 69ae947ac660ead8a389b7ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:37:23,088 - lava_callback - INFO - Received callback for node 69ae94c8c660ead8a389b7e1 INFO: 172.21.0.1:47936 - "POST /node/69ae94c8c660ead8a389b7e1 HTTP/1.0" 202 Accepted 2026-03-11 09:37:23,100 - lava_callback - INFO - Starting async job submit for node 69ae94c8c660ead8a389b7e1 2026-03-11 09:37:23,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:37:23,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae94c8c660ead8a389b7e1 HTTP/1.1" 200 None 2026-03-11 09:37:23,131 - lava_callback - DEBUG - Processing node 69ae94c8c660ead8a389b7e1: baseline-arm64-clabbe 2026-03-11 09:37:23,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae94c8c660ead8a389b7e1 2026-03-11 09:37:23,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:37:23,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae94c8c660ead8a389b7e1 HTTP/1.1" 200 None 2026-03-11 09:37:23,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:37:23,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:37:23,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:37:23,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae94c8c660ead8a389b7e1 HTTP/1.1" 200 None 2026-03-11 09:37:23,206 - lava_callback - ERROR - Error processing callback for node 69ae94c8c660ead8a389b7e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:38:43,137 - lava_callback - INFO - Received callback for node 69ae9514c660ead8a389b7f7 INFO: 172.21.0.1:43578 - "POST /node/69ae9514c660ead8a389b7f7 HTTP/1.0" 202 Accepted 2026-03-11 09:38:43,143 - lava_callback - INFO - Starting async job submit for node 69ae9514c660ead8a389b7f7 2026-03-11 09:38:43,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:38:43,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9514c660ead8a389b7f7 HTTP/1.1" 200 None 2026-03-11 09:38:43,167 - lava_callback - DEBUG - Processing node 69ae9514c660ead8a389b7f7: baseline-arm64-clabbe 2026-03-11 09:38:43,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9514c660ead8a389b7f7 2026-03-11 09:38:43,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:38:43,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9514c660ead8a389b7f7 HTTP/1.1" 200 None 2026-03-11 09:38:43,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:38:43,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:38:43,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:38:43,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9514c660ead8a389b7f7 HTTP/1.1" 200 None 2026-03-11 09:38:43,239 - lava_callback - ERROR - Error processing callback for node 69ae9514c660ead8a389b7f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:39:58,876 - lava_callback - INFO - Received callback for node 69b137f5a870a1dc3343c4f7 INFO: 172.21.0.1:49350 - "POST /node/69b137f5a870a1dc3343c4f7 HTTP/1.0" 202 Accepted 2026-03-11 09:39:58,882 - lava_callback - INFO - Starting async job submit for node 69b137f5a870a1dc3343c4f7 2026-03-11 09:39:58,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:39:58,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b137f5a870a1dc3343c4f7 HTTP/1.1" 200 None 2026-03-11 09:39:58,915 - lava_callback - DEBUG - Processing node 69b137f5a870a1dc3343c4f7: baseline-x86 2026-03-11 09:39:59,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:39:59,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:39:59,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b137f5a870a1dc3343c4f7/log.txt.gz 2026-03-11 09:39:59,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:39:59,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:39:59,690 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b137f5a870a1dc3343c4f7/lava-logs.yaml 2026-03-11 09:39:59,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:39:59,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:39:59,837 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b137f5a870a1dc3343c4f7/lava_callback.json.gz 2026-03-11 09:39:59,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:39:59,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b137f5a870a1dc3343c4f7 HTTP/1.1" 200 None 2026-03-11 09:39:59,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:39:59,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:39:59,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:39:59,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b137f5a870a1dc3343c4f7 HTTP/1.1" 200 None 2026-03-11 09:39:59,941 - lava_callback - INFO - Completed processing callback for node 69b137f5a870a1dc3343c4f7 INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:40:25,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:25,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 09:40:25,788 - lava_callback - INFO - Received callback for node 69b134aba870a1dc3343c40a INFO: 172.21.0.1:52796 - "POST /node/69b134aba870a1dc3343c40a HTTP/1.0" 202 Accepted 2026-03-11 09:40:25,795 - lava_callback - INFO - Starting async job submit for node 69b134aba870a1dc3343c40a 2026-03-11 09:40:25,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:25,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b134aba870a1dc3343c40a HTTP/1.1" 200 None 2026-03-11 09:40:25,863 - lava_callback - DEBUG - Processing node 69b134aba870a1dc3343c40a: baseline-arm 2026-03-11 09:40:26,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:40:26,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:40:26,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b134aba870a1dc3343c40a/log.txt.gz 2026-03-11 09:40:26,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:40:27,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:40:27,219 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b134aba870a1dc3343c40a/lava-logs.yaml 2026-03-11 09:40:27,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:40:27,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:40:27,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b134aba870a1dc3343c40a/lava_callback.json.gz DEBUG: Setup failed for 69b134aba870a1dc3343c40a. Transitting job node result: incomplete -> fail 2026-03-11 09:40:27,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:27,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b134aba870a1dc3343c40a HTTP/1.1" 200 None 2026-03-11 09:40:27,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:27,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:40:27,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:27,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b134aba870a1dc3343c40a HTTP/1.1" 200 None 2026-03-11 09:40:27,690 - lava_callback - INFO - Completed processing callback for node 69b134aba870a1dc3343c40a INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:40:55,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:55,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:41:57,068 - lava_callback - INFO - Received callback for node 69b134cea870a1dc3343c418 INFO: 172.21.0.1:55322 - "POST /node/69b134cea870a1dc3343c418 HTTP/1.0" 202 Accepted 2026-03-11 09:41:57,076 - lava_callback - INFO - Starting async job submit for node 69b134cea870a1dc3343c418 2026-03-11 09:41:57,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:41:57,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b134cea870a1dc3343c418 HTTP/1.1" 200 None 2026-03-11 09:41:57,163 - lava_callback - DEBUG - Processing node 69b134cea870a1dc3343c418: ltp-smoke 2026-03-11 09:41:57,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:41:57,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:41:57,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b134cea870a1dc3343c418/log.txt.gz 2026-03-11 09:41:58,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:41:58,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:41:58,365 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b134cea870a1dc3343c418/lava-logs.yaml 2026-03-11 09:41:58,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:41:58,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:41:58,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b134cea870a1dc3343c418/lava_callback.json.gz 2026-03-11 09:41:58,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:41:58,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b134cea870a1dc3343c418 HTTP/1.1" 200 None 2026-03-11 09:41:58,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:41:58,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12599a870a1dc3343ba8b HTTP/1.1" 200 None 2026-03-11 09:41:58,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:41:58,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b134cea870a1dc3343c418 HTTP/1.1" 200 None 2026-03-11 09:41:58,884 - lava_callback - INFO - Completed processing callback for node 69b134cea870a1dc3343c418 INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:42:25,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:42:25,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:45:19,250 - lava_callback - INFO - Received callback for node 69ae96abc660ead8a389b887 INFO: 172.21.0.1:60266 - "POST /node/69ae96abc660ead8a389b887 HTTP/1.0" 202 Accepted 2026-03-11 09:45:19,255 - lava_callback - INFO - Starting async job submit for node 69ae96abc660ead8a389b887 2026-03-11 09:45:19,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:45:19,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae96abc660ead8a389b887 HTTP/1.1" 200 None 2026-03-11 09:45:19,271 - lava_callback - DEBUG - Processing node 69ae96abc660ead8a389b887: baseline-arm64-baylibre 2026-03-11 09:45:19,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae96abc660ead8a389b887 2026-03-11 09:45:19,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:45:19,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae96abc660ead8a389b887 HTTP/1.1" 200 None 2026-03-11 09:45:19,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:45:19,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-11 09:45:19,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:45:19,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae96abc660ead8a389b887 HTTP/1.1" 200 None 2026-03-11 09:45:19,324 - lava_callback - ERROR - Error processing callback for node 69ae96abc660ead8a389b887: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:46:38,842 - lava_callback - INFO - Received callback for node 69ae96f7c660ead8a389b89b INFO: 172.21.0.1:33602 - "POST /node/69ae96f7c660ead8a389b89b HTTP/1.0" 202 Accepted 2026-03-11 09:46:38,848 - lava_callback - INFO - Starting async job submit for node 69ae96f7c660ead8a389b89b 2026-03-11 09:46:38,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:46:38,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae96f7c660ead8a389b89b HTTP/1.1" 200 None 2026-03-11 09:46:38,870 - lava_callback - DEBUG - Processing node 69ae96f7c660ead8a389b89b: baseline-arm64-baylibre 2026-03-11 09:46:38,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae96f7c660ead8a389b89b 2026-03-11 09:46:38,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:46:38,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae96f7c660ead8a389b89b HTTP/1.1" 200 None 2026-03-11 09:46:38,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:46:38,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-11 09:46:38,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:46:38,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae96f7c660ead8a389b89b HTTP/1.1" 200 None 2026-03-11 09:46:38,924 - lava_callback - ERROR - Error processing callback for node 69ae96f7c660ead8a389b89b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:49:45,230 - lava_callback - INFO - Received callback for node 69b1362aa870a1dc3343c485 INFO: 172.21.0.1:48036 - "POST /node/69b1362aa870a1dc3343c485 HTTP/1.0" 202 Accepted 2026-03-11 09:49:45,277 - lava_callback - INFO - Starting async job submit for node 69b1362aa870a1dc3343c485 2026-03-11 09:49:45,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:45,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1362aa870a1dc3343c485 HTTP/1.1" 200 None 2026-03-11 09:49:45,316 - lava_callback - DEBUG - Processing node 69b1362aa870a1dc3343c485: baseline-arm-pengutronix 2026-03-11 09:49:45,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:49:45,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:49:45,573 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1362aa870a1dc3343c485/log.txt.gz 2026-03-11 09:49:45,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:49:45,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:49:45,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1362aa870a1dc3343c485/lava-logs.yaml 2026-03-11 09:49:45,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:49:45,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:49:45,944 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1362aa870a1dc3343c485/lava_callback.json.gz DEBUG: Setup failed for 69b1362aa870a1dc3343c485. Transitting job node result: incomplete -> fail 2026-03-11 09:49:46,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:46,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1362aa870a1dc3343c485 HTTP/1.1" 200 None 2026-03-11 09:49:46,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:46,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:49:46,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:46,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1362aa870a1dc3343c485 HTTP/1.1" 200 None 2026-03-11 09:49:46,160 - lava_callback - INFO - Completed processing callback for node 69b1362aa870a1dc3343c485 INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:49:55,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:55,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:49:59,027 - lava_callback - INFO - Received callback for node 69ae97b5c660ead8a389b8d3 INFO: 172.21.0.1:41638 - "POST /node/69ae97b5c660ead8a389b8d3 HTTP/1.0" 202 Accepted 2026-03-11 09:49:59,033 - lava_callback - INFO - Starting async job submit for node 69ae97b5c660ead8a389b8d3 2026-03-11 09:49:59,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:59,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae97b5c660ead8a389b8d3 HTTP/1.1" 200 None 2026-03-11 09:49:59,052 - lava_callback - DEBUG - Processing node 69ae97b5c660ead8a389b8d3: baseline-arm64-baylibre 2026-03-11 09:49:59,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae97b5c660ead8a389b8d3 2026-03-11 09:49:59,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:59,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae97b5c660ead8a389b8d3 HTTP/1.1" 200 None 2026-03-11 09:49:59,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:59,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-11 09:49:59,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:59,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae97b5c660ead8a389b8d3 HTTP/1.1" 200 None 2026-03-11 09:49:59,107 - lava_callback - ERROR - Error processing callback for node 69ae97b5c660ead8a389b8d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:52:19,374 - lava_callback - INFO - Received callback for node 69ae984cc660ead8a389b905 INFO: 172.21.0.1:44194 - "POST /node/69ae984cc660ead8a389b905 HTTP/1.0" 202 Accepted 2026-03-11 09:52:19,379 - lava_callback - INFO - Starting async job submit for node 69ae984cc660ead8a389b905 2026-03-11 09:52:19,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:52:19,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae984cc660ead8a389b905 HTTP/1.1" 200 None 2026-03-11 09:52:19,419 - lava_callback - DEBUG - Processing node 69ae984cc660ead8a389b905: baseline-arm64-baylibre 2026-03-11 09:52:19,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae984cc660ead8a389b905 2026-03-11 09:52:19,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:52:19,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae984cc660ead8a389b905 HTTP/1.1" 200 None 2026-03-11 09:52:19,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:52:19,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-11 09:52:19,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:52:19,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae984cc660ead8a389b905 HTTP/1.1" 200 None 2026-03-11 09:52:19,518 - lava_callback - ERROR - Error processing callback for node 69ae984cc660ead8a389b905: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:55:04,103 - lava_callback - INFO - Received callback for node 69ae98e6c660ead8a389b92e INFO: 172.21.0.1:56626 - "POST /node/69ae98e6c660ead8a389b92e HTTP/1.0" 202 Accepted 2026-03-11 09:55:04,110 - lava_callback - INFO - Starting async job submit for node 69ae98e6c660ead8a389b92e 2026-03-11 09:55:04,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:55:04,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae98e6c660ead8a389b92e HTTP/1.1" 200 None 2026-03-11 09:55:04,132 - lava_callback - DEBUG - Processing node 69ae98e6c660ead8a389b92e: baseline-arm64-clabbe 2026-03-11 09:55:04,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae98e6c660ead8a389b92e 2026-03-11 09:55:04,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:55:04,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae98e6c660ead8a389b92e HTTP/1.1" 200 None 2026-03-11 09:55:04,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:55:04,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-11 09:55:04,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:55:04,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae98e6c660ead8a389b92e HTTP/1.1" 200 None 2026-03-11 09:55:04,222 - lava_callback - ERROR - Error processing callback for node 69ae98e6c660ead8a389b92e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:57:19,491 - lava_callback - INFO - Received callback for node 69ae9976c660ead8a389b957 INFO: 172.21.0.1:50300 - "POST /node/69ae9976c660ead8a389b957 HTTP/1.0" 202 Accepted 2026-03-11 09:57:19,500 - lava_callback - INFO - Starting async job submit for node 69ae9976c660ead8a389b957 2026-03-11 09:57:19,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:19,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9976c660ead8a389b957 HTTP/1.1" 200 None 2026-03-11 09:57:19,526 - lava_callback - DEBUG - Processing node 69ae9976c660ead8a389b957: baseline-arm64-baylibre 2026-03-11 09:57:19,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9976c660ead8a389b957 2026-03-11 09:57:19,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:19,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9976c660ead8a389b957 HTTP/1.1" 200 None 2026-03-11 09:57:19,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:19,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:57:19,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:19,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9976c660ead8a389b957 HTTP/1.1" 200 None 2026-03-11 09:57:19,614 - lava_callback - ERROR - Error processing callback for node 69ae9976c660ead8a389b957: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:57:30,368 - lava_callback - INFO - Received callback for node 69b13c6ba870a1dc3343c5c4 INFO: 172.21.0.1:54292 - "POST /node/69b13c6ba870a1dc3343c5c4 HTTP/1.0" 202 Accepted 2026-03-11 09:57:30,377 - lava_callback - INFO - Starting async job submit for node 69b13c6ba870a1dc3343c5c4 2026-03-11 09:57:30,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:30,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ba870a1dc3343c5c4 HTTP/1.1" 200 None 2026-03-11 09:57:30,416 - lava_callback - DEBUG - Processing node 69b13c6ba870a1dc3343c5c4: baseline-arm64 2026-03-11 09:57:30,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:30,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:30,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ba870a1dc3343c5c4/log.txt.gz 2026-03-11 09:57:30,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:31,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:31,058 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ba870a1dc3343c5c4/lava-logs.yaml 2026-03-11 09:57:31,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:31,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:31,205 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ba870a1dc3343c5c4/lava_callback.json.gz 2026-03-11 09:57:31,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:31,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ba870a1dc3343c5c4 HTTP/1.1" 200 None 2026-03-11 09:57:31,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:31,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:57:31,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:31,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c6ba870a1dc3343c5c4 HTTP/1.1" 200 None 2026-03-11 09:57:31,288 - lava_callback - INFO - Completed processing callback for node 69b13c6ba870a1dc3343c5c4 INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:57:49,970 - lava_callback - INFO - Received callback for node 69b13c88a870a1dc3343c617 INFO: 172.21.0.1:55124 - "POST /node/69b13c88a870a1dc3343c617 HTTP/1.0" 202 Accepted 2026-03-11 09:57:49,979 - lava_callback - INFO - Starting async job submit for node 69b13c88a870a1dc3343c617 2026-03-11 09:57:49,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:50,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c88a870a1dc3343c617 HTTP/1.1" 200 None 2026-03-11 09:57:50,022 - lava_callback - DEBUG - Processing node 69b13c88a870a1dc3343c617: baseline-nfs-arm64 2026-03-11 09:57:50,024 - lava_callback - WARNING - Failed to upload log 2026-03-11 09:57:50,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:50,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:50,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c88a870a1dc3343c617/lava-logs.yaml 2026-03-11 09:57:50,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:50,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:50,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c88a870a1dc3343c617/lava_callback.json.gz 2026-03-11 09:57:50,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:50,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c88a870a1dc3343c617 HTTP/1.1" 200 None 2026-03-11 09:57:50,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:50,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:57:50,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:50,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c88a870a1dc3343c617 HTTP/1.1" 200 None 2026-03-11 09:57:50,408 - lava_callback - INFO - Completed processing callback for node 69b13c88a870a1dc3343c617 2026-03-11 09:57:54,674 - lava_callback - INFO - Received callback for node 69b13c78a870a1dc3343c5ef INFO: 172.21.0.1:55130 - "POST /node/69b13c78a870a1dc3343c5ef HTTP/1.0" 202 Accepted 2026-03-11 09:57:54,681 - lava_callback - INFO - Starting async job submit for node 69b13c78a870a1dc3343c5ef 2026-03-11 09:57:54,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:54,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c78a870a1dc3343c5ef HTTP/1.1" 200 None 2026-03-11 09:57:54,741 - lava_callback - DEBUG - Processing node 69b13c78a870a1dc3343c5ef: baseline-arm64 2026-03-11 09:57:55,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:55,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:55,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:55,201 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c78a870a1dc3343c5ef/log.txt.gz 2026-03-11 09:57:55,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 09:57:55,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:55,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:55,538 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c78a870a1dc3343c5ef/lava-logs.yaml 2026-03-11 09:57:55,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:55,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:55,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c78a870a1dc3343c5ef/lava_callback.json.gz 2026-03-11 09:57:55,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:56,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c78a870a1dc3343c5ef HTTP/1.1" 200 None 2026-03-11 09:57:56,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:56,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:57:56,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:56,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c78a870a1dc3343c5ef HTTP/1.1" 200 None 2026-03-11 09:57:56,088 - lava_callback - INFO - Completed processing callback for node 69b13c78a870a1dc3343c5ef INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33914 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:58:10,405 - lava_callback - INFO - Received callback for node 69b138dda870a1dc3343c532 INFO: 172.21.0.1:41054 - "POST /node/69b138dda870a1dc3343c532 HTTP/1.0" 202 Accepted 2026-03-11 09:58:10,416 - lava_callback - INFO - Starting async job submit for node 69b138dda870a1dc3343c532 2026-03-11 09:58:10,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:10,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b138dda870a1dc3343c532 HTTP/1.1" 200 None 2026-03-11 09:58:10,494 - lava_callback - DEBUG - Processing node 69b138dda870a1dc3343c532: baseline-arm 2026-03-11 09:58:11,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:11,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:11,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b138dda870a1dc3343c532/log.txt.gz 2026-03-11 09:58:11,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:12,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:12,149 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b138dda870a1dc3343c532/lava-logs.yaml 2026-03-11 09:58:12,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:12,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:12,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b138dda870a1dc3343c532/lava_callback.json.gz DEBUG: Setup failed for 69b138dda870a1dc3343c532. Transitting job node result: incomplete -> fail 2026-03-11 09:58:12,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:12,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b138dda870a1dc3343c532 HTTP/1.1" 200 None 2026-03-11 09:58:12,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:12,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:58:12,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:12,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b138dda870a1dc3343c532 HTTP/1.1" 200 None 2026-03-11 09:58:12,624 - lava_callback - INFO - Completed processing callback for node 69b138dda870a1dc3343c532 INFO: 172.21.0.1:41058 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 09:58:16,375 - lava_callback - INFO - Received callback for node 69b13c6ca870a1dc3343c5ca INFO: 172.21.0.1:41072 - "POST /node/69b13c6ca870a1dc3343c5ca HTTP/1.0" 202 Accepted 2026-03-11 09:58:16,383 - lava_callback - INFO - Starting async job submit for node 69b13c6ca870a1dc3343c5ca 2026-03-11 09:58:16,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:16,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ca870a1dc3343c5ca HTTP/1.1" 200 None 2026-03-11 09:58:16,423 - lava_callback - DEBUG - Processing node 69b13c6ca870a1dc3343c5ca: baseline-arm64 INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:58:16,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:16,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:16,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5ca/log.txt.gz 2026-03-11 09:58:17,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:17,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:17,373 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5ca/lava-logs.yaml 2026-03-11 09:58:17,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:17,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:17,545 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5ca/lava_callback.json.gz 2026-03-11 09:58:17,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:17,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ca870a1dc3343c5ca HTTP/1.1" 200 None 2026-03-11 09:58:17,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:17,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:58:17,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:17,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c6ca870a1dc3343c5ca HTTP/1.1" 200 None 2026-03-11 09:58:17,673 - lava_callback - INFO - Completed processing callback for node 69b13c6ca870a1dc3343c5ca 2026-03-11 09:58:25,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:25,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:58:41,062 - lava_callback - INFO - Received callback for node 69b13c6ca870a1dc3343c5c7 INFO: 172.21.0.1:36060 - "POST /node/69b13c6ca870a1dc3343c5c7 HTTP/1.0" 202 Accepted 2026-03-11 09:58:41,068 - lava_callback - INFO - Starting async job submit for node 69b13c6ca870a1dc3343c5c7 2026-03-11 09:58:41,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:41,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ca870a1dc3343c5c7 HTTP/1.1" 200 None 2026-03-11 09:58:41,107 - lava_callback - DEBUG - Processing node 69b13c6ca870a1dc3343c5c7: baseline-arm64 2026-03-11 09:58:41,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:41,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:41,468 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5c7/log.txt.gz 2026-03-11 09:58:41,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:41,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:41,825 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5c7/lava-logs.yaml 2026-03-11 09:58:41,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:42,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:42,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5c7/lava_callback.json.gz 2026-03-11 09:58:42,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:42,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ca870a1dc3343c5c7 HTTP/1.1" 200 None 2026-03-11 09:58:42,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:42,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:58:42,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:42,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c6ca870a1dc3343c5c7 HTTP/1.1" 200 None 2026-03-11 09:58:42,140 - lava_callback - INFO - Completed processing callback for node 69b13c6ca870a1dc3343c5c7 INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:58:55,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:55,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:13,240 - lava_callback - INFO - Received callback for node 69b13cb5a870a1dc3343c6bf INFO: 172.21.0.1:49888 - "POST /node/69b13cb5a870a1dc3343c6bf HTTP/1.0" 202 Accepted 2026-03-11 09:59:13,248 - lava_callback - INFO - Starting async job submit for node 69b13cb5a870a1dc3343c6bf 2026-03-11 09:59:13,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:13,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb5a870a1dc3343c6bf HTTP/1.1" 200 None 2026-03-11 09:59:13,291 - lava_callback - DEBUG - Processing node 69b13cb5a870a1dc3343c6bf: baseline-arm64-foundriesio 2026-03-11 09:59:13,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:13,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:13,675 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6bf/log.txt.gz 2026-03-11 09:59:13,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:14,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:14,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6bf/lava-logs.yaml 2026-03-11 09:59:14,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:14,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:14,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6bf/lava_callback.json.gz 2026-03-11 09:59:14,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:14,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb5a870a1dc3343c6bf HTTP/1.1" 200 None 2026-03-11 09:59:14,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:14,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:14,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:14,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cb5a870a1dc3343c6bf HTTP/1.1" 200 None 2026-03-11 09:59:14,283 - lava_callback - INFO - Completed processing callback for node 69b13cb5a870a1dc3343c6bf 2026-03-11 09:59:14,595 - lava_callback - INFO - Received callback for node 69b13c6fa870a1dc3343c5d0 INFO: 172.21.0.1:49894 - "POST /node/69b13c6fa870a1dc3343c5d0 HTTP/1.0" 202 Accepted 2026-03-11 09:59:14,632 - lava_callback - INFO - Starting async job submit for node 69b13c6fa870a1dc3343c5d0 2026-03-11 09:59:14,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:14,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6fa870a1dc3343c5d0 HTTP/1.1" 200 None 2026-03-11 09:59:14,678 - lava_callback - DEBUG - Processing node 69b13c6fa870a1dc3343c5d0: baseline-arm64 2026-03-11 09:59:14,810 - lava_callback - WARNING - Failed to upload log 2026-03-11 09:59:14,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:15,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:15,076 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6fa870a1dc3343c5d0/lava-logs.yaml 2026-03-11 09:59:15,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49900 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 09:59:15,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:15,211 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6fa870a1dc3343c5d0/lava_callback.json.gz 2026-03-11 09:59:15,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:15,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6fa870a1dc3343c5d0 HTTP/1.1" 200 None 2026-03-11 09:59:15,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:15,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:15,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:15,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c6fa870a1dc3343c5d0 HTTP/1.1" 200 None 2026-03-11 09:59:15,379 - lava_callback - INFO - Completed processing callback for node 69b13c6fa870a1dc3343c5d0 2026-03-11 09:59:15,951 - lava_callback - INFO - Received callback for node 69b13c70a870a1dc3343c5dd INFO: 172.21.0.1:49902 - "POST /node/69b13c70a870a1dc3343c5dd HTTP/1.0" 202 Accepted 2026-03-11 09:59:15,958 - lava_callback - INFO - Starting async job submit for node 69b13c70a870a1dc3343c5dd 2026-03-11 09:59:15,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:16,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c70a870a1dc3343c5dd HTTP/1.1" 200 None 2026-03-11 09:59:16,003 - lava_callback - DEBUG - Processing node 69b13c70a870a1dc3343c5dd: baseline-arm64 2026-03-11 09:59:16,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:16,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:16,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c70a870a1dc3343c5dd/log.txt.gz 2026-03-11 09:59:16,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:16,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:16,568 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c70a870a1dc3343c5dd/lava-logs.yaml 2026-03-11 09:59:16,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:16,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:16,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c70a870a1dc3343c5dd/lava_callback.json.gz 2026-03-11 09:59:16,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:16,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c70a870a1dc3343c5dd HTTP/1.1" 200 None 2026-03-11 09:59:16,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:16,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:16,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:16,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c70a870a1dc3343c5dd HTTP/1.1" 200 None 2026-03-11 09:59:16,836 - lava_callback - INFO - Completed processing callback for node 69b13c70a870a1dc3343c5dd 2026-03-11 09:59:18,699 - lava_callback - INFO - Received callback for node 69b13c74a870a1dc3343c5e6 INFO: 172.21.0.1:49912 - "POST /node/69b13c74a870a1dc3343c5e6 HTTP/1.0" 202 Accepted 2026-03-11 09:59:18,705 - lava_callback - INFO - Starting async job submit for node 69b13c74a870a1dc3343c5e6 2026-03-11 09:59:18,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:18,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c74a870a1dc3343c5e6 HTTP/1.1" 200 None 2026-03-11 09:59:18,741 - lava_callback - DEBUG - Processing node 69b13c74a870a1dc3343c5e6: baseline-arm64 2026-03-11 09:59:19,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:19,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:19,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c74a870a1dc3343c5e6/log.txt.gz 2026-03-11 09:59:19,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:19,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:19,664 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c74a870a1dc3343c5e6/lava-logs.yaml 2026-03-11 09:59:19,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:19,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:19,827 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c74a870a1dc3343c5e6/lava_callback.json.gz 2026-03-11 09:59:19,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:19,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c74a870a1dc3343c5e6 HTTP/1.1" 200 None 2026-03-11 09:59:19,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:19,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:19,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:19,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c74a870a1dc3343c5e6 HTTP/1.1" 200 None 2026-03-11 09:59:19,905 - lava_callback - INFO - Completed processing callback for node 69b13c74a870a1dc3343c5e6 2026-03-11 09:59:21,631 - lava_callback - INFO - Received callback for node 69b13c99a870a1dc3343c654 INFO: 172.21.0.1:56696 - "POST /node/69b13c99a870a1dc3343c654 HTTP/1.0" 202 Accepted 2026-03-11 09:59:21,640 - lava_callback - INFO - Starting async job submit for node 69b13c99a870a1dc3343c654 2026-03-11 09:59:21,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:21,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c99a870a1dc3343c654 HTTP/1.1" 200 None 2026-03-11 09:59:21,678 - lava_callback - DEBUG - Processing node 69b13c99a870a1dc3343c654: baseline-arm64-broonie 2026-03-11 09:59:21,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:22,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:22,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c99a870a1dc3343c654/log.txt.gz 2026-03-11 09:59:22,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:22,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:22,341 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c99a870a1dc3343c654/lava-logs.yaml 2026-03-11 09:59:22,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:22,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:22,477 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c99a870a1dc3343c654/lava_callback.json.gz 2026-03-11 09:59:22,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:22,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c99a870a1dc3343c654 HTTP/1.1" 200 None 2026-03-11 09:59:22,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:22,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:22,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:22,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c99a870a1dc3343c654 HTTP/1.1" 200 None 2026-03-11 09:59:22,557 - lava_callback - INFO - Completed processing callback for node 69b13c99a870a1dc3343c654 2026-03-11 09:59:24,086 - lava_callback - INFO - Received callback for node 69b13c75a870a1dc3343c5e9 INFO: 172.21.0.1:56710 - "POST /node/69b13c75a870a1dc3343c5e9 HTTP/1.0" 202 Accepted 2026-03-11 09:59:24,092 - lava_callback - INFO - Starting async job submit for node 69b13c75a870a1dc3343c5e9 2026-03-11 09:59:24,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:24,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c75a870a1dc3343c5e9 HTTP/1.1" 200 None 2026-03-11 09:59:24,128 - lava_callback - DEBUG - Processing node 69b13c75a870a1dc3343c5e9: baseline-arm64 2026-03-11 09:59:24,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:24,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:24,601 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c75a870a1dc3343c5e9/log.txt.gz 2026-03-11 09:59:24,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:25,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:25,036 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c75a870a1dc3343c5e9/lava-logs.yaml 2026-03-11 09:59:25,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:25,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:25,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c75a870a1dc3343c5e9/lava_callback.json.gz 2026-03-11 09:59:25,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:25,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c75a870a1dc3343c5e9 HTTP/1.1" 200 None 2026-03-11 09:59:25,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:25,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:25,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:25,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c75a870a1dc3343c5e9 HTTP/1.1" 200 None 2026-03-11 09:59:25,272 - lava_callback - INFO - Completed processing callback for node 69b13c75a870a1dc3343c5e9 2026-03-11 09:59:25,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:25,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:56712 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:31,065 - lava_callback - INFO - Received callback for node 69b13ceba870a1dc3343c6e8 INFO: 172.21.0.1:44682 - "POST /node/69b13ceba870a1dc3343c6e8 HTTP/1.0" 202 Accepted 2026-03-11 09:59:31,070 - lava_callback - INFO - Starting async job submit for node 69b13ceba870a1dc3343c6e8 2026-03-11 09:59:31,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:31,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ceba870a1dc3343c6e8 HTTP/1.1" 200 None 2026-03-11 09:59:31,088 - lava_callback - DEBUG - Processing node 69b13ceba870a1dc3343c6e8: baseline-nfs-arm64 2026-03-11 09:59:31,089 - lava_callback - WARNING - Failed to upload log 2026-03-11 09:59:31,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:31,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:31,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13ceba870a1dc3343c6e8/lava-logs.yaml 2026-03-11 09:59:31,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:31,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:31,332 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13ceba870a1dc3343c6e8/lava_callback.json.gz 2026-03-11 09:59:31,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:31,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ceba870a1dc3343c6e8 HTTP/1.1" 200 None 2026-03-11 09:59:31,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:31,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:31,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:31,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ceba870a1dc3343c6e8 HTTP/1.1" 200 None 2026-03-11 09:59:31,413 - lava_callback - INFO - Completed processing callback for node 69b13ceba870a1dc3343c6e8 INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:40,754 - lava_callback - INFO - Received callback for node 69b13cb3a870a1dc3343c6b8 INFO: 172.21.0.1:34522 - "POST /node/69b13cb3a870a1dc3343c6b8 HTTP/1.0" 202 Accepted 2026-03-11 09:59:40,760 - lava_callback - INFO - Starting async job submit for node 69b13cb3a870a1dc3343c6b8 2026-03-11 09:59:40,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:40,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb3a870a1dc3343c6b8 HTTP/1.1" 200 None 2026-03-11 09:59:40,796 - lava_callback - DEBUG - Processing node 69b13cb3a870a1dc3343c6b8: baseline-arm64-pengutronix 2026-03-11 09:59:40,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:41,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:41,135 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb3a870a1dc3343c6b8/log.txt.gz 2026-03-11 09:59:41,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:41,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:41,467 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb3a870a1dc3343c6b8/lava-logs.yaml 2026-03-11 09:59:41,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:41,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:41,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb3a870a1dc3343c6b8/lava_callback.json.gz 2026-03-11 09:59:41,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:41,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb3a870a1dc3343c6b8 HTTP/1.1" 200 None 2026-03-11 09:59:41,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:41,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:41,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:41,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cb3a870a1dc3343c6b8 HTTP/1.1" 200 None 2026-03-11 09:59:41,719 - lava_callback - INFO - Completed processing callback for node 69b13cb3a870a1dc3343c6b8 2026-03-11 09:59:45,702 - lava_callback - INFO - Received callback for node 69b13c7da870a1dc3343c5fb INFO: 172.21.0.1:34532 - "POST /node/69b13c7da870a1dc3343c5fb HTTP/1.0" 202 Accepted 2026-03-11 09:59:45,708 - lava_callback - INFO - Starting async job submit for node 69b13c7da870a1dc3343c5fb 2026-03-11 09:59:45,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:45,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7da870a1dc3343c5fb HTTP/1.1" 200 None 2026-03-11 09:59:45,744 - lava_callback - DEBUG - Processing node 69b13c7da870a1dc3343c5fb: baseline-arm64 2026-03-11 09:59:45,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:46,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:46,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7da870a1dc3343c5fb/log.txt.gz 2026-03-11 09:59:46,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:46,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:46,445 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7da870a1dc3343c5fb/lava-logs.yaml 2026-03-11 09:59:46,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34548 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:46,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:46,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7da870a1dc3343c5fb/lava_callback.json.gz 2026-03-11 09:59:46,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:46,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7da870a1dc3343c5fb HTTP/1.1" 200 None 2026-03-11 09:59:46,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:46,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:46,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:46,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c7da870a1dc3343c5fb HTTP/1.1" 200 None 2026-03-11 09:59:46,664 - lava_callback - INFO - Completed processing callback for node 69b13c7da870a1dc3343c5fb 2026-03-11 09:59:51,570 - lava_callback - INFO - Received callback for node 69b13c86a870a1dc3343c611 INFO: 172.21.0.1:38684 - "POST /node/69b13c86a870a1dc3343c611 HTTP/1.0" 202 Accepted 2026-03-11 09:59:51,577 - lava_callback - INFO - Starting async job submit for node 69b13c86a870a1dc3343c611 2026-03-11 09:59:51,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:51,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c86a870a1dc3343c611 HTTP/1.1" 200 None 2026-03-11 09:59:51,630 - lava_callback - DEBUG - Processing node 69b13c86a870a1dc3343c611: baseline-nfs-arm64 2026-03-11 09:59:52,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:52,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:52,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c86a870a1dc3343c611/log.txt.gz 2026-03-11 09:59:52,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:52,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:52,645 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c86a870a1dc3343c611/lava-logs.yaml 2026-03-11 09:59:52,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:52,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:52,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c86a870a1dc3343c611/lava_callback.json.gz 2026-03-11 09:59:52,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:52,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c86a870a1dc3343c611 HTTP/1.1" 200 None 2026-03-11 09:59:52,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:52,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:52,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:52,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c86a870a1dc3343c611 HTTP/1.1" 200 None 2026-03-11 09:59:52,889 - lava_callback - INFO - Completed processing callback for node 69b13c86a870a1dc3343c611 2026-03-11 09:59:54,906 - lava_callback - INFO - Received callback for node 69b13c7ea870a1dc3343c5fe INFO: 172.21.0.1:38686 - "POST /node/69b13c7ea870a1dc3343c5fe HTTP/1.0" 202 Accepted 2026-03-11 09:59:54,912 - lava_callback - INFO - Starting async job submit for node 69b13c7ea870a1dc3343c5fe 2026-03-11 09:59:54,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:54,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7ea870a1dc3343c5fe HTTP/1.1" 200 None 2026-03-11 09:59:54,952 - lava_callback - DEBUG - Processing node 69b13c7ea870a1dc3343c5fe: baseline-arm64 2026-03-11 09:59:55,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:55,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:55,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-11 09:59:55,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:55,384 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ea870a1dc3343c5fe/log.txt.gz 2026-03-11 09:59:55,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:55,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:55,798 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ea870a1dc3343c5fe/lava-logs.yaml 2026-03-11 09:59:55,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:55,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:55,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ea870a1dc3343c5fe/lava_callback.json.gz 2026-03-11 09:59:55,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:55,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7ea870a1dc3343c5fe HTTP/1.1" 200 None 2026-03-11 09:59:55,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:55,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:55,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:56,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c7ea870a1dc3343c5fe HTTP/1.1" 200 None 2026-03-11 09:59:56,020 - lava_callback - INFO - Completed processing callback for node 69b13c7ea870a1dc3343c5fe INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:56,669 - lava_callback - INFO - Received callback for node 69b13c87a870a1dc3343c614 INFO: 172.21.0.1:38702 - "POST /node/69b13c87a870a1dc3343c614 HTTP/1.0" 202 Accepted 2026-03-11 09:59:56,676 - lava_callback - INFO - Starting async job submit for node 69b13c87a870a1dc3343c614 2026-03-11 09:59:56,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:56,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c87a870a1dc3343c614 HTTP/1.1" 200 None 2026-03-11 09:59:56,715 - lava_callback - DEBUG - Processing node 69b13c87a870a1dc3343c614: baseline-nfs-arm64 2026-03-11 09:59:57,199 - lava_callback - INFO - Received callback for node 69b13c73a870a1dc3343c5e3 INFO: 172.21.0.1:38708 - "POST /node/69b13c73a870a1dc3343c5e3 HTTP/1.0" 202 Accepted 2026-03-11 09:59:57,205 - lava_callback - INFO - Starting async job submit for node 69b13c73a870a1dc3343c5e3 2026-03-11 09:59:57,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:57,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:57,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c73a870a1dc3343c5e3 HTTP/1.1" 200 None 2026-03-11 09:59:57,244 - lava_callback - DEBUG - Processing node 69b13c73a870a1dc3343c5e3: baseline-arm64 2026-03-11 09:59:57,299 - lava_callback - INFO - Received callback for node 69b13cb1a870a1dc3343c6b2 2026-03-11 09:59:57,315 - lava_callback - INFO - Starting async job submit for node 69b13cb1a870a1dc3343c6b2 INFO: 172.21.0.1:38716 - "POST /node/69b13cb1a870a1dc3343c6b2 HTTP/1.0" 202 Accepted 2026-03-11 09:59:57,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:57,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:57,446 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c87a870a1dc3343c614/log.txt.gz 2026-03-11 09:59:57,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb1a870a1dc3343c6b2 HTTP/1.1" 200 None 2026-03-11 09:59:57,495 - lava_callback - DEBUG - Processing node 69b13cb1a870a1dc3343c6b2: baseline-arm64-pengutronix 2026-03-11 09:59:57,510 - lava_callback - INFO - Received callback for node 69b13900a870a1dc3343c547 2026-03-11 09:59:57,538 - lava_callback - INFO - Starting async job submit for node 69b13900a870a1dc3343c547 INFO: 172.21.0.1:38732 - "POST /node/69b13900a870a1dc3343c547 HTTP/1.0" 202 Accepted 2026-03-11 09:59:57,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:58,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13900a870a1dc3343c547 HTTP/1.1" 200 None 2026-03-11 09:59:58,138 - lava_callback - DEBUG - Processing node 69b13900a870a1dc3343c547: ltp-smoke 2026-03-11 09:59:58,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:58,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:58,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb1a870a1dc3343c6b2/log.txt.gz 2026-03-11 09:59:58,535 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c73a870a1dc3343c5e3/log.txt.gz 2026-03-11 09:59:58,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:58,801 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c87a870a1dc3343c614/lava-logs.yaml 2026-03-11 09:59:58,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:59,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb1a870a1dc3343c6b2/lava-logs.yaml 2026-03-11 09:59:59,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:59,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,202 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b13900a870a1dc3343c547/log.txt.gz 2026-03-11 09:59:59,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c73a870a1dc3343c5e3/lava-logs.yaml 2026-03-11 09:59:59,319 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c87a870a1dc3343c614/lava_callback.json.gz 2026-03-11 09:59:59,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,422 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb1a870a1dc3343c6b2/lava_callback.json.gz 2026-03-11 09:59:59,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:59,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c87a870a1dc3343c614 HTTP/1.1" 200 None 2026-03-11 09:59:59,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb1a870a1dc3343c6b2 HTTP/1.1" 200 None 2026-03-11 09:59:59,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:59,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:59,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:59,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c87a870a1dc3343c614 HTTP/1.1" 200 None 2026-03-11 09:59:59,667 - lava_callback - INFO - Completed processing callback for node 69b13c87a870a1dc3343c614 2026-03-11 09:59:59,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cb1a870a1dc3343c6b2 HTTP/1.1" 200 None 2026-03-11 09:59:59,730 - lava_callback - INFO - Completed processing callback for node 69b13cb1a870a1dc3343c6b2 2026-03-11 09:59:59,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c73a870a1dc3343c5e3/lava_callback.json.gz 2026-03-11 09:59:59,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c73a870a1dc3343c5e3 HTTP/1.1" 200 None 2026-03-11 09:59:59,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:59,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c73a870a1dc3343c5e3 HTTP/1.1" 200 None 2026-03-11 09:59:59,902 - lava_callback - INFO - Completed processing callback for node 69b13c73a870a1dc3343c5e3 2026-03-11 09:59:59,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,951 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b13900a870a1dc3343c547/lava-logs.yaml 2026-03-11 09:59:59,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:00,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:00,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b13900a870a1dc3343c547/lava_callback.json.gz 2026-03-11 10:00:00,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:00,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13900a870a1dc3343c547 HTTP/1.1" 200 None 2026-03-11 10:00:00,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:00,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12599a870a1dc3343ba8b HTTP/1.1" 200 None 2026-03-11 10:00:00,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:00,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13900a870a1dc3343c547 HTTP/1.1" 200 None 2026-03-11 10:00:00,524 - lava_callback - INFO - Completed processing callback for node 69b13900a870a1dc3343c547 2026-03-11 10:00:00,828 - lava_callback - INFO - Received callback for node 69b13ca7a870a1dc3343c67d INFO: 172.21.0.1:51016 - "POST /node/69b13ca7a870a1dc3343c67d HTTP/1.0" 202 Accepted 2026-03-11 10:00:00,834 - lava_callback - INFO - Starting async job submit for node 69b13ca7a870a1dc3343c67d 2026-03-11 10:00:00,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:00,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca7a870a1dc3343c67d HTTP/1.1" 200 None 2026-03-11 10:00:00,888 - lava_callback - DEBUG - Processing node 69b13ca7a870a1dc3343c67d: baseline-arm64-broonie 2026-03-11 10:00:01,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:01,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:01,235 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca7a870a1dc3343c67d/log.txt.gz 2026-03-11 10:00:01,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:01,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:01,581 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca7a870a1dc3343c67d/lava-logs.yaml 2026-03-11 10:00:01,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:01,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:01,740 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca7a870a1dc3343c67d/lava_callback.json.gz 2026-03-11 10:00:01,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:01,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca7a870a1dc3343c67d HTTP/1.1" 200 None 2026-03-11 10:00:01,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:01,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:01,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:01,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca7a870a1dc3343c67d HTTP/1.1" 200 None 2026-03-11 10:00:01,835 - lava_callback - INFO - Completed processing callback for node 69b13ca7a870a1dc3343c67d 2026-03-11 10:00:02,297 - lava_callback - INFO - Received callback for node 69b13ca3a870a1dc3343c671 INFO: 172.21.0.1:51026 - "POST /node/69b13ca3a870a1dc3343c671 HTTP/1.0" 202 Accepted 2026-03-11 10:00:02,303 - lava_callback - INFO - Starting async job submit for node 69b13ca3a870a1dc3343c671 2026-03-11 10:00:02,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:02,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca3a870a1dc3343c671 HTTP/1.1" 200 None 2026-03-11 10:00:02,349 - lava_callback - DEBUG - Processing node 69b13ca3a870a1dc3343c671: baseline-arm64-broonie 2026-03-11 10:00:02,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:02,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:02,749 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca3a870a1dc3343c671/log.txt.gz 2026-03-11 10:00:02,857 - lava_callback - INFO - Received callback for node 69b13cada870a1dc3343c6a9 INFO: 172.21.0.1:51042 - "POST /node/69b13cada870a1dc3343c6a9 HTTP/1.0" 202 Accepted 2026-03-11 10:00:02,881 - lava_callback - INFO - Starting async job submit for node 69b13cada870a1dc3343c6a9 2026-03-11 10:00:02,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:02,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:02,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cada870a1dc3343c6a9 HTTP/1.1" 200 None 2026-03-11 10:00:02,956 - lava_callback - DEBUG - Processing node 69b13cada870a1dc3343c6a9: baseline-arm64-clabbe 2026-03-11 10:00:03,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:03,215 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca3a870a1dc3343c671/lava-logs.yaml 2026-03-11 10:00:03,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:03,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:03,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:03,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:03,440 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca3a870a1dc3343c671/lava_callback.json.gz 2026-03-11 10:00:03,460 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b13cada870a1dc3343c6a9/log.txt.gz 2026-03-11 10:00:03,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:03,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca3a870a1dc3343c671 HTTP/1.1" 200 None 2026-03-11 10:00:03,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:03,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:03,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:03,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:03,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca3a870a1dc3343c671 HTTP/1.1" 200 None 2026-03-11 10:00:03,664 - lava_callback - INFO - Completed processing callback for node 69b13ca3a870a1dc3343c671 2026-03-11 10:00:03,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:03,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b13cada870a1dc3343c6a9/lava-logs.yaml 2026-03-11 10:00:03,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:04,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:04,006 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b13cada870a1dc3343c6a9/lava_callback.json.gz 2026-03-11 10:00:04,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:04,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cada870a1dc3343c6a9 HTTP/1.1" 200 None 2026-03-11 10:00:04,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:04,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:04,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:04,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cada870a1dc3343c6a9 HTTP/1.1" 200 None 2026-03-11 10:00:04,096 - lava_callback - INFO - Completed processing callback for node 69b13cada870a1dc3343c6a9 2026-03-11 10:00:05,498 - lava_callback - INFO - Received callback for node 69b13c7ca870a1dc3343c5f8 INFO: 172.21.0.1:51058 - "POST /node/69b13c7ca870a1dc3343c5f8 HTTP/1.0" 202 Accepted 2026-03-11 10:00:05,504 - lava_callback - INFO - Starting async job submit for node 69b13c7ca870a1dc3343c5f8 2026-03-11 10:00:05,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:05,529 - lava_callback - INFO - Received callback for node 69b13cb2a870a1dc3343c6b5 INFO: 172.21.0.1:51064 - "POST /node/69b13cb2a870a1dc3343c6b5 HTTP/1.0" 202 Accepted 2026-03-11 10:00:05,535 - lava_callback - INFO - Starting async job submit for node 69b13cb2a870a1dc3343c6b5 2026-03-11 10:00:05,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:05,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb2a870a1dc3343c6b5 HTTP/1.1" 200 None 2026-03-11 10:00:05,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7ca870a1dc3343c5f8 HTTP/1.1" 200 None 2026-03-11 10:00:05,573 - lava_callback - DEBUG - Processing node 69b13cb2a870a1dc3343c6b5: baseline-arm64-pengutronix 2026-03-11 10:00:05,580 - lava_callback - DEBUG - Processing node 69b13c7ca870a1dc3343c5f8: baseline-arm64 2026-03-11 10:00:06,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:06,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:06,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:06,313 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ca870a1dc3343c5f8/log.txt.gz 2026-03-11 10:00:06,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:06,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb2a870a1dc3343c6b5/log.txt.gz INFO: 172.21.0.1:51072 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:06,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:06,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:06,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:06,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb2a870a1dc3343c6b5/lava-logs.yaml 2026-03-11 10:00:06,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:06,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:06,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ca870a1dc3343c5f8/lava-logs.yaml 2026-03-11 10:00:06,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:07,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:07,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb2a870a1dc3343c6b5/lava_callback.json.gz 2026-03-11 10:00:07,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb2a870a1dc3343c6b5 HTTP/1.1" 200 None 2026-03-11 10:00:07,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:07,088 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ca870a1dc3343c5f8/lava_callback.json.gz 2026-03-11 10:00:07,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:07,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7ca870a1dc3343c5f8 HTTP/1.1" 200 None 2026-03-11 10:00:07,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cb2a870a1dc3343c6b5 HTTP/1.1" 200 None 2026-03-11 10:00:07,146 - lava_callback - INFO - Completed processing callback for node 69b13cb2a870a1dc3343c6b5 2026-03-11 10:00:07,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:07,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c7ca870a1dc3343c5f8 HTTP/1.1" 200 None 2026-03-11 10:00:07,221 - lava_callback - INFO - Completed processing callback for node 69b13c7ca870a1dc3343c5f8 INFO: 172.21.0.1:40900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:18,264 - lava_callback - INFO - Received callback for node 69b13ca1a870a1dc3343c668 INFO: 172.21.0.1:40916 - "POST /node/69b13ca1a870a1dc3343c668 HTTP/1.0" 202 Accepted 2026-03-11 10:00:18,269 - lava_callback - INFO - Starting async job submit for node 69b13ca1a870a1dc3343c668 2026-03-11 10:00:18,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:18,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca1a870a1dc3343c668 HTTP/1.1" 200 None 2026-03-11 10:00:18,331 - lava_callback - DEBUG - Processing node 69b13ca1a870a1dc3343c668: baseline-arm64-broonie 2026-03-11 10:00:18,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:18,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:18,713 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca1a870a1dc3343c668/log.txt.gz 2026-03-11 10:00:18,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:19,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:19,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca1a870a1dc3343c668/lava-logs.yaml 2026-03-11 10:00:19,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:19,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:19,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca1a870a1dc3343c668/lava_callback.json.gz 2026-03-11 10:00:19,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:19,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca1a870a1dc3343c668 HTTP/1.1" 200 None 2026-03-11 10:00:19,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:19,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:19,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:19,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca1a870a1dc3343c668 HTTP/1.1" 200 None 2026-03-11 10:00:19,332 - lava_callback - INFO - Completed processing callback for node 69b13ca1a870a1dc3343c668 2026-03-11 10:00:21,808 - lava_callback - INFO - Received callback for node 69b13c84a870a1dc3343c60b INFO: 172.21.0.1:58728 - "POST /node/69b13c84a870a1dc3343c60b HTTP/1.0" 202 Accepted 2026-03-11 10:00:21,815 - lava_callback - INFO - Starting async job submit for node 69b13c84a870a1dc3343c60b 2026-03-11 10:00:21,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:21,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c84a870a1dc3343c60b HTTP/1.1" 200 None 2026-03-11 10:00:21,853 - lava_callback - DEBUG - Processing node 69b13c84a870a1dc3343c60b: baseline-nfs-arm64 2026-03-11 10:00:22,096 - lava_callback - INFO - Received callback for node 69b13c8ca870a1dc3343c624 INFO: 172.21.0.1:58732 - "POST /node/69b13c8ca870a1dc3343c624 HTTP/1.0" 202 Accepted 2026-03-11 10:00:22,118 - lava_callback - INFO - Starting async job submit for node 69b13c8ca870a1dc3343c624 2026-03-11 10:00:22,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:22,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:22,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ca870a1dc3343c624 HTTP/1.1" 200 None 2026-03-11 10:00:22,243 - lava_callback - DEBUG - Processing node 69b13c8ca870a1dc3343c624: baseline-nfs-arm64 2026-03-11 10:00:22,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:22,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c84a870a1dc3343c60b/log.txt.gz 2026-03-11 10:00:22,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:22,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:22,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:22,909 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ca870a1dc3343c624/log.txt.gz 2026-03-11 10:00:23,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:23,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c84a870a1dc3343c60b/lava-logs.yaml 2026-03-11 10:00:23,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:23,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:23,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:23,335 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c84a870a1dc3343c60b/lava_callback.json.gz 2026-03-11 10:00:23,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:23,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,362 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ca870a1dc3343c624/lava-logs.yaml 2026-03-11 10:00:23,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:23,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c84a870a1dc3343c60b HTTP/1.1" 200 None 2026-03-11 10:00:23,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:23,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c84a870a1dc3343c60b HTTP/1.1" 200 None 2026-03-11 10:00:23,428 - lava_callback - INFO - Completed processing callback for node 69b13c84a870a1dc3343c60b 2026-03-11 10:00:23,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:23,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ca870a1dc3343c624/lava_callback.json.gz 2026-03-11 10:00:23,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ca870a1dc3343c624 HTTP/1.1" 200 None 2026-03-11 10:00:23,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:23,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c8ca870a1dc3343c624 HTTP/1.1" 200 None 2026-03-11 10:00:23,712 - lava_callback - INFO - Completed processing callback for node 69b13c8ca870a1dc3343c624 2026-03-11 10:00:25,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:25,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-11 10:00:25,629 - lava_callback - INFO - Received callback for node 69b13c77a870a1dc3343c5ec INFO: 172.21.0.1:58738 - "POST /node/69b13c77a870a1dc3343c5ec HTTP/1.0" 202 Accepted 2026-03-11 10:00:25,636 - lava_callback - INFO - Starting async job submit for node 69b13c77a870a1dc3343c5ec 2026-03-11 10:00:25,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:25,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c77a870a1dc3343c5ec HTTP/1.1" 200 None 2026-03-11 10:00:25,679 - lava_callback - DEBUG - Processing node 69b13c77a870a1dc3343c5ec: baseline-arm64 2026-03-11 10:00:26,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:26,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:26,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c77a870a1dc3343c5ec/log.txt.gz INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:26,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:26,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:26,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c77a870a1dc3343c5ec/lava-logs.yaml 2026-03-11 10:00:26,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:26,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:26,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c77a870a1dc3343c5ec/lava_callback.json.gz 2026-03-11 10:00:26,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:26,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c77a870a1dc3343c5ec HTTP/1.1" 200 None 2026-03-11 10:00:26,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:26,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:26,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:27,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c77a870a1dc3343c5ec HTTP/1.1" 200 None 2026-03-11 10:00:27,056 - lava_callback - INFO - Completed processing callback for node 69b13c77a870a1dc3343c5ec INFO: 172.21.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:36,647 - lava_callback - INFO - Received callback for node 69b13c7aa870a1dc3343c5f5 INFO: 172.21.0.1:38712 - "POST /node/69b13c7aa870a1dc3343c5f5 HTTP/1.0" 202 Accepted 2026-03-11 10:00:36,653 - lava_callback - INFO - Starting async job submit for node 69b13c7aa870a1dc3343c5f5 2026-03-11 10:00:36,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:36,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7aa870a1dc3343c5f5 HTTP/1.1" 200 None 2026-03-11 10:00:36,688 - lava_callback - DEBUG - Processing node 69b13c7aa870a1dc3343c5f5: baseline-arm64 2026-03-11 10:00:36,724 - lava_callback - INFO - Received callback for node 69b13c9ba870a1dc3343c657 INFO: 172.21.0.1:38728 - "POST /node/69b13c9ba870a1dc3343c657 HTTP/1.0" 202 Accepted 2026-03-11 10:00:36,750 - lava_callback - INFO - Starting async job submit for node 69b13c9ba870a1dc3343c657 2026-03-11 10:00:36,823 - lava_callback - INFO - Received callback for node 69b13c8fa870a1dc3343c644 2026-03-11 10:00:36,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:38740 - "POST /node/69b13c8fa870a1dc3343c644 HTTP/1.0" 202 Accepted 2026-03-11 10:00:36,863 - lava_callback - INFO - Starting async job submit for node 69b13c8fa870a1dc3343c644 2026-03-11 10:00:36,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:36,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9ba870a1dc3343c657 HTTP/1.1" 200 None 2026-03-11 10:00:36,940 - lava_callback - DEBUG - Processing node 69b13c9ba870a1dc3343c657: baseline-arm64-broonie 2026-03-11 10:00:37,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:37,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8fa870a1dc3343c644 HTTP/1.1" 200 None 2026-03-11 10:00:37,564 - lava_callback - DEBUG - Processing node 69b13c8fa870a1dc3343c644: baseline-nfs-arm64 2026-03-11 10:00:37,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:37,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:38,016 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ba870a1dc3343c657/log.txt.gz 2026-03-11 10:00:38,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:38,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7aa870a1dc3343c5f5/log.txt.gz 2026-03-11 10:00:38,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:38,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:38,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:38,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8fa870a1dc3343c644/log.txt.gz 2026-03-11 10:00:38,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:38,783 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ba870a1dc3343c657/lava-logs.yaml 2026-03-11 10:00:38,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:38,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:38,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:39,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:39,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ba870a1dc3343c657/lava_callback.json.gz 2026-03-11 10:00:39,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:39,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,139 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7aa870a1dc3343c5f5/lava-logs.yaml 2026-03-11 10:00:39,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:39,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9ba870a1dc3343c657 HTTP/1.1" 200 None 2026-03-11 10:00:39,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:39,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c9ba870a1dc3343c657 HTTP/1.1" 200 None 2026-03-11 10:00:39,204 - lava_callback - INFO - Completed processing callback for node 69b13c9ba870a1dc3343c657 2026-03-11 10:00:39,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:39,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8fa870a1dc3343c644/lava-logs.yaml 2026-03-11 10:00:39,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:39,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:39,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7aa870a1dc3343c5f5/lava_callback.json.gz 2026-03-11 10:00:39,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7aa870a1dc3343c5f5 HTTP/1.1" 200 None 2026-03-11 10:00:39,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:39,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c7aa870a1dc3343c5f5 HTTP/1.1" 200 None 2026-03-11 10:00:39,529 - lava_callback - INFO - Completed processing callback for node 69b13c7aa870a1dc3343c5f5 2026-03-11 10:00:39,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:39,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8fa870a1dc3343c644/lava_callback.json.gz 2026-03-11 10:00:39,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8fa870a1dc3343c644 HTTP/1.1" 200 None 2026-03-11 10:00:39,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:39,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c8fa870a1dc3343c644 HTTP/1.1" 200 None 2026-03-11 10:00:39,726 - lava_callback - INFO - Completed processing callback for node 69b13c8fa870a1dc3343c644 INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:55,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:55,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:58,079 - lava_callback - INFO - Received callback for node 69b13c8ea870a1dc3343c641 INFO: 172.21.0.1:45076 - "POST /node/69b13c8ea870a1dc3343c641 HTTP/1.0" 202 Accepted 2026-03-11 10:00:58,085 - lava_callback - INFO - Starting async job submit for node 69b13c8ea870a1dc3343c641 2026-03-11 10:00:58,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:58,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ea870a1dc3343c641 HTTP/1.1" 200 None 2026-03-11 10:00:58,130 - lava_callback - DEBUG - Processing node 69b13c8ea870a1dc3343c641: baseline-nfs-arm64 2026-03-11 10:00:58,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:58,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:58,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ea870a1dc3343c641/log.txt.gz 2026-03-11 10:00:58,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:59,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:59,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ea870a1dc3343c641/lava-logs.yaml 2026-03-11 10:00:59,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:59,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:59,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ea870a1dc3343c641/lava_callback.json.gz 2026-03-11 10:00:59,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:59,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ea870a1dc3343c641 HTTP/1.1" 200 None 2026-03-11 10:00:59,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:59,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:59,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:59,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c8ea870a1dc3343c641 HTTP/1.1" 200 None 2026-03-11 10:00:59,273 - lava_callback - INFO - Completed processing callback for node 69b13c8ea870a1dc3343c641 INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51132 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:01:21,985 - lava_callback - INFO - Received callback for node 69b13c9da870a1dc3343c65d INFO: 172.21.0.1:32976 - "POST /node/69b13c9da870a1dc3343c65d HTTP/1.0" 202 Accepted 2026-03-11 10:01:21,991 - lava_callback - INFO - Starting async job submit for node 69b13c9da870a1dc3343c65d 2026-03-11 10:01:22,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:22,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9da870a1dc3343c65d HTTP/1.1" 200 None 2026-03-11 10:01:22,028 - lava_callback - DEBUG - Processing node 69b13c9da870a1dc3343c65d: baseline-arm64-broonie 2026-03-11 10:01:22,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:22,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:22,445 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9da870a1dc3343c65d/log.txt.gz 2026-03-11 10:01:22,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:22,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:22,831 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9da870a1dc3343c65d/lava-logs.yaml 2026-03-11 10:01:22,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:22,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:22,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9da870a1dc3343c65d/lava_callback.json.gz 2026-03-11 10:01:22,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:23,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9da870a1dc3343c65d HTTP/1.1" 200 None 2026-03-11 10:01:23,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:23,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:01:23,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:23,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c9da870a1dc3343c65d HTTP/1.1" 200 None 2026-03-11 10:01:23,062 - lava_callback - INFO - Completed processing callback for node 69b13c9da870a1dc3343c65d 2026-03-11 10:01:23,421 - lava_callback - INFO - Received callback for node 69b13c9fa870a1dc3343c662 INFO: 172.21.0.1:32988 - "POST /node/69b13c9fa870a1dc3343c662 HTTP/1.0" 202 Accepted 2026-03-11 10:01:23,429 - lava_callback - INFO - Starting async job submit for node 69b13c9fa870a1dc3343c662 2026-03-11 10:01:23,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:23,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9fa870a1dc3343c662 HTTP/1.1" 200 None 2026-03-11 10:01:23,469 - lava_callback - DEBUG - Processing node 69b13c9fa870a1dc3343c662: baseline-arm64-broonie 2026-03-11 10:01:23,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:23,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:23,890 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9fa870a1dc3343c662/log.txt.gz 2026-03-11 10:01:24,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:24,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:24,308 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9fa870a1dc3343c662/lava-logs.yaml 2026-03-11 10:01:24,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:24,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:24,475 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9fa870a1dc3343c662/lava_callback.json.gz 2026-03-11 10:01:24,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:24,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9fa870a1dc3343c662 HTTP/1.1" 200 None 2026-03-11 10:01:24,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:24,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:01:24,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:24,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c9fa870a1dc3343c662 HTTP/1.1" 200 None 2026-03-11 10:01:24,555 - lava_callback - INFO - Completed processing callback for node 69b13c9fa870a1dc3343c662 2026-03-11 10:01:24,858 - lava_callback - INFO - Received callback for node 69b13ca5a870a1dc3343c67a INFO: 172.21.0.1:32996 - "POST /node/69b13ca5a870a1dc3343c67a HTTP/1.0" 202 Accepted 2026-03-11 10:01:24,864 - lava_callback - INFO - Starting async job submit for node 69b13ca5a870a1dc3343c67a 2026-03-11 10:01:24,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:24,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca5a870a1dc3343c67a HTTP/1.1" 200 None 2026-03-11 10:01:24,911 - lava_callback - DEBUG - Processing node 69b13ca5a870a1dc3343c67a: baseline-arm64-broonie 2026-03-11 10:01:25,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:25,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:25,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca5a870a1dc3343c67a/log.txt.gz 2026-03-11 10:01:25,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:25,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:25,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 10:01:25,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:25,675 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca5a870a1dc3343c67a/lava-logs.yaml 2026-03-11 10:01:25,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:25,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:25,823 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca5a870a1dc3343c67a/lava_callback.json.gz 2026-03-11 10:01:25,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:25,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca5a870a1dc3343c67a HTTP/1.1" 200 None 2026-03-11 10:01:25,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:25,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:01:25,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:25,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca5a870a1dc3343c67a HTTP/1.1" 200 None 2026-03-11 10:01:25,903 - lava_callback - INFO - Completed processing callback for node 69b13ca5a870a1dc3343c67a INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:01:55,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:55,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:02:18,649 - lava_callback - INFO - Received callback for node 69b13d7da870a1dc3343c7cc INFO: 172.21.0.1:45792 - "POST /node/69b13d7da870a1dc3343c7cc HTTP/1.0" 202 Accepted 2026-03-11 10:02:18,656 - lava_callback - INFO - Starting async job submit for node 69b13d7da870a1dc3343c7cc 2026-03-11 10:02:18,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:02:18,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13d7da870a1dc3343c7cc HTTP/1.1" 200 None 2026-03-11 10:02:18,700 - lava_callback - DEBUG - Processing node 69b13d7da870a1dc3343c7cc: baseline-arm64 2026-03-11 10:02:18,839 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:02:18,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:02:19,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:02:19,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13d7da870a1dc3343c7cc/lava-logs.yaml 2026-03-11 10:02:19,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:02:19,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:02:19,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13d7da870a1dc3343c7cc/lava_callback.json.gz 2026-03-11 10:02:19,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:02:19,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13d7da870a1dc3343c7cc HTTP/1.1" 200 None 2026-03-11 10:02:19,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:02:19,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:02:19,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:02:19,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13d7da870a1dc3343c7cc HTTP/1.1" 200 None 2026-03-11 10:02:19,383 - lava_callback - INFO - Completed processing callback for node 69b13d7da870a1dc3343c7cc 2026-03-11 10:02:25,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:02:25,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:03:04,128 - lava_callback - INFO - Received callback for node 69ae9ad2c660ead8a389b9d2 INFO: 172.21.0.1:37638 - "POST /node/69ae9ad2c660ead8a389b9d2 HTTP/1.0" 202 Accepted 2026-03-11 10:03:04,133 - lava_callback - INFO - Starting async job submit for node 69ae9ad2c660ead8a389b9d2 2026-03-11 10:03:04,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:04,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9ad2c660ead8a389b9d2 HTTP/1.1" 200 None 2026-03-11 10:03:04,156 - lava_callback - DEBUG - Processing node 69ae9ad2c660ead8a389b9d2: baseline-arm64-clabbe 2026-03-11 10:03:04,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9ad2c660ead8a389b9d2 2026-03-11 10:03:04,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:04,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9ad2c660ead8a389b9d2 HTTP/1.1" 200 None 2026-03-11 10:03:04,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:04,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 10:03:04,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:04,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9ad2c660ead8a389b9d2 HTTP/1.1" 200 None 2026-03-11 10:03:04,215 - lava_callback - ERROR - Error processing callback for node 69ae9ad2c660ead8a389b9d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:03:04,383 - lava_callback - INFO - Received callback for node 69b13c8ba870a1dc3343c621 INFO: 172.21.0.1:37640 - "POST /node/69b13c8ba870a1dc3343c621 HTTP/1.0" 202 Accepted 2026-03-11 10:03:04,390 - lava_callback - INFO - Starting async job submit for node 69b13c8ba870a1dc3343c621 2026-03-11 10:03:04,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:04,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ba870a1dc3343c621 HTTP/1.1" 200 None 2026-03-11 10:03:04,433 - lava_callback - DEBUG - Processing node 69b13c8ba870a1dc3343c621: baseline-nfs-arm64 2026-03-11 10:03:05,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:05,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:05,359 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ba870a1dc3343c621/log.txt.gz 2026-03-11 10:03:05,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:06,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:06,064 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ba870a1dc3343c621/lava-logs.yaml 2026-03-11 10:03:06,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:06,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:06,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ba870a1dc3343c621/lava_callback.json.gz 2026-03-11 10:03:06,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:06,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ba870a1dc3343c621 HTTP/1.1" 200 None 2026-03-11 10:03:06,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:06,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:03:06,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:06,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c8ba870a1dc3343c621 HTTP/1.1" 200 None 2026-03-11 10:03:06,368 - lava_callback - INFO - Completed processing callback for node 69b13c8ba870a1dc3343c621 INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51510 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:03:21,765 - lava_callback - INFO - Received callback for node 69b13c9ca870a1dc3343c65a INFO: 172.21.0.1:56134 - "POST /node/69b13c9ca870a1dc3343c65a HTTP/1.0" 202 Accepted 2026-03-11 10:03:21,771 - lava_callback - INFO - Starting async job submit for node 69b13c9ca870a1dc3343c65a 2026-03-11 10:03:21,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:21,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9ca870a1dc3343c65a HTTP/1.1" 200 None 2026-03-11 10:03:21,804 - lava_callback - DEBUG - Processing node 69b13c9ca870a1dc3343c65a: baseline-arm64-broonie 2026-03-11 10:03:22,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:22,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:22,244 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ca870a1dc3343c65a/log.txt.gz 2026-03-11 10:03:22,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:22,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:22,655 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ca870a1dc3343c65a/lava-logs.yaml 2026-03-11 10:03:22,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:22,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:22,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ca870a1dc3343c65a/lava_callback.json.gz 2026-03-11 10:03:22,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:22,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9ca870a1dc3343c65a HTTP/1.1" 200 None 2026-03-11 10:03:22,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:22,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:03:22,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:22,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c9ca870a1dc3343c65a HTTP/1.1" 200 None 2026-03-11 10:03:22,964 - lava_callback - INFO - Completed processing callback for node 69b13c9ca870a1dc3343c65a 2026-03-11 10:03:25,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:25,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:03:38,906 - lava_callback - INFO - Received callback for node 69b13dcaa870a1dc3343c7de INFO: 172.21.0.1:39480 - "POST /node/69b13dcaa870a1dc3343c7de HTTP/1.0" 202 Accepted 2026-03-11 10:03:38,914 - lava_callback - INFO - Starting async job submit for node 69b13dcaa870a1dc3343c7de 2026-03-11 10:03:38,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:38,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13dcaa870a1dc3343c7de HTTP/1.1" 200 None 2026-03-11 10:03:38,966 - lava_callback - DEBUG - Processing node 69b13dcaa870a1dc3343c7de: baseline-arm64 2026-03-11 10:03:39,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:39,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:39,216 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13dcaa870a1dc3343c7de/log.txt.gz 2026-03-11 10:03:39,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:39,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:39,466 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13dcaa870a1dc3343c7de/lava-logs.yaml 2026-03-11 10:03:39,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:39,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:39,582 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13dcaa870a1dc3343c7de/lava_callback.json.gz 2026-03-11 10:03:39,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:39,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13dcaa870a1dc3343c7de HTTP/1.1" 200 None 2026-03-11 10:03:39,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:39,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:03:39,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:39,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13dcaa870a1dc3343c7de HTTP/1.1" 200 None 2026-03-11 10:03:39,745 - lava_callback - INFO - Completed processing callback for node 69b13dcaa870a1dc3343c7de INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:03:55,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:55,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 10:04:15,966 - lava_callback - INFO - Received callback for node 69b13cb5a870a1dc3343c6c2 INFO: 172.21.0.1:35082 - "POST /node/69b13cb5a870a1dc3343c6c2 HTTP/1.0" 202 Accepted 2026-03-11 10:04:15,973 - lava_callback - INFO - Starting async job submit for node 69b13cb5a870a1dc3343c6c2 2026-03-11 10:04:16,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:16,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb5a870a1dc3343c6c2 HTTP/1.1" 200 None 2026-03-11 10:04:16,016 - lava_callback - DEBUG - Processing node 69b13cb5a870a1dc3343c6c2: baseline-arm64-foundriesio 2026-03-11 10:04:16,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35092 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:04:16,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:16,579 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6c2/log.txt.gz 2026-03-11 10:04:16,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:17,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:17,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6c2/lava-logs.yaml 2026-03-11 10:04:17,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:17,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:17,247 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6c2/lava_callback.json.gz 2026-03-11 10:04:17,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:17,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb5a870a1dc3343c6c2 HTTP/1.1" 200 None 2026-03-11 10:04:17,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:17,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:04:17,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:17,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cb5a870a1dc3343c6c2 HTTP/1.1" 200 None 2026-03-11 10:04:17,338 - lava_callback - INFO - Completed processing callback for node 69b13cb5a870a1dc3343c6c2 2026-03-11 10:04:24,183 - lava_callback - INFO - Received callback for node 69ae9b1fc660ead8a389ba05 INFO: 172.21.0.1:47304 - "POST /node/69ae9b1fc660ead8a389ba05 HTTP/1.0" 202 Accepted 2026-03-11 10:04:24,189 - lava_callback - INFO - Starting async job submit for node 69ae9b1fc660ead8a389ba05 2026-03-11 10:04:24,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:24,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9b1fc660ead8a389ba05 HTTP/1.1" 200 None 2026-03-11 10:04:24,228 - lava_callback - DEBUG - Processing node 69ae9b1fc660ead8a389ba05: baseline-arm64-clabbe 2026-03-11 10:04:24,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9b1fc660ead8a389ba05 2026-03-11 10:04:24,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:24,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9b1fc660ead8a389ba05 HTTP/1.1" 200 None 2026-03-11 10:04:24,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:24,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 10:04:24,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:24,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9b1fc660ead8a389ba05 HTTP/1.1" 200 None 2026-03-11 10:04:24,318 - lava_callback - ERROR - Error processing callback for node 69ae9b1fc660ead8a389ba05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:04:25,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:25,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:04:31,422 - lava_callback - INFO - Received callback for node 69b13e1da870a1dc3343c800 INFO: 172.21.0.1:33138 - "POST /node/69b13e1da870a1dc3343c800 HTTP/1.0" 202 Accepted 2026-03-11 10:04:31,428 - lava_callback - INFO - Starting async job submit for node 69b13e1da870a1dc3343c800 2026-03-11 10:04:31,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:31,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13e1da870a1dc3343c800 HTTP/1.1" 200 None 2026-03-11 10:04:31,446 - lava_callback - DEBUG - Processing node 69b13e1da870a1dc3343c800: baseline-nfs-arm64 2026-03-11 10:04:31,447 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:04:31,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:31,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:31,564 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13e1da870a1dc3343c800/lava-logs.yaml 2026-03-11 10:04:31,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:31,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:31,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13e1da870a1dc3343c800/lava_callback.json.gz 2026-03-11 10:04:31,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:31,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13e1da870a1dc3343c800 HTTP/1.1" 200 None 2026-03-11 10:04:31,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:31,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:04:31,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:31,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13e1da870a1dc3343c800 HTTP/1.1" 200 None 2026-03-11 10:04:31,771 - lava_callback - INFO - Completed processing callback for node 69b13e1da870a1dc3343c800 2026-03-11 10:04:31,930 - lava_callback - INFO - Received callback for node 69b13c71a870a1dc3343c5e0 INFO: 172.21.0.1:33152 - "POST /node/69b13c71a870a1dc3343c5e0 HTTP/1.0" 202 Accepted 2026-03-11 10:04:31,937 - lava_callback - INFO - Starting async job submit for node 69b13c71a870a1dc3343c5e0 2026-03-11 10:04:31,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:31,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c71a870a1dc3343c5e0 HTTP/1.1" 200 None 2026-03-11 10:04:31,974 - lava_callback - DEBUG - Processing node 69b13c71a870a1dc3343c5e0: baseline-arm64 2026-03-11 10:04:32,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:32,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:32,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c71a870a1dc3343c5e0/log.txt.gz 2026-03-11 10:04:32,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:32,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:32,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c71a870a1dc3343c5e0/lava-logs.yaml 2026-03-11 10:04:32,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:33,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:33,044 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c71a870a1dc3343c5e0/lava_callback.json.gz 2026-03-11 10:04:33,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:33,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c71a870a1dc3343c5e0 HTTP/1.1" 200 None 2026-03-11 10:04:33,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:33,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:04:33,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:33,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c71a870a1dc3343c5e0 HTTP/1.1" 200 None 2026-03-11 10:04:33,123 - lava_callback - INFO - Completed processing callback for node 69b13c71a870a1dc3343c5e0 INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:04:37,225 - lava_callback - INFO - Received callback for node 69b13ca0a870a1dc3343c665 INFO: 172.21.0.1:33172 - "POST /node/69b13ca0a870a1dc3343c665 HTTP/1.0" 202 Accepted 2026-03-11 10:04:37,234 - lava_callback - INFO - Starting async job submit for node 69b13ca0a870a1dc3343c665 2026-03-11 10:04:37,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:37,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca0a870a1dc3343c665 HTTP/1.1" 200 None 2026-03-11 10:04:37,272 - lava_callback - DEBUG - Processing node 69b13ca0a870a1dc3343c665: baseline-arm64-broonie 2026-03-11 10:04:37,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:37,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:37,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca0a870a1dc3343c665/log.txt.gz 2026-03-11 10:04:37,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:37,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:37,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca0a870a1dc3343c665/lava-logs.yaml 2026-03-11 10:04:37,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:38,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:38,129 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca0a870a1dc3343c665/lava_callback.json.gz 2026-03-11 10:04:38,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:38,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca0a870a1dc3343c665 HTTP/1.1" 200 None 2026-03-11 10:04:38,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:38,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:04:38,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:38,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca0a870a1dc3343c665 HTTP/1.1" 200 None 2026-03-11 10:04:38,208 - lava_callback - INFO - Completed processing callback for node 69b13ca0a870a1dc3343c665 INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:04:55,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:55,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:05:20,136 - lava_callback - INFO - Received callback for node 69ae9b59c660ead8a389ba0d INFO: 172.21.0.1:55694 - "POST /node/69ae9b59c660ead8a389ba0d HTTP/1.0" 202 Accepted 2026-03-11 10:05:20,141 - lava_callback - INFO - Starting async job submit for node 69ae9b59c660ead8a389ba0d 2026-03-11 10:05:20,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:05:20,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9b59c660ead8a389ba0d HTTP/1.1" 200 None 2026-03-11 10:05:20,158 - lava_callback - DEBUG - Processing node 69ae9b59c660ead8a389ba0d: baseline-arm-baylibre 2026-03-11 10:05:20,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9b59c660ead8a389ba0d 2026-03-11 10:05:20,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:05:20,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9b59c660ead8a389ba0d HTTP/1.1" 200 None 2026-03-11 10:05:20,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:05:20,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:05:20,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:05:20,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9b59c660ead8a389ba0d HTTP/1.1" 200 None 2026-03-11 10:05:20,219 - lava_callback - ERROR - Error processing callback for node 69ae9b59c660ead8a389ba0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:06:07,745 - lava_callback - INFO - Received callback for node 69b13c80a870a1dc3343c602 INFO: 172.21.0.1:40660 - "POST /node/69b13c80a870a1dc3343c602 HTTP/1.0" 202 Accepted 2026-03-11 10:06:07,752 - lava_callback - INFO - Starting async job submit for node 69b13c80a870a1dc3343c602 2026-03-11 10:06:07,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:07,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c80a870a1dc3343c602 HTTP/1.1" 200 None 2026-03-11 10:06:07,803 - lava_callback - DEBUG - Processing node 69b13c80a870a1dc3343c602: baseline-arm64 2026-03-11 10:06:08,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:08,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:08,339 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c80a870a1dc3343c602/log.txt.gz 2026-03-11 10:06:08,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:08,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:08,798 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c80a870a1dc3343c602/lava-logs.yaml 2026-03-11 10:06:08,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:09,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:09,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c80a870a1dc3343c602/lava_callback.json.gz DEBUG: Setup failed for 69b13c80a870a1dc3343c602. Transitting job node result: incomplete -> fail 2026-03-11 10:06:09,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:09,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c80a870a1dc3343c602 HTTP/1.1" 200 None 2026-03-11 10:06:09,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:09,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:06:09,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:09,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c80a870a1dc3343c602 HTTP/1.1" 200 None 2026-03-11 10:06:09,234 - lava_callback - INFO - Completed processing callback for node 69b13c80a870a1dc3343c602 INFO: 172.21.0.1:37264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:06:25,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:25,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 10:06:26,503 - lava_callback - INFO - Received callback for node 69b13e63a870a1dc3343c827 INFO: 172.21.0.1:40752 - "POST /node/69b13e63a870a1dc3343c827 HTTP/1.0" 202 Accepted 2026-03-11 10:06:26,510 - lava_callback - INFO - Starting async job submit for node 69b13e63a870a1dc3343c827 INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:06:26,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:26,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13e63a870a1dc3343c827 HTTP/1.1" 200 None 2026-03-11 10:06:26,567 - lava_callback - DEBUG - Processing node 69b13e63a870a1dc3343c827: baseline-arm64 2026-03-11 10:06:26,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:27,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:27,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13e63a870a1dc3343c827/log.txt.gz 2026-03-11 10:06:27,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:27,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:27,615 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13e63a870a1dc3343c827/lava-logs.yaml 2026-03-11 10:06:27,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:27,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:27,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13e63a870a1dc3343c827/lava_callback.json.gz 2026-03-11 10:06:27,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:27,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13e63a870a1dc3343c827 HTTP/1.1" 200 None 2026-03-11 10:06:27,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:27,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:06:27,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:27,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13e63a870a1dc3343c827 HTTP/1.1" 200 None 2026-03-11 10:06:27,905 - lava_callback - INFO - Completed processing callback for node 69b13e63a870a1dc3343c827 INFO: 172.21.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:06:37,164 - lava_callback - INFO - Received callback for node 69b13c82a870a1dc3343c608 INFO: 172.21.0.1:45906 - "POST /node/69b13c82a870a1dc3343c608 HTTP/1.0" 202 Accepted 2026-03-11 10:06:37,170 - lava_callback - INFO - Starting async job submit for node 69b13c82a870a1dc3343c608 2026-03-11 10:06:37,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:37,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c82a870a1dc3343c608 HTTP/1.1" 200 None 2026-03-11 10:06:37,209 - lava_callback - DEBUG - Processing node 69b13c82a870a1dc3343c608: baseline-nfs-arm64 2026-03-11 10:06:37,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:37,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:37,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c82a870a1dc3343c608/log.txt.gz 2026-03-11 10:06:37,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:38,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:38,181 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c82a870a1dc3343c608/lava-logs.yaml 2026-03-11 10:06:38,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:38,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:38,371 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c82a870a1dc3343c608/lava_callback.json.gz 2026-03-11 10:06:38,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:38,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c82a870a1dc3343c608 HTTP/1.1" 200 None 2026-03-11 10:06:38,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:38,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:06:38,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:38,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c82a870a1dc3343c608 HTTP/1.1" 200 None 2026-03-11 10:06:38,478 - lava_callback - INFO - Completed processing callback for node 69b13c82a870a1dc3343c608 INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:06:55,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:55,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:08:37,799 - lava_callback - INFO - Received callback for node 69b13ef5a870a1dc3343c859 INFO: 172.21.0.1:34118 - "POST /node/69b13ef5a870a1dc3343c859 HTTP/1.0" 202 Accepted 2026-03-11 10:08:37,805 - lava_callback - INFO - Starting async job submit for node 69b13ef5a870a1dc3343c859 2026-03-11 10:08:37,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:37,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ef5a870a1dc3343c859 HTTP/1.1" 200 None 2026-03-11 10:08:37,849 - lava_callback - DEBUG - Processing node 69b13ef5a870a1dc3343c859: baseline-arm64 2026-03-11 10:08:37,977 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:08:38,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:08:38,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:08:38,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13ef5a870a1dc3343c859/lava-logs.yaml 2026-03-11 10:08:38,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:08:38,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:08:38,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13ef5a870a1dc3343c859/lava_callback.json.gz 2026-03-11 10:08:38,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:38,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ef5a870a1dc3343c859 HTTP/1.1" 200 None 2026-03-11 10:08:38,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:38,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:08:38,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:38,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ef5a870a1dc3343c859 HTTP/1.1" 200 None 2026-03-11 10:08:38,614 - lava_callback - INFO - Completed processing callback for node 69b13ef5a870a1dc3343c859 2026-03-11 10:08:40,075 - lava_callback - INFO - Received callback for node 69ae9c16c660ead8a389ba6d INFO: 172.21.0.1:49816 - "POST /node/69ae9c16c660ead8a389ba6d HTTP/1.0" 202 Accepted 2026-03-11 10:08:40,081 - lava_callback - INFO - Starting async job submit for node 69ae9c16c660ead8a389ba6d 2026-03-11 10:08:40,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:40,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c16c660ead8a389ba6d HTTP/1.1" 200 None 2026-03-11 10:08:40,097 - lava_callback - DEBUG - Processing node 69ae9c16c660ead8a389ba6d: baseline-arm-baylibre 2026-03-11 10:08:40,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9c16c660ead8a389ba6d 2026-03-11 10:08:40,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:40,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c16c660ead8a389ba6d HTTP/1.1" 200 None 2026-03-11 10:08:40,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:40,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:08:40,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:40,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9c16c660ead8a389ba6d HTTP/1.1" 200 None 2026-03-11 10:08:40,160 - lava_callback - ERROR - Error processing callback for node 69ae9c16c660ead8a389ba6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:08:47,242 - lava_callback - INFO - Received callback for node 69b13c79a870a1dc3343c5f2 INFO: 172.21.0.1:49822 - "POST /node/69b13c79a870a1dc3343c5f2 HTTP/1.0" 202 Accepted 2026-03-11 10:08:47,248 - lava_callback - INFO - Starting async job submit for node 69b13c79a870a1dc3343c5f2 2026-03-11 10:08:47,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:47,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c79a870a1dc3343c5f2 HTTP/1.1" 200 None 2026-03-11 10:08:47,284 - lava_callback - DEBUG - Processing node 69b13c79a870a1dc3343c5f2: baseline-arm64 2026-03-11 10:08:47,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:08:47,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:08:47,652 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c79a870a1dc3343c5f2/log.txt.gz 2026-03-11 10:08:47,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:08:47,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:08:47,971 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c79a870a1dc3343c5f2/lava-logs.yaml 2026-03-11 10:08:47,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:08:48,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:08:48,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c79a870a1dc3343c5f2/lava_callback.json.gz 2026-03-11 10:08:48,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:48,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c79a870a1dc3343c5f2 HTTP/1.1" 200 None 2026-03-11 10:08:48,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:48,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:08:48,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:48,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c79a870a1dc3343c5f2 HTTP/1.1" 200 None 2026-03-11 10:08:48,214 - lava_callback - INFO - Completed processing callback for node 69b13c79a870a1dc3343c5f2 2026-03-11 10:08:55,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:55,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:09:20,080 - lava_callback - INFO - Received callback for node 69ae9c3ec660ead8a389baa5 INFO: 172.21.0.1:55878 - "POST /node/69ae9c3ec660ead8a389baa5 HTTP/1.0" 202 Accepted 2026-03-11 10:09:20,085 - lava_callback - INFO - Starting async job submit for node 69ae9c3ec660ead8a389baa5 2026-03-11 10:09:20,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:20,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c3ec660ead8a389baa5 HTTP/1.1" 200 None 2026-03-11 10:09:20,101 - lava_callback - DEBUG - Processing node 69ae9c3ec660ead8a389baa5: baseline-arm-baylibre 2026-03-11 10:09:20,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9c3ec660ead8a389baa5 2026-03-11 10:09:20,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:20,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c3ec660ead8a389baa5 HTTP/1.1" 200 None 2026-03-11 10:09:20,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:20,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:09:20,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:20,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9c3ec660ead8a389baa5 HTTP/1.1" 200 None 2026-03-11 10:09:20,170 - lava_callback - ERROR - Error processing callback for node 69ae9c3ec660ead8a389baa5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:09:25,564 - lava_callback - INFO - Received callback for node 69b13ac5a870a1dc3343c57b INFO: 172.21.0.1:55884 - "POST /node/69b13ac5a870a1dc3343c57b HTTP/1.0" 202 Accepted 2026-03-11 10:09:25,614 - lava_callback - INFO - Starting async job submit for node 69b13ac5a870a1dc3343c57b 2026-03-11 10:09:25,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:25,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ac5a870a1dc3343c57b HTTP/1.1" 200 None 2026-03-11 10:09:25,659 - lava_callback - DEBUG - Processing node 69b13ac5a870a1dc3343c57b: baseline-arm-pengutronix 2026-03-11 10:09:25,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:09:26,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:09:26,043 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b13ac5a870a1dc3343c57b/log.txt.gz 2026-03-11 10:09:26,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:09:26,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:09:26,299 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b13ac5a870a1dc3343c57b/lava-logs.yaml 2026-03-11 10:09:26,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:09:26,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:09:26,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b13ac5a870a1dc3343c57b/lava_callback.json.gz DEBUG: Setup failed for 69b13ac5a870a1dc3343c57b. Transitting job node result: incomplete -> fail 2026-03-11 10:09:26,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:26,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ac5a870a1dc3343c57b HTTP/1.1" 200 None INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:09:26,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:26,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 10:09:26,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:26,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ac5a870a1dc3343c57b HTTP/1.1" 200 None 2026-03-11 10:09:26,616 - lava_callback - INFO - Completed processing callback for node 69b13ac5a870a1dc3343c57b INFO: 172.21.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:09:55,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:55,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:10:00,128 - lava_callback - INFO - Received callback for node 69ae9c67c660ead8a389baca INFO: 172.21.0.1:51658 - "POST /node/69ae9c67c660ead8a389baca HTTP/1.0" 202 Accepted 2026-03-11 10:10:00,134 - lava_callback - INFO - Starting async job submit for node 69ae9c67c660ead8a389baca 2026-03-11 10:10:00,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:00,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c67c660ead8a389baca HTTP/1.1" 200 None 2026-03-11 10:10:00,151 - lava_callback - DEBUG - Processing node 69ae9c67c660ead8a389baca: baseline-arm-baylibre 2026-03-11 10:10:00,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9c67c660ead8a389baca 2026-03-11 10:10:00,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:00,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c67c660ead8a389baca HTTP/1.1" 200 None 2026-03-11 10:10:00,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:00,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:10:00,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:00,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9c67c660ead8a389baca HTTP/1.1" 200 None 2026-03-11 10:10:00,207 - lava_callback - ERROR - Error processing callback for node 69ae9c67c660ead8a389baca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:10:05,223 - lava_callback - INFO - Received callback for node 69b13c8aa870a1dc3343c61a INFO: 172.21.0.1:51672 - "POST /node/69b13c8aa870a1dc3343c61a HTTP/1.0" 202 Accepted 2026-03-11 10:10:05,229 - lava_callback - INFO - Starting async job submit for node 69b13c8aa870a1dc3343c61a 2026-03-11 10:10:05,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:05,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8aa870a1dc3343c61a HTTP/1.1" 200 None 2026-03-11 10:10:05,279 - lava_callback - DEBUG - Processing node 69b13c8aa870a1dc3343c61a: baseline-nfs-arm64 2026-03-11 10:10:05,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:10:05,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:10:05,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8aa870a1dc3343c61a/log.txt.gz 2026-03-11 10:10:05,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:10:06,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:10:06,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8aa870a1dc3343c61a/lava-logs.yaml 2026-03-11 10:10:06,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:10:06,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:10:06,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8aa870a1dc3343c61a/lava_callback.json.gz 2026-03-11 10:10:06,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:06,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8aa870a1dc3343c61a HTTP/1.1" 200 None 2026-03-11 10:10:06,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:06,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:10:06,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:06,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c8aa870a1dc3343c61a HTTP/1.1" 200 None 2026-03-11 10:10:06,430 - lava_callback - INFO - Completed processing callback for node 69b13c8aa870a1dc3343c61a INFO: 172.21.0.1:51676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:10:25,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:25,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:10:40,158 - lava_callback - INFO - Received callback for node 69ae9c8dc660ead8a389baee INFO: 172.21.0.1:43680 - "POST /node/69ae9c8dc660ead8a389baee HTTP/1.0" 202 Accepted 2026-03-11 10:10:40,163 - lava_callback - INFO - Starting async job submit for node 69ae9c8dc660ead8a389baee 2026-03-11 10:10:40,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:40,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c8dc660ead8a389baee HTTP/1.1" 200 None 2026-03-11 10:10:40,179 - lava_callback - DEBUG - Processing node 69ae9c8dc660ead8a389baee: baseline-arm-baylibre 2026-03-11 10:10:40,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9c8dc660ead8a389baee 2026-03-11 10:10:40,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:40,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c8dc660ead8a389baee HTTP/1.1" 200 None 2026-03-11 10:10:40,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:40,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:10:40,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:40,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9c8dc660ead8a389baee HTTP/1.1" 200 None 2026-03-11 10:10:40,259 - lava_callback - ERROR - Error processing callback for node 69ae9c8dc660ead8a389baee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:11:17,800 - lava_callback - INFO - Received callback for node 69b13f50a870a1dc3343c878 INFO: 172.21.0.1:55392 - "POST /node/69b13f50a870a1dc3343c878 HTTP/1.0" 202 Accepted 2026-03-11 10:11:17,806 - lava_callback - INFO - Starting async job submit for node 69b13f50a870a1dc3343c878 2026-03-11 10:11:17,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:17,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13f50a870a1dc3343c878 HTTP/1.1" 200 None 2026-03-11 10:11:17,838 - lava_callback - DEBUG - Processing node 69b13f50a870a1dc3343c878: baseline-arm64-broonie 2026-03-11 10:11:18,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:11:18,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:11:18,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13f50a870a1dc3343c878/log.txt.gz 2026-03-11 10:11:18,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:11:18,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:11:18,775 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13f50a870a1dc3343c878/lava-logs.yaml 2026-03-11 10:11:18,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:11:18,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:11:18,959 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13f50a870a1dc3343c878/lava_callback.json.gz 2026-03-11 10:11:18,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:18,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13f50a870a1dc3343c878 HTTP/1.1" 200 None 2026-03-11 10:11:18,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:19,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:11:19,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:19,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13f50a870a1dc3343c878 HTTP/1.1" 200 None 2026-03-11 10:11:19,066 - lava_callback - INFO - Completed processing callback for node 69b13f50a870a1dc3343c878 2026-03-11 10:11:20,225 - lava_callback - INFO - Received callback for node 69ae9cb6c660ead8a389bb39 INFO: 172.21.0.1:36832 - "POST /node/69ae9cb6c660ead8a389bb39 HTTP/1.0" 202 Accepted 2026-03-11 10:11:20,232 - lava_callback - INFO - Starting async job submit for node 69ae9cb6c660ead8a389bb39 2026-03-11 10:11:20,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:20,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9cb6c660ead8a389bb39 HTTP/1.1" 200 None 2026-03-11 10:11:20,248 - lava_callback - DEBUG - Processing node 69ae9cb6c660ead8a389bb39: baseline-arm-baylibre 2026-03-11 10:11:20,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9cb6c660ead8a389bb39 2026-03-11 10:11:20,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:20,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9cb6c660ead8a389bb39 HTTP/1.1" 200 None 2026-03-11 10:11:20,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:20,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:11:20,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:20,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9cb6c660ead8a389bb39 HTTP/1.1" 200 None 2026-03-11 10:11:20,303 - lava_callback - ERROR - Error processing callback for node 69ae9cb6c660ead8a389bb39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:11:25,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:25,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36842 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:11:30,891 - lava_callback - INFO - Received callback for node 69b13f8ca870a1dc3343c88e INFO: 172.21.0.1:36590 - "POST /node/69b13f8ca870a1dc3343c88e HTTP/1.0" 202 Accepted 2026-03-11 10:11:30,898 - lava_callback - INFO - Starting async job submit for node 69b13f8ca870a1dc3343c88e 2026-03-11 10:11:30,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:30,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13f8ca870a1dc3343c88e HTTP/1.1" 200 None 2026-03-11 10:11:30,943 - lava_callback - DEBUG - Processing node 69b13f8ca870a1dc3343c88e: baseline-arm64 2026-03-11 10:11:31,184 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:11:31,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:11:31,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:11:31,489 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13f8ca870a1dc3343c88e/lava-logs.yaml 2026-03-11 10:11:31,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:11:31,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:11:31,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13f8ca870a1dc3343c88e/lava_callback.json.gz 2026-03-11 10:11:31,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:31,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13f8ca870a1dc3343c88e HTTP/1.1" 200 None 2026-03-11 10:11:31,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:31,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:11:31,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:31,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13f8ca870a1dc3343c88e HTTP/1.1" 200 None 2026-03-11 10:11:31,855 - lava_callback - INFO - Completed processing callback for node 69b13f8ca870a1dc3343c88e INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:11:55,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:55,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:12:11,787 - lava_callback - INFO - Received callback for node 69b13fe0a870a1dc3343c8aa INFO: 172.21.0.1:48142 - "POST /node/69b13fe0a870a1dc3343c8aa HTTP/1.0" 202 Accepted 2026-03-11 10:12:11,793 - lava_callback - INFO - Starting async job submit for node 69b13fe0a870a1dc3343c8aa 2026-03-11 10:12:11,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:12:11,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13fe0a870a1dc3343c8aa HTTP/1.1" 200 None 2026-03-11 10:12:11,810 - lava_callback - DEBUG - Processing node 69b13fe0a870a1dc3343c8aa: baseline-nfs-arm64 2026-03-11 10:12:11,812 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:12:11,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:12:12,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:12:12,045 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13fe0a870a1dc3343c8aa/lava-logs.yaml 2026-03-11 10:12:12,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:12:12,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:12:12,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13fe0a870a1dc3343c8aa/lava_callback.json.gz 2026-03-11 10:12:12,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:12:12,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13fe0a870a1dc3343c8aa HTTP/1.1" 200 None 2026-03-11 10:12:12,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:12:12,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:12:12,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:12:12,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13fe0a870a1dc3343c8aa HTTP/1.1" 200 None 2026-03-11 10:12:12,230 - lava_callback - INFO - Completed processing callback for node 69b13fe0a870a1dc3343c8aa INFO: 172.21.0.1:48152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:12:25,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:12:25,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:15:03,198 - lava_callback - INFO - Received callback for node 69b14072a870a1dc3343c8c8 INFO: 172.21.0.1:36664 - "POST /node/69b14072a870a1dc3343c8c8 HTTP/1.0" 202 Accepted 2026-03-11 10:15:03,207 - lava_callback - INFO - Starting async job submit for node 69b14072a870a1dc3343c8c8 2026-03-11 10:15:03,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:15:03,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14072a870a1dc3343c8c8 HTTP/1.1" 200 None 2026-03-11 10:15:03,254 - lava_callback - DEBUG - Processing node 69b14072a870a1dc3343c8c8: baseline-arm64 2026-03-11 10:15:03,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:15:03,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:15:03,572 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14072a870a1dc3343c8c8/log.txt.gz 2026-03-11 10:15:03,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:15:03,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:15:03,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14072a870a1dc3343c8c8/lava-logs.yaml 2026-03-11 10:15:03,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:15:03,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:15:03,961 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14072a870a1dc3343c8c8/lava_callback.json.gz 2026-03-11 10:15:03,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:15:04,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14072a870a1dc3343c8c8 HTTP/1.1" 200 None 2026-03-11 10:15:04,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:15:04,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:15:04,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:15:04,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b14072a870a1dc3343c8c8 HTTP/1.1" 200 None 2026-03-11 10:15:04,115 - lava_callback - INFO - Completed processing callback for node 69b14072a870a1dc3343c8c8 INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:15:25,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:15:25,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40880 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:16:20,601 - lava_callback - INFO - Received callback for node 69ae9deec660ead8a389bbbb INFO: 172.21.0.1:53966 - "POST /node/69ae9deec660ead8a389bbbb HTTP/1.0" 202 Accepted 2026-03-11 10:16:20,607 - lava_callback - INFO - Starting async job submit for node 69ae9deec660ead8a389bbbb 2026-03-11 10:16:20,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:16:20,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9deec660ead8a389bbbb HTTP/1.1" 200 None 2026-03-11 10:16:20,633 - lava_callback - DEBUG - Processing node 69ae9deec660ead8a389bbbb: baseline-arm64-baylibre 2026-03-11 10:16:20,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9deec660ead8a389bbbb 2026-03-11 10:16:20,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:16:20,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9deec660ead8a389bbbb HTTP/1.1" 200 None 2026-03-11 10:16:20,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:16:20,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-11 10:16:20,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:16:20,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9deec660ead8a389bbbb HTTP/1.1" 200 None 2026-03-11 10:16:20,689 - lava_callback - ERROR - Error processing callback for node 69ae9deec660ead8a389bbbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:17:21,189 - lava_callback - INFO - Received callback for node 69b140e1a870a1dc3343c8df INFO: 172.21.0.1:59030 - "POST /node/69b140e1a870a1dc3343c8df HTTP/1.0" 202 Accepted 2026-03-11 10:17:21,195 - lava_callback - INFO - Starting async job submit for node 69b140e1a870a1dc3343c8df 2026-03-11 10:17:21,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:21,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b140e1a870a1dc3343c8df HTTP/1.1" 200 None 2026-03-11 10:17:21,241 - lava_callback - DEBUG - Processing node 69b140e1a870a1dc3343c8df: baseline-arm64 2026-03-11 10:17:21,430 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:17:21,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:17:21,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:17:21,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b140e1a870a1dc3343c8df/lava-logs.yaml 2026-03-11 10:17:21,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:17:21,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:17:21,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b140e1a870a1dc3343c8df/lava_callback.json.gz 2026-03-11 10:17:21,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:21,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b140e1a870a1dc3343c8df HTTP/1.1" 200 None 2026-03-11 10:17:21,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:21,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:17:21,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:21,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b140e1a870a1dc3343c8df HTTP/1.1" 200 None 2026-03-11 10:17:22,073 - lava_callback - INFO - Completed processing callback for node 69b140e1a870a1dc3343c8df 2026-03-11 10:17:25,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:25,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:17:40,576 - lava_callback - INFO - Received callback for node 69ae9e39c660ead8a389bbd7 INFO: 172.21.0.1:58566 - "POST /node/69ae9e39c660ead8a389bbd7 HTTP/1.0" 202 Accepted 2026-03-11 10:17:40,581 - lava_callback - INFO - Starting async job submit for node 69ae9e39c660ead8a389bbd7 2026-03-11 10:17:40,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:40,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9e39c660ead8a389bbd7 HTTP/1.1" 200 None 2026-03-11 10:17:40,598 - lava_callback - DEBUG - Processing node 69ae9e39c660ead8a389bbd7: baseline-arm64-baylibre 2026-03-11 10:17:40,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9e39c660ead8a389bbd7 2026-03-11 10:17:40,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:40,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9e39c660ead8a389bbd7 HTTP/1.1" 200 None 2026-03-11 10:17:40,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:40,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-11 10:17:40,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:40,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9e39c660ead8a389bbd7 HTTP/1.1" 200 None 2026-03-11 10:17:40,697 - lava_callback - ERROR - Error processing callback for node 69ae9e39c660ead8a389bbd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:18:16,890 - lava_callback - INFO - Received callback for node 69b13c85a870a1dc3343c60e INFO: 172.21.0.1:33734 - "POST /node/69b13c85a870a1dc3343c60e HTTP/1.0" 202 Accepted 2026-03-11 10:18:16,899 - lava_callback - INFO - Starting async job submit for node 69b13c85a870a1dc3343c60e 2026-03-11 10:18:16,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:16,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c85a870a1dc3343c60e HTTP/1.1" 200 None 2026-03-11 10:18:16,979 - lava_callback - DEBUG - Processing node 69b13c85a870a1dc3343c60e: baseline-nfs-arm64 2026-03-11 10:18:18,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:18,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:18,243 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c85a870a1dc3343c60e/log.txt.gz 2026-03-11 10:18:18,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:19,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:19,105 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c85a870a1dc3343c60e/lava-logs.yaml 2026-03-11 10:18:19,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:19,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:19,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c85a870a1dc3343c60e/lava_callback.json.gz DEBUG: Setup failed for 69b13c85a870a1dc3343c60e. Transitting job node result: incomplete -> fail 2026-03-11 10:18:19,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:19,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c85a870a1dc3343c60e HTTP/1.1" 200 None 2026-03-11 10:18:19,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:19,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:18:19,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:19,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c85a870a1dc3343c60e HTTP/1.1" 200 None 2026-03-11 10:18:19,561 - lava_callback - INFO - Completed processing callback for node 69b13c85a870a1dc3343c60e 2026-03-11 10:18:25,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:25,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:18:36,836 - lava_callback - INFO - Received callback for node 69b139b3a870a1dc3343c552 INFO: 172.21.0.1:50044 - "POST /node/69b139b3a870a1dc3343c552 HTTP/1.0" 202 Accepted 2026-03-11 10:18:36,841 - lava_callback - INFO - Starting async job submit for node 69b139b3a870a1dc3343c552 2026-03-11 10:18:36,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:36,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b139b3a870a1dc3343c552 HTTP/1.1" 200 None 2026-03-11 10:18:36,876 - lava_callback - DEBUG - Processing node 69b139b3a870a1dc3343c552: baseline-arm64-broonie 2026-03-11 10:18:36,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:37,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:37,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b139b3a870a1dc3343c552/log.txt.gz 2026-03-11 10:18:37,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:37,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:37,330 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b139b3a870a1dc3343c552/lava-logs.yaml 2026-03-11 10:18:37,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:37,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:37,444 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b139b3a870a1dc3343c552/lava_callback.json.gz 2026-03-11 10:18:37,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:37,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b139b3a870a1dc3343c552 HTTP/1.1" 200 None 2026-03-11 10:18:37,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:37,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-11 10:18:37,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:37,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b139b3a870a1dc3343c552 HTTP/1.1" 200 None 2026-03-11 10:18:37,580 - lava_callback - INFO - Completed processing callback for node 69b139b3a870a1dc3343c552 INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:18:55,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:55,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:20:28,808 - lava_callback - INFO - Received callback for node 69b1402aa870a1dc3343c8b9 INFO: 172.21.0.1:38946 - "POST /node/69b1402aa870a1dc3343c8b9 HTTP/1.0" 202 Accepted 2026-03-11 10:20:28,815 - lava_callback - INFO - Starting async job submit for node 69b1402aa870a1dc3343c8b9 2026-03-11 10:20:28,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:20:28,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1402aa870a1dc3343c8b9 HTTP/1.1" 200 None 2026-03-11 10:20:28,870 - lava_callback - DEBUG - Processing node 69b1402aa870a1dc3343c8b9: baseline-arm64 2026-03-11 10:20:29,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:20:29,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:20:29,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1402aa870a1dc3343c8b9/log.txt.gz 2026-03-11 10:20:29,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:20:29,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:20:29,828 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1402aa870a1dc3343c8b9/lava-logs.yaml 2026-03-11 10:20:29,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:20:30,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:20:30,014 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1402aa870a1dc3343c8b9/lava_callback.json.gz DEBUG: Setup failed for 69b1402aa870a1dc3343c8b9. Transitting job node result: incomplete -> fail 2026-03-11 10:20:30,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:20:30,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1402aa870a1dc3343c8b9 HTTP/1.1" 200 None 2026-03-11 10:20:30,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:20:30,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:20:30,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:20:30,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1402aa870a1dc3343c8b9 HTTP/1.1" 200 None 2026-03-11 10:20:30,272 - lava_callback - INFO - Completed processing callback for node 69b1402aa870a1dc3343c8b9 INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:20:55,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:20:55,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56916 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:24:01,085 - lava_callback - INFO - Received callback for node 69ae9fb1c660ead8a389bc6a INFO: 172.21.0.1:49212 - "POST /node/69ae9fb1c660ead8a389bc6a HTTP/1.0" 202 Accepted 2026-03-11 10:24:01,091 - lava_callback - INFO - Starting async job submit for node 69ae9fb1c660ead8a389bc6a 2026-03-11 10:24:01,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:24:01,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9fb1c660ead8a389bc6a HTTP/1.1" 200 None 2026-03-11 10:24:01,116 - lava_callback - DEBUG - Processing node 69ae9fb1c660ead8a389bc6a: baseline-arm64-baylibre 2026-03-11 10:24:01,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9fb1c660ead8a389bc6a 2026-03-11 10:24:01,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:24:01,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9fb1c660ead8a389bc6a HTTP/1.1" 200 None 2026-03-11 10:24:01,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:24:01,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-11 10:24:01,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:24:01,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9fb1c660ead8a389bc6a HTTP/1.1" 200 None 2026-03-11 10:24:01,190 - lava_callback - ERROR - Error processing callback for node 69ae9fb1c660ead8a389bc6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:26:21,111 - lava_callback - INFO - Received callback for node 69aea045c660ead8a389bc95 INFO: 172.21.0.1:43492 - "POST /node/69aea045c660ead8a389bc95 HTTP/1.0" 202 Accepted 2026-03-11 10:26:21,116 - lava_callback - INFO - Starting async job submit for node 69aea045c660ead8a389bc95 2026-03-11 10:26:21,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:21,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea045c660ead8a389bc95 HTTP/1.1" 200 None 2026-03-11 10:26:21,132 - lava_callback - DEBUG - Processing node 69aea045c660ead8a389bc95: baseline-arm64-baylibre 2026-03-11 10:26:21,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea045c660ead8a389bc95 2026-03-11 10:26:21,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:21,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea045c660ead8a389bc95 HTTP/1.1" 200 None 2026-03-11 10:26:21,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:21,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-11 10:26:21,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:21,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea045c660ead8a389bc95 HTTP/1.1" 200 None 2026-03-11 10:26:21,198 - lava_callback - ERROR - Error processing callback for node 69aea045c660ead8a389bc95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:26:23,732 - lava_callback - INFO - Received callback for node 69b1420aa870a1dc3343c915 INFO: 172.21.0.1:43494 - "POST /node/69b1420aa870a1dc3343c915 HTTP/1.0" 202 Accepted 2026-03-11 10:26:23,739 - lava_callback - INFO - Starting async job submit for node 69b1420aa870a1dc3343c915 2026-03-11 10:26:23,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:23,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1420aa870a1dc3343c915 HTTP/1.1" 200 None 2026-03-11 10:26:23,788 - lava_callback - DEBUG - Processing node 69b1420aa870a1dc3343c915: baseline-arm64 2026-03-11 10:26:24,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:26:24,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:26:24,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1420aa870a1dc3343c915/log.txt.gz 2026-03-11 10:26:24,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:26:24,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:26:24,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1420aa870a1dc3343c915/lava-logs.yaml 2026-03-11 10:26:24,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:26:24,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:26:24,934 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1420aa870a1dc3343c915/lava_callback.json.gz DEBUG: Setup failed for 69b1420aa870a1dc3343c915. Transitting job node result: incomplete -> fail 2026-03-11 10:26:25,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:25,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1420aa870a1dc3343c915 HTTP/1.1" 200 None 2026-03-11 10:26:25,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:25,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:26:25,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:25,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1420aa870a1dc3343c915 HTTP/1.1" 200 None 2026-03-11 10:26:25,140 - lava_callback - INFO - Completed processing callback for node 69b1420aa870a1dc3343c915 2026-03-11 10:26:25,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:25,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:33:55,472 - lava_callback - INFO - Received callback for node 69b14358a870a1dc3343c92c INFO: 172.21.0.1:42082 - "POST /node/69b14358a870a1dc3343c92c HTTP/1.0" 202 Accepted 2026-03-11 10:33:55,479 - lava_callback - INFO - Starting async job submit for node 69b14358a870a1dc3343c92c 2026-03-11 10:33:55,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:33:55,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14358a870a1dc3343c92c HTTP/1.1" 200 None 2026-03-11 10:33:55,530 - lava_callback - DEBUG - Processing node 69b14358a870a1dc3343c92c: baseline-arm64 2026-03-11 10:33:55,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:33:56,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:33:56,078 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14358a870a1dc3343c92c/log.txt.gz 2026-03-11 10:33:56,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:33:56,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:33:56,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14358a870a1dc3343c92c/lava-logs.yaml INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:33:56,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:33:56,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:33:56,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14358a870a1dc3343c92c/lava_callback.json.gz DEBUG: Setup failed for 69b14358a870a1dc3343c92c. Transitting job node result: incomplete -> fail 2026-03-11 10:33:56,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:33:56,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14358a870a1dc3343c92c HTTP/1.1" 200 None 2026-03-11 10:33:56,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:33:56,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:33:56,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:33:56,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b14358a870a1dc3343c92c HTTP/1.1" 200 None 2026-03-11 10:33:57,006 - lava_callback - INFO - Completed processing callback for node 69b14358a870a1dc3343c92c INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:34:25,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:34:25,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:35:06,832 - lava_callback - INFO - Received callback for node 69b140c7a870a1dc3343c8dc INFO: 172.21.0.1:43630 - "POST /node/69b140c7a870a1dc3343c8dc HTTP/1.0" 202 Accepted 2026-03-11 10:35:06,881 - lava_callback - INFO - Starting async job submit for node 69b140c7a870a1dc3343c8dc 2026-03-11 10:35:06,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:35:06,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b140c7a870a1dc3343c8dc HTTP/1.1" 200 None 2026-03-11 10:35:06,922 - lava_callback - DEBUG - Processing node 69b140c7a870a1dc3343c8dc: baseline-arm-pengutronix 2026-03-11 10:35:07,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:35:07,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:35:07,187 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b140c7a870a1dc3343c8dc/log.txt.gz 2026-03-11 10:35:07,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:35:07,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:35:07,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b140c7a870a1dc3343c8dc/lava-logs.yaml 2026-03-11 10:35:07,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:35:07,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:35:07,571 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b140c7a870a1dc3343c8dc/lava_callback.json.gz DEBUG: Setup failed for 69b140c7a870a1dc3343c8dc. Transitting job node result: incomplete -> fail 2026-03-11 10:35:07,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:35:07,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b140c7a870a1dc3343c8dc HTTP/1.1" 200 None 2026-03-11 10:35:07,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:35:07,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 10:35:07,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:35:07,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b140c7a870a1dc3343c8dc HTTP/1.1" 200 None 2026-03-11 10:35:07,721 - lava_callback - INFO - Completed processing callback for node 69b140c7a870a1dc3343c8dc INFO: 172.21.0.1:36396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:35:25,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:35:25,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55712 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 10:38:15,397 - lava_callback - INFO - Received callback for node 69b14174a870a1dc3343c8f9 INFO: 172.21.0.1:55718 - "POST /node/69b14174a870a1dc3343c8f9 HTTP/1.0" 202 Accepted 2026-03-11 10:38:15,405 - lava_callback - INFO - Starting async job submit for node 69b14174a870a1dc3343c8f9 2026-03-11 10:38:15,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:38:15,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14174a870a1dc3343c8f9 HTTP/1.1" 200 None 2026-03-11 10:38:15,485 - lava_callback - DEBUG - Processing node 69b14174a870a1dc3343c8f9: baseline-nfs-arm64 INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:38:16,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:38:16,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:38:16,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14174a870a1dc3343c8f9/log.txt.gz 2026-03-11 10:38:17,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:38:17,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:38:17,711 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14174a870a1dc3343c8f9/lava-logs.yaml 2026-03-11 10:38:17,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:38:17,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:38:17,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14174a870a1dc3343c8f9/lava_callback.json.gz DEBUG: Setup failed for 69b14174a870a1dc3343c8f9. Transitting job node result: incomplete -> fail 2026-03-11 10:38:18,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:38:18,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14174a870a1dc3343c8f9 HTTP/1.1" 200 None 2026-03-11 10:38:18,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:38:18,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:38:18,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:38:18,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b14174a870a1dc3343c8f9 HTTP/1.1" 200 None 2026-03-11 10:38:18,181 - lava_callback - INFO - Completed processing callback for node 69b14174a870a1dc3343c8f9 2026-03-11 10:38:25,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:38:25,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:48:02,339 - lava_callback - INFO - Received callback for node 69aea553c660ead8a389bddc INFO: 172.21.0.1:49660 - "POST /node/69aea553c660ead8a389bddc HTTP/1.0" 202 Accepted 2026-03-11 10:48:02,345 - lava_callback - INFO - Starting async job submit for node 69aea553c660ead8a389bddc 2026-03-11 10:48:02,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:02,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea553c660ead8a389bddc HTTP/1.1" 200 None 2026-03-11 10:48:02,398 - lava_callback - DEBUG - Processing node 69aea553c660ead8a389bddc: baseline-arm-baylibre 2026-03-11 10:48:02,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea553c660ead8a389bddc 2026-03-11 10:48:02,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:02,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea553c660ead8a389bddc HTTP/1.1" 200 None 2026-03-11 10:48:02,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:02,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:48:02,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:02,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea553c660ead8a389bddc HTTP/1.1" 200 None 2026-03-11 10:48:02,505 - lava_callback - ERROR - Error processing callback for node 69aea553c660ead8a389bddc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36944 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:48:42,219 - lava_callback - INFO - Received callback for node 69aea57bc660ead8a389bde7 INFO: 172.21.0.1:50290 - "POST /node/69aea57bc660ead8a389bde7 HTTP/1.0" 202 Accepted 2026-03-11 10:48:42,224 - lava_callback - INFO - Starting async job submit for node 69aea57bc660ead8a389bde7 2026-03-11 10:48:42,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:42,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea57bc660ead8a389bde7 HTTP/1.1" 200 None 2026-03-11 10:48:42,246 - lava_callback - DEBUG - Processing node 69aea57bc660ead8a389bde7: baseline-arm-baylibre 2026-03-11 10:48:42,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea57bc660ead8a389bde7 2026-03-11 10:48:42,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:42,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea57bc660ead8a389bde7 HTTP/1.1" 200 None 2026-03-11 10:48:42,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:42,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:48:42,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:42,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea57bc660ead8a389bde7 HTTP/1.1" 200 None 2026-03-11 10:48:42,343 - lava_callback - ERROR - Error processing callback for node 69aea57bc660ead8a389bde7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:49:22,454 - lava_callback - INFO - Received callback for node 69aea5a5c660ead8a389bdf4 INFO: 172.21.0.1:45174 - "POST /node/69aea5a5c660ead8a389bdf4 HTTP/1.0" 202 Accepted 2026-03-11 10:49:22,460 - lava_callback - INFO - Starting async job submit for node 69aea5a5c660ead8a389bdf4 2026-03-11 10:49:22,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:49:22,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea5a5c660ead8a389bdf4 HTTP/1.1" 200 None 2026-03-11 10:49:22,476 - lava_callback - DEBUG - Processing node 69aea5a5c660ead8a389bdf4: baseline-arm-baylibre 2026-03-11 10:49:22,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea5a5c660ead8a389bdf4 2026-03-11 10:49:22,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:49:22,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea5a5c660ead8a389bdf4 HTTP/1.1" 200 None 2026-03-11 10:49:22,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:49:22,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:49:22,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:49:22,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea5a5c660ead8a389bdf4 HTTP/1.1" 200 None 2026-03-11 10:49:22,547 - lava_callback - ERROR - Error processing callback for node 69aea5a5c660ead8a389bdf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:50:22,341 - lava_callback - INFO - Received callback for node 69aea5e2c660ead8a389be03 INFO: 172.21.0.1:34982 - "POST /node/69aea5e2c660ead8a389be03 HTTP/1.0" 202 Accepted 2026-03-11 10:50:22,347 - lava_callback - INFO - Starting async job submit for node 69aea5e2c660ead8a389be03 2026-03-11 10:50:22,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:50:22,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea5e2c660ead8a389be03 HTTP/1.1" 200 None 2026-03-11 10:50:22,363 - lava_callback - DEBUG - Processing node 69aea5e2c660ead8a389be03: baseline-arm-baylibre 2026-03-11 10:50:22,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea5e2c660ead8a389be03 2026-03-11 10:50:22,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:50:22,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea5e2c660ead8a389be03 HTTP/1.1" 200 None 2026-03-11 10:50:22,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:50:22,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:50:22,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:50:22,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea5e2c660ead8a389be03 HTTP/1.1" 200 None 2026-03-11 10:50:22,430 - lava_callback - ERROR - Error processing callback for node 69aea5e2c660ead8a389be03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51250 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:51:02,486 - lava_callback - INFO - Received callback for node 69aea60ac660ead8a389be0f INFO: 172.21.0.1:35756 - "POST /node/69aea60ac660ead8a389be0f HTTP/1.0" 202 Accepted 2026-03-11 10:51:02,491 - lava_callback - INFO - Starting async job submit for node 69aea60ac660ead8a389be0f 2026-03-11 10:51:02,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:02,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea60ac660ead8a389be0f HTTP/1.1" 200 None 2026-03-11 10:51:02,511 - lava_callback - DEBUG - Processing node 69aea60ac660ead8a389be0f: baseline-arm-baylibre 2026-03-11 10:51:02,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea60ac660ead8a389be0f 2026-03-11 10:51:02,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:02,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea60ac660ead8a389be0f HTTP/1.1" 200 None 2026-03-11 10:51:02,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:02,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:51:02,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:02,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea60ac660ead8a389be0f HTTP/1.1" 200 None 2026-03-11 10:51:02,567 - lava_callback - ERROR - Error processing callback for node 69aea60ac660ead8a389be0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:51:42,433 - lava_callback - INFO - Received callback for node 69aea631c660ead8a389be1b INFO: 172.21.0.1:41524 - "POST /node/69aea631c660ead8a389be1b HTTP/1.0" 202 Accepted 2026-03-11 10:51:42,440 - lava_callback - INFO - Starting async job submit for node 69aea631c660ead8a389be1b 2026-03-11 10:51:42,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:42,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea631c660ead8a389be1b HTTP/1.1" 200 None 2026-03-11 10:51:42,457 - lava_callback - DEBUG - Processing node 69aea631c660ead8a389be1b: baseline-arm-baylibre 2026-03-11 10:51:42,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea631c660ead8a389be1b 2026-03-11 10:51:42,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:42,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea631c660ead8a389be1b HTTP/1.1" 200 None 2026-03-11 10:51:42,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:42,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:51:42,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:42,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea631c660ead8a389be1b HTTP/1.1" 200 None 2026-03-11 10:51:42,528 - lava_callback - ERROR - Error processing callback for node 69aea631c660ead8a389be1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:52:18,073 - lava_callback - INFO - Received callback for node 69b141c9a870a1dc3343c906 INFO: 172.21.0.1:51840 - "POST /node/69b141c9a870a1dc3343c906 HTTP/1.0" 202 Accepted 2026-03-11 10:52:18,078 - lava_callback - INFO - Starting async job submit for node 69b141c9a870a1dc3343c906 2026-03-11 10:52:18,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:52:18,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b141c9a870a1dc3343c906 HTTP/1.1" 200 None 2026-03-11 10:52:18,113 - lava_callback - DEBUG - Processing node 69b141c9a870a1dc3343c906: baseline-arm64-broonie 2026-03-11 10:52:18,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:52:18,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:52:18,346 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b141c9a870a1dc3343c906/log.txt.gz 2026-03-11 10:52:18,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:52:18,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:52:18,570 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b141c9a870a1dc3343c906/lava-logs.yaml 2026-03-11 10:52:18,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:52:18,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:52:18,717 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b141c9a870a1dc3343c906/lava_callback.json.gz 2026-03-11 10:52:18,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:52:18,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b141c9a870a1dc3343c906 HTTP/1.1" 200 None 2026-03-11 10:52:18,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:52:18,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-11 10:52:18,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:52:18,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b141c9a870a1dc3343c906 HTTP/1.1" 200 None 2026-03-11 10:52:18,847 - lava_callback - INFO - Completed processing callback for node 69b141c9a870a1dc3343c906 2026-03-11 10:52:25,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:52:25,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:53:46,481 - lava_callback - INFO - Received callback for node 69aea6adc660ead8a389be4a INFO: 172.21.0.1:44508 - "POST /node/69aea6adc660ead8a389be4a HTTP/1.0" 202 Accepted 2026-03-11 10:53:46,487 - lava_callback - INFO - Starting async job submit for node 69aea6adc660ead8a389be4a 2026-03-11 10:53:46,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:53:46,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6adc660ead8a389be4a HTTP/1.1" 200 None 2026-03-11 10:53:46,503 - lava_callback - DEBUG - Processing node 69aea6adc660ead8a389be4a: baseline-arm-clabbe 2026-03-11 10:53:46,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea6adc660ead8a389be4a 2026-03-11 10:53:46,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:53:46,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6adc660ead8a389be4a HTTP/1.1" 200 None 2026-03-11 10:53:46,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:53:46,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:53:46,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:53:46,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea6adc660ead8a389be4a HTTP/1.1" 200 None 2026-03-11 10:53:46,581 - lava_callback - ERROR - Error processing callback for node 69aea6adc660ead8a389be4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:54:26,436 - lava_callback - INFO - Received callback for node 69aea6d7c660ead8a389be5f INFO: 172.21.0.1:47506 - "POST /node/69aea6d7c660ead8a389be5f HTTP/1.0" 202 Accepted 2026-03-11 10:54:26,442 - lava_callback - INFO - Starting async job submit for node 69aea6d7c660ead8a389be5f 2026-03-11 10:54:26,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:54:26,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6d7c660ead8a389be5f HTTP/1.1" 200 None 2026-03-11 10:54:26,458 - lava_callback - DEBUG - Processing node 69aea6d7c660ead8a389be5f: baseline-arm-clabbe 2026-03-11 10:54:26,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea6d7c660ead8a389be5f 2026-03-11 10:54:26,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:54:26,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6d7c660ead8a389be5f HTTP/1.1" 200 None 2026-03-11 10:54:26,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:54:26,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:54:26,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47516 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:54:26,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea6d7c660ead8a389be5f HTTP/1.1" 200 None 2026-03-11 10:54:26,534 - lava_callback - ERROR - Error processing callback for node 69aea6d7c660ead8a389be5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:55:06,489 - lava_callback - INFO - Received callback for node 69aea6ffc660ead8a389be71 INFO: 172.21.0.1:44402 - "POST /node/69aea6ffc660ead8a389be71 HTTP/1.0" 202 Accepted 2026-03-11 10:55:06,494 - lava_callback - INFO - Starting async job submit for node 69aea6ffc660ead8a389be71 2026-03-11 10:55:06,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:55:06,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6ffc660ead8a389be71 HTTP/1.1" 200 None 2026-03-11 10:55:06,530 - lava_callback - DEBUG - Processing node 69aea6ffc660ead8a389be71: baseline-arm-clabbe 2026-03-11 10:55:06,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea6ffc660ead8a389be71 2026-03-11 10:55:06,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:55:06,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6ffc660ead8a389be71 HTTP/1.1" 200 None 2026-03-11 10:55:06,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:55:06,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:55:06,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:55:06,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea6ffc660ead8a389be71 HTTP/1.1" 200 None 2026-03-11 10:55:06,592 - lava_callback - ERROR - Error processing callback for node 69aea6ffc660ead8a389be71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:57:06,594 - lava_callback - INFO - Received callback for node 69aea771c660ead8a389be8b INFO: 172.21.0.1:60814 - "POST /node/69aea771c660ead8a389be8b HTTP/1.0" 202 Accepted 2026-03-11 10:57:06,600 - lava_callback - INFO - Starting async job submit for node 69aea771c660ead8a389be8b 2026-03-11 10:57:06,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:06,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea771c660ead8a389be8b HTTP/1.1" 200 None 2026-03-11 10:57:06,641 - lava_callback - DEBUG - Processing node 69aea771c660ead8a389be8b: baseline-arm-clabbe 2026-03-11 10:57:06,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea771c660ead8a389be8b 2026-03-11 10:57:06,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:06,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea771c660ead8a389be8b HTTP/1.1" 200 None 2026-03-11 10:57:06,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:06,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:57:06,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:06,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea771c660ead8a389be8b HTTP/1.1" 200 None 2026-03-11 10:57:06,749 - lava_callback - ERROR - Error processing callback for node 69aea771c660ead8a389be8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:57:46,662 - lava_callback - INFO - Received callback for node 69aea799c660ead8a389be9a INFO: 172.21.0.1:44708 - "POST /node/69aea799c660ead8a389be9a HTTP/1.0" 202 Accepted 2026-03-11 10:57:46,667 - lava_callback - INFO - Starting async job submit for node 69aea799c660ead8a389be9a 2026-03-11 10:57:46,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:46,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea799c660ead8a389be9a HTTP/1.1" 200 None 2026-03-11 10:57:46,705 - lava_callback - DEBUG - Processing node 69aea799c660ead8a389be9a: baseline-arm-clabbe 2026-03-11 10:57:46,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea799c660ead8a389be9a 2026-03-11 10:57:46,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:46,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea799c660ead8a389be9a HTTP/1.1" 200 None 2026-03-11 10:57:46,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:46,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:57:46,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:46,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea799c660ead8a389be9a HTTP/1.1" 200 None 2026-03-11 10:57:46,775 - lava_callback - ERROR - Error processing callback for node 69aea799c660ead8a389be9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43418 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:58:17,104 - lava_callback - INFO - Received callback for node 69b14623a870a1dc3343c950 INFO: 172.21.0.1:43432 - "POST /node/69b14623a870a1dc3343c950 HTTP/1.0" 202 Accepted 2026-03-11 10:58:17,112 - lava_callback - INFO - Starting async job submit for node 69b14623a870a1dc3343c950 2026-03-11 10:58:17,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:58:17,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14623a870a1dc3343c950 HTTP/1.1" 200 None 2026-03-11 10:58:17,189 - lava_callback - DEBUG - Processing node 69b14623a870a1dc3343c950: baseline-nfs-arm64 2026-03-11 10:58:18,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:58:18,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:58:18,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14623a870a1dc3343c950/log.txt.gz 2026-03-11 10:58:19,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:58:19,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:58:19,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14623a870a1dc3343c950/lava-logs.yaml 2026-03-11 10:58:19,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:58:19,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:58:19,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14623a870a1dc3343c950/lava_callback.json.gz DEBUG: Setup failed for 69b14623a870a1dc3343c950. Transitting job node result: incomplete -> fail 2026-03-11 10:58:19,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:58:19,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14623a870a1dc3343c950 HTTP/1.1" 200 None 2026-03-11 10:58:19,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:58:19,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:58:19,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:58:19,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b14623a870a1dc3343c950 HTTP/1.1" 200 None 2026-03-11 10:58:19,862 - lava_callback - INFO - Completed processing callback for node 69b14623a870a1dc3343c950 2026-03-11 10:58:25,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:58:26,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:08:43,703 - lava_callback - INFO - Received callback for node 69aeaa28c660ead8a389bf2f INFO: 172.21.0.1:52578 - "POST /node/69aeaa28c660ead8a389bf2f HTTP/1.0" 202 Accepted 2026-03-11 11:08:43,709 - lava_callback - INFO - Starting async job submit for node 69aeaa28c660ead8a389bf2f 2026-03-11 11:08:43,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:08:43,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaa28c660ead8a389bf2f HTTP/1.1" 200 None 2026-03-11 11:08:43,740 - lava_callback - DEBUG - Processing node 69aeaa28c660ead8a389bf2f: baseline-arm64-baylibre 2026-03-11 11:08:43,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeaa28c660ead8a389bf2f 2026-03-11 11:08:43,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:08:43,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaa28c660ead8a389bf2f HTTP/1.1" 200 None 2026-03-11 11:08:43,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:08:43,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:08:43,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:08:43,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeaa28c660ead8a389bf2f HTTP/1.1" 200 None 2026-03-11 11:08:43,829 - lava_callback - ERROR - Error processing callback for node 69aeaa28c660ead8a389bf2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:10:47,171 - lava_callback - INFO - Received callback for node 69aeaaa6c660ead8a389bf3a INFO: 172.21.0.1:59138 - "POST /node/69aeaaa6c660ead8a389bf3a HTTP/1.0" 202 Accepted 2026-03-11 11:10:47,177 - lava_callback - INFO - Starting async job submit for node 69aeaaa6c660ead8a389bf3a 2026-03-11 11:10:47,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:10:47,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaaa6c660ead8a389bf3a HTTP/1.1" 200 None 2026-03-11 11:10:47,199 - lava_callback - DEBUG - Processing node 69aeaaa6c660ead8a389bf3a: baseline-arm64-clabbe 2026-03-11 11:10:47,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeaaa6c660ead8a389bf3a 2026-03-11 11:10:47,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:10:47,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaaa6c660ead8a389bf3a HTTP/1.1" 200 None 2026-03-11 11:10:47,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:10:47,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:10:47,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:10:47,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeaaa6c660ead8a389bf3a HTTP/1.1" 200 None 2026-03-11 11:10:47,284 - lava_callback - ERROR - Error processing callback for node 69aeaaa6c660ead8a389bf3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:12:07,204 - lava_callback - INFO - Received callback for node 69aeaaf6c660ead8a389bf47 INFO: 172.21.0.1:49334 - "POST /node/69aeaaf6c660ead8a389bf47 HTTP/1.0" 202 Accepted 2026-03-11 11:12:07,210 - lava_callback - INFO - Starting async job submit for node 69aeaaf6c660ead8a389bf47 2026-03-11 11:12:07,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:12:07,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaaf6c660ead8a389bf47 HTTP/1.1" 200 None 2026-03-11 11:12:07,236 - lava_callback - DEBUG - Processing node 69aeaaf6c660ead8a389bf47: baseline-arm64-clabbe 2026-03-11 11:12:07,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeaaf6c660ead8a389bf47 2026-03-11 11:12:07,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:12:07,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaaf6c660ead8a389bf47 HTTP/1.1" 200 None 2026-03-11 11:12:07,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:12:07,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:12:07,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:12:07,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeaaf6c660ead8a389bf47 HTTP/1.1" 200 None 2026-03-11 11:12:07,304 - lava_callback - ERROR - Error processing callback for node 69aeaaf6c660ead8a389bf47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:13:27,233 - lava_callback - INFO - Received callback for node 69aeab46c660ead8a389bf54 INFO: 172.21.0.1:44894 - "POST /node/69aeab46c660ead8a389bf54 HTTP/1.0" 202 Accepted 2026-03-11 11:13:27,238 - lava_callback - INFO - Starting async job submit for node 69aeab46c660ead8a389bf54 2026-03-11 11:13:27,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:13:27,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeab46c660ead8a389bf54 HTTP/1.1" 200 None 2026-03-11 11:13:27,259 - lava_callback - DEBUG - Processing node 69aeab46c660ead8a389bf54: baseline-arm64-clabbe 2026-03-11 11:13:27,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeab46c660ead8a389bf54 2026-03-11 11:13:27,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:13:27,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeab46c660ead8a389bf54 HTTP/1.1" 200 None 2026-03-11 11:13:27,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:13:27,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:13:27,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:13:27,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeab46c660ead8a389bf54 HTTP/1.1" 200 None 2026-03-11 11:13:27,339 - lava_callback - ERROR - Error processing callback for node 69aeab46c660ead8a389bf54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:14:47,307 - lava_callback - INFO - Received callback for node 69aeab96c660ead8a389bf5b INFO: 172.21.0.1:58850 - "POST /node/69aeab96c660ead8a389bf5b HTTP/1.0" 202 Accepted 2026-03-11 11:14:47,315 - lava_callback - INFO - Starting async job submit for node 69aeab96c660ead8a389bf5b 2026-03-11 11:14:47,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:14:47,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeab96c660ead8a389bf5b HTTP/1.1" 200 None 2026-03-11 11:14:47,338 - lava_callback - DEBUG - Processing node 69aeab96c660ead8a389bf5b: baseline-arm64-clabbe 2026-03-11 11:14:47,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeab96c660ead8a389bf5b 2026-03-11 11:14:47,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:14:47,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeab96c660ead8a389bf5b HTTP/1.1" 200 None 2026-03-11 11:14:47,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:14:47,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:14:47,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:14:47,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeab96c660ead8a389bf5b HTTP/1.1" 200 None 2026-03-11 11:14:47,439 - lava_callback - ERROR - Error processing callback for node 69aeab96c660ead8a389bf5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:16:07,374 - lava_callback - INFO - Received callback for node 69aeabe6c660ead8a389bf6b INFO: 172.21.0.1:32978 - "POST /node/69aeabe6c660ead8a389bf6b HTTP/1.0" 202 Accepted 2026-03-11 11:16:07,379 - lava_callback - INFO - Starting async job submit for node 69aeabe6c660ead8a389bf6b 2026-03-11 11:16:07,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:16:07,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeabe6c660ead8a389bf6b HTTP/1.1" 200 None 2026-03-11 11:16:07,397 - lava_callback - DEBUG - Processing node 69aeabe6c660ead8a389bf6b: baseline-arm64-clabbe 2026-03-11 11:16:07,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeabe6c660ead8a389bf6b 2026-03-11 11:16:07,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:16:07,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeabe6c660ead8a389bf6b HTTP/1.1" 200 None 2026-03-11 11:16:07,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:16:07,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:16:07,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:16:07,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeabe6c660ead8a389bf6b HTTP/1.1" 200 None 2026-03-11 11:16:07,467 - lava_callback - ERROR - Error processing callback for node 69aeabe6c660ead8a389bf6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52148 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:18:16,971 - lava_callback - INFO - Received callback for node 69b14ad5a870a1dc3343c987 INFO: 172.21.0.1:52162 - "POST /node/69b14ad5a870a1dc3343c987 HTTP/1.0" 202 Accepted 2026-03-11 11:18:16,979 - lava_callback - INFO - Starting async job submit for node 69b14ad5a870a1dc3343c987 2026-03-11 11:18:17,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:18:17,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14ad5a870a1dc3343c987 HTTP/1.1" 200 None 2026-03-11 11:18:17,047 - lava_callback - DEBUG - Processing node 69b14ad5a870a1dc3343c987: baseline-nfs-arm64 2026-03-11 11:18:18,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 11:18:18,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 11:18:18,340 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14ad5a870a1dc3343c987/log.txt.gz 2026-03-11 11:18:18,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 11:18:19,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 11:18:19,218 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14ad5a870a1dc3343c987/lava-logs.yaml 2026-03-11 11:18:19,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 11:18:19,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 11:18:19,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14ad5a870a1dc3343c987/lava_callback.json.gz DEBUG: Setup failed for 69b14ad5a870a1dc3343c987. Transitting job node result: incomplete -> fail 2026-03-11 11:18:19,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:18:19,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14ad5a870a1dc3343c987 HTTP/1.1" 200 None 2026-03-11 11:18:19,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:18:19,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 11:18:19,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:18:19,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b14ad5a870a1dc3343c987 HTTP/1.1" 200 None 2026-03-11 11:18:19,721 - lava_callback - INFO - Completed processing callback for node 69b14ad5a870a1dc3343c987 2026-03-11 11:18:26,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:18:26,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:34:20,256 - lava_callback - INFO - Received callback for node 69b13c6da870a1dc3343c5cd INFO: 172.21.0.1:58378 - "POST /node/69b13c6da870a1dc3343c5cd HTTP/1.0" 202 Accepted 2026-03-11 12:34:20,263 - lava_callback - INFO - Starting async job submit for node 69b13c6da870a1dc3343c5cd 2026-03-11 12:34:20,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:34:20,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6da870a1dc3343c5cd HTTP/1.1" 200 None 2026-03-11 12:34:20,357 - lava_callback - DEBUG - Processing node 69b13c6da870a1dc3343c5cd: baseline-arm64 2026-03-11 12:34:20,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:34:20,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:34:20,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6da870a1dc3343c5cd/log.txt.gz 2026-03-11 12:34:20,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:34:21,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:34:21,115 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6da870a1dc3343c5cd/lava-logs.yaml 2026-03-11 12:34:21,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:34:21,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:34:21,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6da870a1dc3343c5cd/lava_callback.json.gz 2026-03-11 12:34:21,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:34:21,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6da870a1dc3343c5cd HTTP/1.1" 200 None 2026-03-11 12:34:21,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:34:21,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 12:34:21,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:34:21,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c6da870a1dc3343c5cd HTTP/1.1" 200 None 2026-03-11 12:34:21,351 - lava_callback - INFO - Completed processing callback for node 69b13c6da870a1dc3343c5cd 2026-03-11 12:34:26,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:34:26,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:35:27,923 - lava_callback - INFO - Received callback for node 69b13c81a870a1dc3343c605 INFO: 172.21.0.1:48130 - "POST /node/69b13c81a870a1dc3343c605 HTTP/1.0" 202 Accepted 2026-03-11 12:35:27,929 - lava_callback - INFO - Starting async job submit for node 69b13c81a870a1dc3343c605 2026-03-11 12:35:27,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:35:27,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c81a870a1dc3343c605 HTTP/1.1" 200 None 2026-03-11 12:35:27,973 - lava_callback - DEBUG - Processing node 69b13c81a870a1dc3343c605: baseline-nfs-arm64 2026-03-11 12:35:28,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:35:28,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:35:28,427 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c81a870a1dc3343c605/log.txt.gz 2026-03-11 12:35:28,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:35:28,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:35:28,859 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c81a870a1dc3343c605/lava-logs.yaml 2026-03-11 12:35:28,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:35:29,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:35:29,024 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c81a870a1dc3343c605/lava_callback.json.gz 2026-03-11 12:35:29,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:35:29,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c81a870a1dc3343c605 HTTP/1.1" 200 None 2026-03-11 12:35:29,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:35:29,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 12:35:29,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:35:29,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c81a870a1dc3343c605 HTTP/1.1" 200 None 2026-03-11 12:35:29,803 - lava_callback - INFO - Completed processing callback for node 69b13c81a870a1dc3343c605 INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58766 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:35:56,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:35:56,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34698 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:46:48,846 - lava_callback - INFO - Received callback for node 69aec12ffeb96b28aa34ac37 INFO: 172.21.0.1:34702 - "POST /node/69aec12ffeb96b28aa34ac37 HTTP/1.0" 202 Accepted 2026-03-11 12:46:48,852 - lava_callback - INFO - Starting async job submit for node 69aec12ffeb96b28aa34ac37 2026-03-11 12:46:48,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:46:48,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec12ffeb96b28aa34ac37 HTTP/1.1" 200 None 2026-03-11 12:46:48,874 - lava_callback - DEBUG - Processing node 69aec12ffeb96b28aa34ac37: baseline-arm-baylibre 2026-03-11 12:46:48,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec12ffeb96b28aa34ac37 2026-03-11 12:46:48,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:46:48,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec12ffeb96b28aa34ac37 HTTP/1.1" 200 None 2026-03-11 12:46:48,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:46:48,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:46:48,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:46:48,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec12ffeb96b28aa34ac37 HTTP/1.1" 200 None 2026-03-11 12:46:48,939 - lava_callback - ERROR - Error processing callback for node 69aec12ffeb96b28aa34ac37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39110 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:47:28,759 - lava_callback - INFO - Received callback for node 69aec15afeb96b28aa34ac52 INFO: 172.21.0.1:39112 - "POST /node/69aec15afeb96b28aa34ac52 HTTP/1.0" 202 Accepted 2026-03-11 12:47:28,765 - lava_callback - INFO - Starting async job submit for node 69aec15afeb96b28aa34ac52 2026-03-11 12:47:28,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:28,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec15afeb96b28aa34ac52 HTTP/1.1" 200 None 2026-03-11 12:47:28,780 - lava_callback - DEBUG - Processing node 69aec15afeb96b28aa34ac52: baseline-arm-baylibre 2026-03-11 12:47:28,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec15afeb96b28aa34ac52 2026-03-11 12:47:28,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:28,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec15afeb96b28aa34ac52 HTTP/1.1" 200 None 2026-03-11 12:47:28,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:28,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:47:28,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:28,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec15afeb96b28aa34ac52 HTTP/1.1" 200 None 2026-03-11 12:47:28,840 - lava_callback - ERROR - Error processing callback for node 69aec15afeb96b28aa34ac52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48100 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:47:48,788 - lava_callback - INFO - Received callback for node 69aec164feb96b28aa34ac73 INFO: 172.21.0.1:48108 - "POST /node/69aec164feb96b28aa34ac73 HTTP/1.0" 202 Accepted 2026-03-11 12:47:48,793 - lava_callback - INFO - Starting async job submit for node 69aec164feb96b28aa34ac73 2026-03-11 12:47:48,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:48,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec164feb96b28aa34ac73 HTTP/1.1" 200 None 2026-03-11 12:47:48,818 - lava_callback - DEBUG - Processing node 69aec164feb96b28aa34ac73: baseline-arm-baylibre 2026-03-11 12:47:48,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec164feb96b28aa34ac73 2026-03-11 12:47:48,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:48,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec164feb96b28aa34ac73 HTTP/1.1" 200 None 2026-03-11 12:47:48,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:48,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:48,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:48,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec164feb96b28aa34ac73 HTTP/1.1" 200 None 2026-03-11 12:47:48,900 - lava_callback - ERROR - Error processing callback for node 69aec164feb96b28aa34ac73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:47:49,432 - lava_callback - INFO - Received callback for node 69aec166feb96b28aa34aca1 INFO: 172.21.0.1:48122 - "POST /node/69aec166feb96b28aa34aca1 HTTP/1.0" 202 Accepted 2026-03-11 12:47:49,438 - lava_callback - INFO - Starting async job submit for node 69aec166feb96b28aa34aca1 2026-03-11 12:47:49,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:49,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec166feb96b28aa34aca1 HTTP/1.1" 200 None 2026-03-11 12:47:49,453 - lava_callback - DEBUG - Processing node 69aec166feb96b28aa34aca1: baseline-arm-baylibre 2026-03-11 12:47:49,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec166feb96b28aa34aca1 2026-03-11 12:47:49,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:49,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec166feb96b28aa34aca1 HTTP/1.1" 200 None 2026-03-11 12:47:49,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:49,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:49,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:49,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec166feb96b28aa34aca1 HTTP/1.1" 200 None 2026-03-11 12:47:49,531 - lava_callback - ERROR - Error processing callback for node 69aec166feb96b28aa34aca1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:47:50,226 - lava_callback - INFO - Received callback for node 69aec167feb96b28aa34aca4 INFO: 172.21.0.1:57650 - "POST /node/69aec167feb96b28aa34aca4 HTTP/1.0" 202 Accepted 2026-03-11 12:47:50,231 - lava_callback - INFO - Starting async job submit for node 69aec167feb96b28aa34aca4 2026-03-11 12:47:50,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec167feb96b28aa34aca4 HTTP/1.1" 200 None 2026-03-11 12:47:50,247 - lava_callback - DEBUG - Processing node 69aec167feb96b28aa34aca4: baseline-arm-baylibre 2026-03-11 12:47:50,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec167feb96b28aa34aca4 2026-03-11 12:47:50,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec167feb96b28aa34aca4 HTTP/1.1" 200 None 2026-03-11 12:47:50,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:50,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec167feb96b28aa34aca4 HTTP/1.1" 200 None 2026-03-11 12:47:50,305 - lava_callback - ERROR - Error processing callback for node 69aec167feb96b28aa34aca4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:47:50,896 - lava_callback - INFO - Received callback for node 69aec16afeb96b28aa34acaf INFO: 172.21.0.1:57654 - "POST /node/69aec16afeb96b28aa34acaf HTTP/1.0" 202 Accepted 2026-03-11 12:47:50,902 - lava_callback - INFO - Starting async job submit for node 69aec16afeb96b28aa34acaf 2026-03-11 12:47:50,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec16afeb96b28aa34acaf HTTP/1.1" 200 None 2026-03-11 12:47:50,918 - lava_callback - DEBUG - Processing node 69aec16afeb96b28aa34acaf: baseline-arm-baylibre 2026-03-11 12:47:50,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec16afeb96b28aa34acaf 2026-03-11 12:47:50,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec16afeb96b28aa34acaf HTTP/1.1" 200 None 2026-03-11 12:47:50,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:50,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec16afeb96b28aa34acaf HTTP/1.1" 200 None 2026-03-11 12:47:50,978 - lava_callback - ERROR - Error processing callback for node 69aec16afeb96b28aa34acaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:47:51,354 - lava_callback - INFO - Received callback for node 69aec173feb96b28aa34acc6 INFO: 172.21.0.1:57668 - "POST /node/69aec173feb96b28aa34acc6 HTTP/1.0" 202 Accepted 2026-03-11 12:47:51,360 - lava_callback - INFO - Starting async job submit for node 69aec173feb96b28aa34acc6 2026-03-11 12:47:51,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec173feb96b28aa34acc6 HTTP/1.1" 200 None 2026-03-11 12:47:51,379 - lava_callback - DEBUG - Processing node 69aec173feb96b28aa34acc6: baseline-arm-clabbe 2026-03-11 12:47:51,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec173feb96b28aa34acc6 2026-03-11 12:47:51,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec173feb96b28aa34acc6 HTTP/1.1" 200 None 2026-03-11 12:47:51,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:51,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec173feb96b28aa34acc6 HTTP/1.1" 200 None 2026-03-11 12:47:51,446 - lava_callback - ERROR - Error processing callback for node 69aec173feb96b28aa34acc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:47:51,544 - lava_callback - INFO - Received callback for node 69aec16cfeb96b28aa34acb2 INFO: 172.21.0.1:57676 - "POST /node/69aec16cfeb96b28aa34acb2 HTTP/1.0" 202 Accepted 2026-03-11 12:47:51,563 - lava_callback - INFO - Starting async job submit for node 69aec16cfeb96b28aa34acb2 2026-03-11 12:47:51,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec16cfeb96b28aa34acb2 HTTP/1.1" 200 None 2026-03-11 12:47:51,584 - lava_callback - DEBUG - Processing node 69aec16cfeb96b28aa34acb2: baseline-arm-baylibre 2026-03-11 12:47:51,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec16cfeb96b28aa34acb2 2026-03-11 12:47:51,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec16cfeb96b28aa34acb2 HTTP/1.1" 200 None 2026-03-11 12:47:51,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:51,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec16cfeb96b28aa34acb2 HTTP/1.1" 200 None 2026-03-11 12:47:51,640 - lava_callback - ERROR - Error processing callback for node 69aec16cfeb96b28aa34acb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:48:08,781 - lava_callback - INFO - Received callback for node 69aec184feb96b28aa34ad40 INFO: 172.21.0.1:56178 - "POST /node/69aec184feb96b28aa34ad40 HTTP/1.0" 202 Accepted 2026-03-11 12:48:08,786 - lava_callback - INFO - Starting async job submit for node 69aec184feb96b28aa34ad40 2026-03-11 12:48:08,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:08,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec184feb96b28aa34ad40 HTTP/1.1" 200 None 2026-03-11 12:48:08,804 - lava_callback - DEBUG - Processing node 69aec184feb96b28aa34ad40: baseline-arm-baylibre 2026-03-11 12:48:08,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec184feb96b28aa34ad40 2026-03-11 12:48:08,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:08,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec184feb96b28aa34ad40 HTTP/1.1" 200 None 2026-03-11 12:48:08,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:08,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:48:08,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:08,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec184feb96b28aa34ad40 HTTP/1.1" 200 None 2026-03-11 12:48:08,862 - lava_callback - ERROR - Error processing callback for node 69aec184feb96b28aa34ad40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:48:11,290 - lava_callback - INFO - Received callback for node 69aec178feb96b28aa34acd3 INFO: 172.21.0.1:41812 - "POST /node/69aec178feb96b28aa34acd3 HTTP/1.0" 202 Accepted 2026-03-11 12:48:11,296 - lava_callback - INFO - Starting async job submit for node 69aec178feb96b28aa34acd3 2026-03-11 12:48:11,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec178feb96b28aa34acd3 HTTP/1.1" 200 None 2026-03-11 12:48:11,312 - lava_callback - DEBUG - Processing node 69aec178feb96b28aa34acd3: baseline-arm-clabbe 2026-03-11 12:48:11,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec178feb96b28aa34acd3 2026-03-11 12:48:11,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec178feb96b28aa34acd3 HTTP/1.1" 200 None 2026-03-11 12:48:11,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:48:11,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec178feb96b28aa34acd3 HTTP/1.1" 200 None 2026-03-11 12:48:11,366 - lava_callback - ERROR - Error processing callback for node 69aec178feb96b28aa34acd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:48:11,945 - lava_callback - INFO - Received callback for node 69aec178feb96b28aa34acd6 INFO: 172.21.0.1:41828 - "POST /node/69aec178feb96b28aa34acd6 HTTP/1.0" 202 Accepted 2026-03-11 12:48:11,950 - lava_callback - INFO - Starting async job submit for node 69aec178feb96b28aa34acd6 2026-03-11 12:48:11,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec178feb96b28aa34acd6 HTTP/1.1" 200 None 2026-03-11 12:48:11,967 - lava_callback - DEBUG - Processing node 69aec178feb96b28aa34acd6: baseline-arm-clabbe 2026-03-11 12:48:11,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec178feb96b28aa34acd6 2026-03-11 12:48:11,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec178feb96b28aa34acd6 HTTP/1.1" 200 None 2026-03-11 12:48:11,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:48:11,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:12,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec178feb96b28aa34acd6 HTTP/1.1" 200 None 2026-03-11 12:48:12,024 - lava_callback - ERROR - Error processing callback for node 69aec178feb96b28aa34acd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:48:12,593 - lava_callback - INFO - Received callback for node 69aec179feb96b28aa34acd9 INFO: 172.21.0.1:41836 - "POST /node/69aec179feb96b28aa34acd9 HTTP/1.0" 202 Accepted 2026-03-11 12:48:12,599 - lava_callback - INFO - Starting async job submit for node 69aec179feb96b28aa34acd9 2026-03-11 12:48:12,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:12,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec179feb96b28aa34acd9 HTTP/1.1" 200 None 2026-03-11 12:48:12,615 - lava_callback - DEBUG - Processing node 69aec179feb96b28aa34acd9: baseline-arm-clabbe 2026-03-11 12:48:12,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec179feb96b28aa34acd9 2026-03-11 12:48:12,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:12,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec179feb96b28aa34acd9 HTTP/1.1" 200 None 2026-03-11 12:48:12,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:12,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:48:12,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:12,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec179feb96b28aa34acd9 HTTP/1.1" 200 None 2026-03-11 12:48:12,669 - lava_callback - ERROR - Error processing callback for node 69aec179feb96b28aa34acd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:48:13,249 - lava_callback - INFO - Received callback for node 69aec17cfeb96b28aa34ad14 INFO: 172.21.0.1:41840 - "POST /node/69aec17cfeb96b28aa34ad14 HTTP/1.0" 202 Accepted 2026-03-11 12:48:13,254 - lava_callback - INFO - Starting async job submit for node 69aec17cfeb96b28aa34ad14 2026-03-11 12:48:13,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:13,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec17cfeb96b28aa34ad14 HTTP/1.1" 200 None 2026-03-11 12:48:13,270 - lava_callback - DEBUG - Processing node 69aec17cfeb96b28aa34ad14: baseline-arm-clabbe 2026-03-11 12:48:13,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec17cfeb96b28aa34ad14 2026-03-11 12:48:13,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:13,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec17cfeb96b28aa34ad14 HTTP/1.1" 200 None 2026-03-11 12:48:13,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:13,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:48:13,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:13,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec17cfeb96b28aa34ad14 HTTP/1.1" 200 None 2026-03-11 12:48:13,328 - lava_callback - ERROR - Error processing callback for node 69aec17cfeb96b28aa34ad14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:49:49,470 - lava_callback - INFO - Received callback for node 69aec1ebfeb96b28aa34adfd INFO: 172.21.0.1:52494 - "POST /node/69aec1ebfeb96b28aa34adfd HTTP/1.0" 202 Accepted 2026-03-11 12:49:49,475 - lava_callback - INFO - Starting async job submit for node 69aec1ebfeb96b28aa34adfd 2026-03-11 12:49:49,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:49:49,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec1ebfeb96b28aa34adfd HTTP/1.1" 200 None 2026-03-11 12:49:49,492 - lava_callback - DEBUG - Processing node 69aec1ebfeb96b28aa34adfd: baseline-arm-baylibre 2026-03-11 12:49:49,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec1ebfeb96b28aa34adfd 2026-03-11 12:49:49,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:49:49,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec1ebfeb96b28aa34adfd HTTP/1.1" 200 None 2026-03-11 12:49:49,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:49:49,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:49:49,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:49:49,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec1ebfeb96b28aa34adfd HTTP/1.1" 200 None 2026-03-11 12:49:49,548 - lava_callback - ERROR - Error processing callback for node 69aec1ebfeb96b28aa34adfd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:55:29,188 - lava_callback - INFO - Received callback for node 69aec32dfeb96b28aa34afdf INFO: 172.21.0.1:39056 - "POST /node/69aec32dfeb96b28aa34afdf HTTP/1.0" 202 Accepted 2026-03-11 12:55:29,194 - lava_callback - INFO - Starting async job submit for node 69aec32dfeb96b28aa34afdf 2026-03-11 12:55:29,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:55:29,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec32dfeb96b28aa34afdf HTTP/1.1" 200 None 2026-03-11 12:55:29,211 - lava_callback - DEBUG - Processing node 69aec32dfeb96b28aa34afdf: baseline-arm-baylibre 2026-03-11 12:55:29,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec32dfeb96b28aa34afdf 2026-03-11 12:55:29,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:55:29,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec32dfeb96b28aa34afdf HTTP/1.1" 200 None 2026-03-11 12:55:29,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:55:29,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:55:29,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:55:29,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec32dfeb96b28aa34afdf HTTP/1.1" 200 None 2026-03-11 12:55:29,277 - lava_callback - ERROR - Error processing callback for node 69aec32dfeb96b28aa34afdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35070 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:58:51,796 - lava_callback - INFO - Received callback for node 69aec3f5feb96b28aa34b0be INFO: 172.21.0.1:48314 - "POST /node/69aec3f5feb96b28aa34b0be HTTP/1.0" 202 Accepted 2026-03-11 12:58:51,801 - lava_callback - INFO - Starting async job submit for node 69aec3f5feb96b28aa34b0be 2026-03-11 12:58:51,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:58:51,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec3f5feb96b28aa34b0be HTTP/1.1" 200 None 2026-03-11 12:58:51,822 - lava_callback - DEBUG - Processing node 69aec3f5feb96b28aa34b0be: baseline-arm-clabbe 2026-03-11 12:58:51,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec3f5feb96b28aa34b0be 2026-03-11 12:58:51,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:58:51,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec3f5feb96b28aa34b0be HTTP/1.1" 200 None 2026-03-11 12:58:51,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:58:51,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:58:51,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:58:51,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec3f5feb96b28aa34b0be HTTP/1.1" 200 None 2026-03-11 12:58:51,875 - lava_callback - ERROR - Error processing callback for node 69aec3f5feb96b28aa34b0be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:59:31,802 - lava_callback - INFO - Received callback for node 69aec41efeb96b28aa34b10f INFO: 172.21.0.1:43904 - "POST /node/69aec41efeb96b28aa34b10f HTTP/1.0" 202 Accepted 2026-03-11 12:59:31,808 - lava_callback - INFO - Starting async job submit for node 69aec41efeb96b28aa34b10f 2026-03-11 12:59:31,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:59:31,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec41efeb96b28aa34b10f HTTP/1.1" 200 None 2026-03-11 12:59:31,825 - lava_callback - DEBUG - Processing node 69aec41efeb96b28aa34b10f: baseline-arm-clabbe 2026-03-11 12:59:31,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec41efeb96b28aa34b10f 2026-03-11 12:59:31,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:59:31,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec41efeb96b28aa34b10f HTTP/1.1" 200 None 2026-03-11 12:59:31,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:59:31,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:59:31,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:59:31,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec41efeb96b28aa34b10f HTTP/1.1" 200 None 2026-03-11 12:59:31,893 - lava_callback - ERROR - Error processing callback for node 69aec41efeb96b28aa34b10f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:00:12,049 - lava_callback - INFO - Received callback for node 69aec446feb96b28aa34b135 INFO: 172.21.0.1:36508 - "POST /node/69aec446feb96b28aa34b135 HTTP/1.0" 202 Accepted 2026-03-11 13:00:12,055 - lava_callback - INFO - Starting async job submit for node 69aec446feb96b28aa34b135 2026-03-11 13:00:12,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:00:12,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec446feb96b28aa34b135 HTTP/1.1" 200 None 2026-03-11 13:00:12,071 - lava_callback - DEBUG - Processing node 69aec446feb96b28aa34b135: baseline-arm-clabbe 2026-03-11 13:00:12,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec446feb96b28aa34b135 2026-03-11 13:00:12,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:00:12,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec446feb96b28aa34b135 HTTP/1.1" 200 None 2026-03-11 13:00:12,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:00:12,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 13:00:12,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:00:12,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec446feb96b28aa34b135 HTTP/1.1" 200 None 2026-03-11 13:00:12,143 - lava_callback - ERROR - Error processing callback for node 69aec446feb96b28aa34b135: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:01:49,638 - lava_callback - INFO - Received callback for node 69aec4b5feb96b28aa34b1d0 INFO: 172.21.0.1:52660 - "POST /node/69aec4b5feb96b28aa34b1d0 HTTP/1.0" 202 Accepted 2026-03-11 13:01:49,644 - lava_callback - INFO - Starting async job submit for node 69aec4b5feb96b28aa34b1d0 2026-03-11 13:01:49,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:01:49,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec4b5feb96b28aa34b1d0 HTTP/1.1" 200 None 2026-03-11 13:01:49,659 - lava_callback - DEBUG - Processing node 69aec4b5feb96b28aa34b1d0: baseline-arm-baylibre 2026-03-11 13:01:49,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec4b5feb96b28aa34b1d0 2026-03-11 13:01:49,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:01:49,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec4b5feb96b28aa34b1d0 HTTP/1.1" 200 None 2026-03-11 13:01:49,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:01:49,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:01:49,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:01:49,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec4b5feb96b28aa34b1d0 HTTP/1.1" 200 None 2026-03-11 13:01:49,724 - lava_callback - ERROR - Error processing callback for node 69aec4b5feb96b28aa34b1d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:02:31,978 - lava_callback - INFO - Received callback for node 69aec4e1feb96b28aa34b1ef INFO: 172.21.0.1:33590 - "POST /node/69aec4e1feb96b28aa34b1ef HTTP/1.0" 202 Accepted 2026-03-11 13:02:31,983 - lava_callback - INFO - Starting async job submit for node 69aec4e1feb96b28aa34b1ef 2026-03-11 13:02:31,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:02:32,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec4e1feb96b28aa34b1ef HTTP/1.1" 200 None 2026-03-11 13:02:32,018 - lava_callback - DEBUG - Processing node 69aec4e1feb96b28aa34b1ef: baseline-arm-clabbe 2026-03-11 13:02:32,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec4e1feb96b28aa34b1ef 2026-03-11 13:02:32,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:02:32,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec4e1feb96b28aa34b1ef HTTP/1.1" 200 None 2026-03-11 13:02:32,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:02:32,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 13:02:32,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:02:32,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec4e1feb96b28aa34b1ef HTTP/1.1" 200 None 2026-03-11 13:02:32,072 - lava_callback - ERROR - Error processing callback for node 69aec4e1feb96b28aa34b1ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44134 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:03:09,611 - lava_callback - INFO - Received callback for node 69aec503feb96b28aa34b215 INFO: 172.21.0.1:44148 - "POST /node/69aec503feb96b28aa34b215 HTTP/1.0" 202 Accepted 2026-03-11 13:03:09,616 - lava_callback - INFO - Starting async job submit for node 69aec503feb96b28aa34b215 2026-03-11 13:03:09,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:03:09,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec503feb96b28aa34b215 HTTP/1.1" 200 None 2026-03-11 13:03:09,633 - lava_callback - DEBUG - Processing node 69aec503feb96b28aa34b215: baseline-arm-baylibre 2026-03-11 13:03:09,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec503feb96b28aa34b215 2026-03-11 13:03:09,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:03:09,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec503feb96b28aa34b215 HTTP/1.1" 200 None 2026-03-11 13:03:09,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:03:09,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:03:09,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:03:09,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec503feb96b28aa34b215 HTTP/1.1" 200 None 2026-03-11 13:03:09,684 - lava_callback - ERROR - Error processing callback for node 69aec503feb96b28aa34b215: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:04:32,044 - lava_callback - INFO - Received callback for node 69aec555feb96b28aa34b291 INFO: 172.21.0.1:40300 - "POST /node/69aec555feb96b28aa34b291 HTTP/1.0" 202 Accepted 2026-03-11 13:04:32,049 - lava_callback - INFO - Starting async job submit for node 69aec555feb96b28aa34b291 2026-03-11 13:04:32,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:04:32,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec555feb96b28aa34b291 HTTP/1.1" 200 None 2026-03-11 13:04:32,081 - lava_callback - DEBUG - Processing node 69aec555feb96b28aa34b291: baseline-arm-clabbe 2026-03-11 13:04:32,081 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec555feb96b28aa34b291 2026-03-11 13:04:32,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:04:32,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec555feb96b28aa34b291 HTTP/1.1" 200 None 2026-03-11 13:04:32,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:04:32,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 13:04:32,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:04:32,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec555feb96b28aa34b291 HTTP/1.1" 200 None 2026-03-11 13:04:32,138 - lava_callback - ERROR - Error processing callback for node 69aec555feb96b28aa34b291: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:05:49,782 - lava_callback - INFO - Received callback for node 69aec59efeb96b28aa34b30d INFO: 172.21.0.1:36930 - "POST /node/69aec59efeb96b28aa34b30d HTTP/1.0" 202 Accepted 2026-03-11 13:05:49,788 - lava_callback - INFO - Starting async job submit for node 69aec59efeb96b28aa34b30d 2026-03-11 13:05:49,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:05:49,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec59efeb96b28aa34b30d HTTP/1.1" 200 None 2026-03-11 13:05:49,804 - lava_callback - DEBUG - Processing node 69aec59efeb96b28aa34b30d: baseline-arm-baylibre 2026-03-11 13:05:49,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec59efeb96b28aa34b30d 2026-03-11 13:05:49,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:05:49,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec59efeb96b28aa34b30d HTTP/1.1" 200 None 2026-03-11 13:05:49,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:05:49,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:05:49,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:05:49,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec59efeb96b28aa34b30d HTTP/1.1" 200 None 2026-03-11 13:05:49,856 - lava_callback - ERROR - Error processing callback for node 69aec59efeb96b28aa34b30d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:07:09,873 - lava_callback - INFO - Received callback for node 69aec5eefeb96b28aa34b352 INFO: 172.21.0.1:52542 - "POST /node/69aec5eefeb96b28aa34b352 HTTP/1.0" 202 Accepted 2026-03-11 13:07:09,878 - lava_callback - INFO - Starting async job submit for node 69aec5eefeb96b28aa34b352 2026-03-11 13:07:09,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:07:09,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec5eefeb96b28aa34b352 HTTP/1.1" 200 None 2026-03-11 13:07:09,924 - lava_callback - DEBUG - Processing node 69aec5eefeb96b28aa34b352: baseline-arm-baylibre 2026-03-11 13:07:09,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec5eefeb96b28aa34b352 2026-03-11 13:07:09,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:07:09,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec5eefeb96b28aa34b352 HTTP/1.1" 200 None 2026-03-11 13:07:09,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:07:09,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:07:09,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:07:10,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec5eefeb96b28aa34b352 HTTP/1.1" 200 None 2026-03-11 13:07:10,008 - lava_callback - ERROR - Error processing callback for node 69aec5eefeb96b28aa34b352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:09:10,023 - lava_callback - INFO - Received callback for node 69aec662feb96b28aa34b3f2 INFO: 172.21.0.1:47756 - "POST /node/69aec662feb96b28aa34b3f2 HTTP/1.0" 202 Accepted 2026-03-11 13:09:10,028 - lava_callback - INFO - Starting async job submit for node 69aec662feb96b28aa34b3f2 2026-03-11 13:09:10,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:09:10,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec662feb96b28aa34b3f2 HTTP/1.1" 200 None 2026-03-11 13:09:10,044 - lava_callback - DEBUG - Processing node 69aec662feb96b28aa34b3f2: baseline-arm-baylibre 2026-03-11 13:09:10,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec662feb96b28aa34b3f2 2026-03-11 13:09:10,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:09:10,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec662feb96b28aa34b3f2 HTTP/1.1" 200 None 2026-03-11 13:09:10,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:09:10,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:09:10,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:09:10,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec662feb96b28aa34b3f2 HTTP/1.1" 200 None 2026-03-11 13:09:10,132 - lava_callback - ERROR - Error processing callback for node 69aec662feb96b28aa34b3f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:12:52,433 - lava_callback - INFO - Received callback for node 69aec74dfeb96b28aa34b52b INFO: 172.21.0.1:41410 - "POST /node/69aec74dfeb96b28aa34b52b HTTP/1.0" 202 Accepted 2026-03-11 13:12:52,438 - lava_callback - INFO - Starting async job submit for node 69aec74dfeb96b28aa34b52b 2026-03-11 13:12:52,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:12:52,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec74dfeb96b28aa34b52b HTTP/1.1" 200 None 2026-03-11 13:12:52,456 - lava_callback - DEBUG - Processing node 69aec74dfeb96b28aa34b52b: baseline-arm-clabbe 2026-03-11 13:12:52,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec74dfeb96b28aa34b52b 2026-03-11 13:12:52,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:12:52,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec74dfeb96b28aa34b52b HTTP/1.1" 200 None 2026-03-11 13:12:52,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:12:52,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:12:52,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:12:52,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec74dfeb96b28aa34b52b HTTP/1.1" 200 None 2026-03-11 13:12:52,523 - lava_callback - ERROR - Error processing callback for node 69aec74dfeb96b28aa34b52b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:13:32,422 - lava_callback - INFO - Received callback for node 69aec778feb96b28aa34b54b INFO: 172.21.0.1:55016 - "POST /node/69aec778feb96b28aa34b54b HTTP/1.0" 202 Accepted 2026-03-11 13:13:32,427 - lava_callback - INFO - Starting async job submit for node 69aec778feb96b28aa34b54b 2026-03-11 13:13:32,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:13:32,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec778feb96b28aa34b54b HTTP/1.1" 200 None 2026-03-11 13:13:32,443 - lava_callback - DEBUG - Processing node 69aec778feb96b28aa34b54b: baseline-arm-clabbe 2026-03-11 13:13:32,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec778feb96b28aa34b54b 2026-03-11 13:13:32,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:13:32,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec778feb96b28aa34b54b HTTP/1.1" 200 None 2026-03-11 13:13:32,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:13:32,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:13:32,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:13:32,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec778feb96b28aa34b54b HTTP/1.1" 200 None 2026-03-11 13:13:32,514 - lava_callback - ERROR - Error processing callback for node 69aec778feb96b28aa34b54b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:15:32,488 - lava_callback - INFO - Received callback for node 69aec7e5feb96b28aa34b5ab INFO: 172.21.0.1:55460 - "POST /node/69aec7e5feb96b28aa34b5ab HTTP/1.0" 202 Accepted 2026-03-11 13:15:32,494 - lava_callback - INFO - Starting async job submit for node 69aec7e5feb96b28aa34b5ab 2026-03-11 13:15:32,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:15:32,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec7e5feb96b28aa34b5ab HTTP/1.1" 200 None 2026-03-11 13:15:32,510 - lava_callback - DEBUG - Processing node 69aec7e5feb96b28aa34b5ab: baseline-arm-clabbe 2026-03-11 13:15:32,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec7e5feb96b28aa34b5ab 2026-03-11 13:15:32,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:15:32,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec7e5feb96b28aa34b5ab HTTP/1.1" 200 None 2026-03-11 13:15:32,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:15:32,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:15:32,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:15:32,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec7e5feb96b28aa34b5ab HTTP/1.1" 200 None 2026-03-11 13:15:32,562 - lava_callback - ERROR - Error processing callback for node 69aec7e5feb96b28aa34b5ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:16:12,517 - lava_callback - INFO - Received callback for node 69aec80ffeb96b28aa34b5ca INFO: 172.21.0.1:50712 - "POST /node/69aec80ffeb96b28aa34b5ca HTTP/1.0" 202 Accepted 2026-03-11 13:16:12,523 - lava_callback - INFO - Starting async job submit for node 69aec80ffeb96b28aa34b5ca 2026-03-11 13:16:12,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:16:12,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec80ffeb96b28aa34b5ca HTTP/1.1" 200 None 2026-03-11 13:16:12,538 - lava_callback - DEBUG - Processing node 69aec80ffeb96b28aa34b5ca: baseline-arm-clabbe 2026-03-11 13:16:12,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec80ffeb96b28aa34b5ca 2026-03-11 13:16:12,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:16:12,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec80ffeb96b28aa34b5ca HTTP/1.1" 200 None 2026-03-11 13:16:12,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:16:12,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:16:12,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:16:12,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec80ffeb96b28aa34b5ca HTTP/1.1" 200 None 2026-03-11 13:16:12,596 - lava_callback - ERROR - Error processing callback for node 69aec80ffeb96b28aa34b5ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET /node/69a62d117da105ad098359ff%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:18:30,520 - lava_callback - INFO - Received callback for node 69aec899feb96b28aa34b6d5 INFO: 172.21.0.1:43246 - "POST /node/69aec899feb96b28aa34b6d5 HTTP/1.0" 202 Accepted 2026-03-11 13:18:30,526 - lava_callback - INFO - Starting async job submit for node 69aec899feb96b28aa34b6d5 2026-03-11 13:18:30,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:30,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec899feb96b28aa34b6d5 HTTP/1.1" 200 None 2026-03-11 13:18:30,545 - lava_callback - DEBUG - Processing node 69aec899feb96b28aa34b6d5: baseline-arm64-baylibre 2026-03-11 13:18:30,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec899feb96b28aa34b6d5 2026-03-11 13:18:30,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:30,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec899feb96b28aa34b6d5 HTTP/1.1" 200 None 2026-03-11 13:18:30,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:30,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:30,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:30,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec899feb96b28aa34b6d5 HTTP/1.1" 200 None 2026-03-11 13:18:30,596 - lava_callback - ERROR - Error processing callback for node 69aec899feb96b28aa34b6d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:31,165 - lava_callback - INFO - Received callback for node 69aec89afeb96b28aa34b6d8 INFO: 172.21.0.1:43260 - "POST /node/69aec89afeb96b28aa34b6d8 HTTP/1.0" 202 Accepted 2026-03-11 13:18:31,171 - lava_callback - INFO - Starting async job submit for node 69aec89afeb96b28aa34b6d8 2026-03-11 13:18:31,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89afeb96b28aa34b6d8 HTTP/1.1" 200 None 2026-03-11 13:18:31,186 - lava_callback - DEBUG - Processing node 69aec89afeb96b28aa34b6d8: baseline-arm64-baylibre 2026-03-11 13:18:31,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec89afeb96b28aa34b6d8 2026-03-11 13:18:31,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89afeb96b28aa34b6d8 HTTP/1.1" 200 None 2026-03-11 13:18:31,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:31,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec89afeb96b28aa34b6d8 HTTP/1.1" 200 None 2026-03-11 13:18:31,242 - lava_callback - ERROR - Error processing callback for node 69aec89afeb96b28aa34b6d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:31,839 - lava_callback - INFO - Received callback for node 69aec89bfeb96b28aa34b6db INFO: 172.21.0.1:43274 - "POST /node/69aec89bfeb96b28aa34b6db HTTP/1.0" 202 Accepted 2026-03-11 13:18:31,844 - lava_callback - INFO - Starting async job submit for node 69aec89bfeb96b28aa34b6db 2026-03-11 13:18:31,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89bfeb96b28aa34b6db HTTP/1.1" 200 None 2026-03-11 13:18:31,863 - lava_callback - DEBUG - Processing node 69aec89bfeb96b28aa34b6db: baseline-arm64-baylibre 2026-03-11 13:18:31,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec89bfeb96b28aa34b6db 2026-03-11 13:18:31,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89bfeb96b28aa34b6db HTTP/1.1" 200 None 2026-03-11 13:18:31,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:31,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec89bfeb96b28aa34b6db HTTP/1.1" 200 None 2026-03-11 13:18:31,921 - lava_callback - ERROR - Error processing callback for node 69aec89bfeb96b28aa34b6db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:32,496 - lava_callback - INFO - Received callback for node 69aec89dfeb96b28aa34b6e2 INFO: 172.21.0.1:43282 - "POST /node/69aec89dfeb96b28aa34b6e2 HTTP/1.0" 202 Accepted 2026-03-11 13:18:32,502 - lava_callback - INFO - Starting async job submit for node 69aec89dfeb96b28aa34b6e2 2026-03-11 13:18:32,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:32,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89dfeb96b28aa34b6e2 HTTP/1.1" 200 None 2026-03-11 13:18:32,528 - lava_callback - DEBUG - Processing node 69aec89dfeb96b28aa34b6e2: baseline-arm64-baylibre 2026-03-11 13:18:32,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec89dfeb96b28aa34b6e2 2026-03-11 13:18:32,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:32,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89dfeb96b28aa34b6e2 HTTP/1.1" 200 None 2026-03-11 13:18:32,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:32,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:32,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:32,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec89dfeb96b28aa34b6e2 HTTP/1.1" 200 None 2026-03-11 13:18:32,586 - lava_callback - ERROR - Error processing callback for node 69aec89dfeb96b28aa34b6e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:33,158 - lava_callback - INFO - Received callback for node 69aec89ffeb96b28aa34b6e5 INFO: 172.21.0.1:43296 - "POST /node/69aec89ffeb96b28aa34b6e5 HTTP/1.0" 202 Accepted 2026-03-11 13:18:33,163 - lava_callback - INFO - Starting async job submit for node 69aec89ffeb96b28aa34b6e5 2026-03-11 13:18:33,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89ffeb96b28aa34b6e5 HTTP/1.1" 200 None 2026-03-11 13:18:33,179 - lava_callback - DEBUG - Processing node 69aec89ffeb96b28aa34b6e5: baseline-arm64-baylibre 2026-03-11 13:18:33,179 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec89ffeb96b28aa34b6e5 2026-03-11 13:18:33,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89ffeb96b28aa34b6e5 HTTP/1.1" 200 None 2026-03-11 13:18:33,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:33,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec89ffeb96b28aa34b6e5 HTTP/1.1" 200 None 2026-03-11 13:18:33,236 - lava_callback - ERROR - Error processing callback for node 69aec89ffeb96b28aa34b6e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:33,827 - lava_callback - INFO - Received callback for node 69aec8a0feb96b28aa34b6e8 INFO: 172.21.0.1:43300 - "POST /node/69aec8a0feb96b28aa34b6e8 HTTP/1.0" 202 Accepted 2026-03-11 13:18:33,832 - lava_callback - INFO - Starting async job submit for node 69aec8a0feb96b28aa34b6e8 2026-03-11 13:18:33,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a0feb96b28aa34b6e8 HTTP/1.1" 200 None 2026-03-11 13:18:33,848 - lava_callback - DEBUG - Processing node 69aec8a0feb96b28aa34b6e8: baseline-arm64-baylibre 2026-03-11 13:18:33,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8a0feb96b28aa34b6e8 2026-03-11 13:18:33,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a0feb96b28aa34b6e8 HTTP/1.1" 200 None 2026-03-11 13:18:33,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:33,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8a0feb96b28aa34b6e8 HTTP/1.1" 200 None 2026-03-11 13:18:33,904 - lava_callback - ERROR - Error processing callback for node 69aec8a0feb96b28aa34b6e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:18:52,684 - lava_callback - INFO - Received callback for node 69aec8b2feb96b28aa34b75c INFO: 172.21.0.1:43710 - "POST /node/69aec8b2feb96b28aa34b75c HTTP/1.0" 202 Accepted 2026-03-11 13:18:52,690 - lava_callback - INFO - Starting async job submit for node 69aec8b2feb96b28aa34b75c 2026-03-11 13:18:52,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:52,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b2feb96b28aa34b75c HTTP/1.1" 200 None 2026-03-11 13:18:52,711 - lava_callback - DEBUG - Processing node 69aec8b2feb96b28aa34b75c: baseline-arm64-clabbe 2026-03-11 13:18:52,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b2feb96b28aa34b75c 2026-03-11 13:18:52,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:52,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b2feb96b28aa34b75c HTTP/1.1" 200 None 2026-03-11 13:18:52,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:52,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:52,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:52,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b2feb96b28aa34b75c HTTP/1.1" 200 None 2026-03-11 13:18:52,777 - lava_callback - ERROR - Error processing callback for node 69aec8b2feb96b28aa34b75c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:53,334 - lava_callback - INFO - Received callback for node 69aec8b4feb96b28aa34b75f INFO: 172.21.0.1:43722 - "POST /node/69aec8b4feb96b28aa34b75f HTTP/1.0" 202 Accepted 2026-03-11 13:18:53,339 - lava_callback - INFO - Starting async job submit for node 69aec8b4feb96b28aa34b75f 2026-03-11 13:18:53,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:53,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b4feb96b28aa34b75f HTTP/1.1" 200 None 2026-03-11 13:18:53,357 - lava_callback - DEBUG - Processing node 69aec8b4feb96b28aa34b75f: baseline-arm64-clabbe 2026-03-11 13:18:53,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b4feb96b28aa34b75f 2026-03-11 13:18:53,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:53,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b4feb96b28aa34b75f HTTP/1.1" 200 None 2026-03-11 13:18:53,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:53,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:53,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:53,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b4feb96b28aa34b75f HTTP/1.1" 200 None 2026-03-11 13:18:53,427 - lava_callback - ERROR - Error processing callback for node 69aec8b4feb96b28aa34b75f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:53,996 - lava_callback - INFO - Received callback for node 69aec8b5feb96b28aa34b762 INFO: 172.21.0.1:43728 - "POST /node/69aec8b5feb96b28aa34b762 HTTP/1.0" 202 Accepted 2026-03-11 13:18:54,002 - lava_callback - INFO - Starting async job submit for node 69aec8b5feb96b28aa34b762 2026-03-11 13:18:54,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b5feb96b28aa34b762 HTTP/1.1" 200 None 2026-03-11 13:18:54,019 - lava_callback - DEBUG - Processing node 69aec8b5feb96b28aa34b762: baseline-arm64-clabbe 2026-03-11 13:18:54,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b5feb96b28aa34b762 2026-03-11 13:18:54,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b5feb96b28aa34b762 HTTP/1.1" 200 None 2026-03-11 13:18:54,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:54,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b5feb96b28aa34b762 HTTP/1.1" 200 None 2026-03-11 13:18:54,088 - lava_callback - ERROR - Error processing callback for node 69aec8b5feb96b28aa34b762: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:54,646 - lava_callback - INFO - Received callback for node 69aec8b6feb96b28aa34b765 INFO: 172.21.0.1:43738 - "POST /node/69aec8b6feb96b28aa34b765 HTTP/1.0" 202 Accepted 2026-03-11 13:18:54,652 - lava_callback - INFO - Starting async job submit for node 69aec8b6feb96b28aa34b765 2026-03-11 13:18:54,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b6feb96b28aa34b765 HTTP/1.1" 200 None 2026-03-11 13:18:54,668 - lava_callback - DEBUG - Processing node 69aec8b6feb96b28aa34b765: baseline-arm64-clabbe 2026-03-11 13:18:54,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b6feb96b28aa34b765 2026-03-11 13:18:54,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b6feb96b28aa34b765 HTTP/1.1" 200 None 2026-03-11 13:18:54,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:54,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b6feb96b28aa34b765 HTTP/1.1" 200 None 2026-03-11 13:18:54,729 - lava_callback - ERROR - Error processing callback for node 69aec8b6feb96b28aa34b765: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:55,306 - lava_callback - INFO - Received callback for node 69aec8b8feb96b28aa34b76e INFO: 172.21.0.1:43752 - "POST /node/69aec8b8feb96b28aa34b76e HTTP/1.0" 202 Accepted 2026-03-11 13:18:55,311 - lava_callback - INFO - Starting async job submit for node 69aec8b8feb96b28aa34b76e 2026-03-11 13:18:55,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:55,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b8feb96b28aa34b76e HTTP/1.1" 200 None 2026-03-11 13:18:55,330 - lava_callback - DEBUG - Processing node 69aec8b8feb96b28aa34b76e: baseline-arm64-clabbe 2026-03-11 13:18:55,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b8feb96b28aa34b76e 2026-03-11 13:18:55,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:55,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b8feb96b28aa34b76e HTTP/1.1" 200 None 2026-03-11 13:18:55,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:55,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:55,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:55,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b8feb96b28aa34b76e HTTP/1.1" 200 None 2026-03-11 13:18:55,391 - lava_callback - ERROR - Error processing callback for node 69aec8b8feb96b28aa34b76e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:55,967 - lava_callback - INFO - Received callback for node 69aec8b8feb96b28aa34b76b INFO: 172.21.0.1:43768 - "POST /node/69aec8b8feb96b28aa34b76b HTTP/1.0" 202 Accepted 2026-03-11 13:18:55,972 - lava_callback - INFO - Starting async job submit for node 69aec8b8feb96b28aa34b76b 2026-03-11 13:18:55,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:55,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b8feb96b28aa34b76b HTTP/1.1" 200 None 2026-03-11 13:18:55,988 - lava_callback - DEBUG - Processing node 69aec8b8feb96b28aa34b76b: baseline-arm64-clabbe 2026-03-11 13:18:55,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b8feb96b28aa34b76b 2026-03-11 13:18:55,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:56,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b8feb96b28aa34b76b HTTP/1.1" 200 None 2026-03-11 13:18:56,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:56,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:56,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:56,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b8feb96b28aa34b76b HTTP/1.1" 200 None 2026-03-11 13:18:56,046 - lava_callback - ERROR - Error processing callback for node 69aec8b8feb96b28aa34b76b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:19:12,642 - lava_callback - INFO - Received callback for node 69aec8cdfeb96b28aa34b7c1 INFO: 172.21.0.1:55762 - "POST /node/69aec8cdfeb96b28aa34b7c1 HTTP/1.0" 202 Accepted 2026-03-11 13:19:12,648 - lava_callback - INFO - Starting async job submit for node 69aec8cdfeb96b28aa34b7c1 2026-03-11 13:19:12,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:19:12,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8cdfeb96b28aa34b7c1 HTTP/1.1" 200 None 2026-03-11 13:19:12,664 - lava_callback - DEBUG - Processing node 69aec8cdfeb96b28aa34b7c1: baseline-arm-clabbe 2026-03-11 13:19:12,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8cdfeb96b28aa34b7c1 2026-03-11 13:19:12,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:19:12,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8cdfeb96b28aa34b7c1 HTTP/1.1" 200 None 2026-03-11 13:19:12,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:19:12,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:19:12,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:19:12,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8cdfeb96b28aa34b7c1 HTTP/1.1" 200 None 2026-03-11 13:19:12,726 - lava_callback - ERROR - Error processing callback for node 69aec8cdfeb96b28aa34b7c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33400 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:21:12,777 - lava_callback - INFO - Received callback for node 69aec945feb96b28aa34b8d6 INFO: 172.21.0.1:58286 - "POST /node/69aec945feb96b28aa34b8d6 HTTP/1.0" 202 Accepted 2026-03-11 13:21:12,782 - lava_callback - INFO - Starting async job submit for node 69aec945feb96b28aa34b8d6 2026-03-11 13:21:12,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:21:12,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec945feb96b28aa34b8d6 HTTP/1.1" 200 None 2026-03-11 13:21:12,798 - lava_callback - DEBUG - Processing node 69aec945feb96b28aa34b8d6: baseline-arm-clabbe 2026-03-11 13:21:12,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec945feb96b28aa34b8d6 2026-03-11 13:21:12,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:21:12,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec945feb96b28aa34b8d6 HTTP/1.1" 200 None 2026-03-11 13:21:12,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:21:12,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:21:12,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:21:12,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec945feb96b28aa34b8d6 HTTP/1.1" 200 None 2026-03-11 13:21:12,857 - lava_callback - ERROR - Error processing callback for node 69aec945feb96b28aa34b8d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41700 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:25:32,912 - lava_callback - INFO - Received callback for node 69aeca3bfeb96b28aa34ba19 INFO: 172.21.0.1:48980 - "POST /node/69aeca3bfeb96b28aa34ba19 HTTP/1.0" 202 Accepted 2026-03-11 13:25:32,918 - lava_callback - INFO - Starting async job submit for node 69aeca3bfeb96b28aa34ba19 2026-03-11 13:25:32,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:25:32,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca3bfeb96b28aa34ba19 HTTP/1.1" 200 None 2026-03-11 13:25:32,934 - lava_callback - DEBUG - Processing node 69aeca3bfeb96b28aa34ba19: baseline-arm-clabbe 2026-03-11 13:25:32,934 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeca3bfeb96b28aa34ba19 2026-03-11 13:25:32,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:25:32,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca3bfeb96b28aa34ba19 HTTP/1.1" 200 None 2026-03-11 13:25:32,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:25:32,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:25:32,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:25:32,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeca3bfeb96b28aa34ba19 HTTP/1.1" 200 None 2026-03-11 13:25:33,002 - lava_callback - ERROR - Error processing callback for node 69aeca3bfeb96b28aa34ba19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:26:12,935 - lava_callback - INFO - Received callback for node 69aeca64feb96b28aa34ba3d INFO: 172.21.0.1:47068 - "POST /node/69aeca64feb96b28aa34ba3d HTTP/1.0" 202 Accepted 2026-03-11 13:26:12,941 - lava_callback - INFO - Starting async job submit for node 69aeca64feb96b28aa34ba3d 2026-03-11 13:26:12,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:26:12,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca64feb96b28aa34ba3d HTTP/1.1" 200 None 2026-03-11 13:26:12,957 - lava_callback - DEBUG - Processing node 69aeca64feb96b28aa34ba3d: baseline-arm-clabbe 2026-03-11 13:26:12,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeca64feb96b28aa34ba3d 2026-03-11 13:26:12,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:26:12,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca64feb96b28aa34ba3d HTTP/1.1" 200 None 2026-03-11 13:26:12,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:26:12,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:26:12,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:26:13,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeca64feb96b28aa34ba3d HTTP/1.1" 200 None 2026-03-11 13:26:13,023 - lava_callback - ERROR - Error processing callback for node 69aeca64feb96b28aa34ba3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:27:33,009 - lava_callback - INFO - Received callback for node 69aecab5feb96b28aa34bab5 INFO: 172.21.0.1:46272 - "POST /node/69aecab5feb96b28aa34bab5 HTTP/1.0" 202 Accepted 2026-03-11 13:27:33,014 - lava_callback - INFO - Starting async job submit for node 69aecab5feb96b28aa34bab5 2026-03-11 13:27:33,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:27:33,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecab5feb96b28aa34bab5 HTTP/1.1" 200 None 2026-03-11 13:27:33,036 - lava_callback - DEBUG - Processing node 69aecab5feb96b28aa34bab5: baseline-arm-clabbe 2026-03-11 13:27:33,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aecab5feb96b28aa34bab5 2026-03-11 13:27:33,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:27:33,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecab5feb96b28aa34bab5 HTTP/1.1" 200 None 2026-03-11 13:27:33,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:27:33,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:27:33,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:27:33,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecab5feb96b28aa34bab5 HTTP/1.1" 200 None 2026-03-11 13:27:33,088 - lava_callback - ERROR - Error processing callback for node 69aecab5feb96b28aa34bab5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:31:31,720 - lava_callback - INFO - Received callback for node 69aecba6feb96b28aa34bbfe INFO: 172.21.0.1:38912 - "POST /node/69aecba6feb96b28aa34bbfe HTTP/1.0" 202 Accepted 2026-03-11 13:31:31,725 - lava_callback - INFO - Starting async job submit for node 69aecba6feb96b28aa34bbfe 2026-03-11 13:31:31,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:31:31,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecba6feb96b28aa34bbfe HTTP/1.1" 200 None 2026-03-11 13:31:31,743 - lava_callback - DEBUG - Processing node 69aecba6feb96b28aa34bbfe: baseline-arm64-baylibre 2026-03-11 13:31:31,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aecba6feb96b28aa34bbfe 2026-03-11 13:31:31,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:31:31,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecba6feb96b28aa34bbfe HTTP/1.1" 200 None 2026-03-11 13:31:31,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:31:31,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 13:31:31,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:31:31,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecba6feb96b28aa34bbfe HTTP/1.1" 200 None 2026-03-11 13:31:31,811 - lava_callback - ERROR - Error processing callback for node 69aecba6feb96b28aa34bbfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:32:51,157 - lava_callback - INFO - Received callback for node 69aecbf7feb96b28aa34bc0d INFO: 172.21.0.1:50102 - "POST /node/69aecbf7feb96b28aa34bc0d HTTP/1.0" 202 Accepted 2026-03-11 13:32:51,163 - lava_callback - INFO - Starting async job submit for node 69aecbf7feb96b28aa34bc0d 2026-03-11 13:32:51,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:32:51,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecbf7feb96b28aa34bc0d HTTP/1.1" 200 None 2026-03-11 13:32:51,179 - lava_callback - DEBUG - Processing node 69aecbf7feb96b28aa34bc0d: baseline-arm64-baylibre 2026-03-11 13:32:51,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aecbf7feb96b28aa34bc0d 2026-03-11 13:32:51,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:32:51,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecbf7feb96b28aa34bc0d HTTP/1.1" 200 None 2026-03-11 13:32:51,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:32:51,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 13:32:51,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:32:51,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecbf7feb96b28aa34bc0d HTTP/1.1" 200 None 2026-03-11 13:32:51,240 - lava_callback - ERROR - Error processing callback for node 69aecbf7feb96b28aa34bc0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:34:11,248 - lava_callback - INFO - Received callback for node 69aecc48feb96b28aa34bc19 INFO: 172.21.0.1:58198 - "POST /node/69aecc48feb96b28aa34bc19 HTTP/1.0" 202 Accepted 2026-03-11 13:34:11,253 - lava_callback - INFO - Starting async job submit for node 69aecc48feb96b28aa34bc19 2026-03-11 13:34:11,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:34:11,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecc48feb96b28aa34bc19 HTTP/1.1" 200 None 2026-03-11 13:34:11,274 - lava_callback - DEBUG - Processing node 69aecc48feb96b28aa34bc19: baseline-arm64-baylibre 2026-03-11 13:34:11,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aecc48feb96b28aa34bc19 2026-03-11 13:34:11,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:34:11,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecc48feb96b28aa34bc19 HTTP/1.1" 200 None 2026-03-11 13:34:11,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:34:11,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 13:34:11,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:34:11,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecc48feb96b28aa34bc19 HTTP/1.1" 200 None 2026-03-11 13:34:11,327 - lava_callback - ERROR - Error processing callback for node 69aecc48feb96b28aa34bc19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:51:32,279 - lava_callback - INFO - Received callback for node 69aed059feb96b28aa34bd0d INFO: 172.21.0.1:51932 - "POST /node/69aed059feb96b28aa34bd0d HTTP/1.0" 202 Accepted 2026-03-11 13:51:32,284 - lava_callback - INFO - Starting async job submit for node 69aed059feb96b28aa34bd0d 2026-03-11 13:51:32,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:51:32,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed059feb96b28aa34bd0d HTTP/1.1" 200 None 2026-03-11 13:51:32,301 - lava_callback - DEBUG - Processing node 69aed059feb96b28aa34bd0d: baseline-arm64-baylibre 2026-03-11 13:51:32,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed059feb96b28aa34bd0d 2026-03-11 13:51:32,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:51:32,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed059feb96b28aa34bd0d HTTP/1.1" 200 None 2026-03-11 13:51:32,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:51:32,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 13:51:32,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:51:32,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed059feb96b28aa34bd0d HTTP/1.1" 200 None 2026-03-11 13:51:32,359 - lava_callback - ERROR - Error processing callback for node 69aed059feb96b28aa34bd0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:15:34,204 - lava_callback - INFO - Received callback for node 69aed604feb96b28aa34bdef INFO: 172.21.0.1:42034 - "POST /node/69aed604feb96b28aa34bdef HTTP/1.0" 202 Accepted 2026-03-11 14:15:34,210 - lava_callback - INFO - Starting async job submit for node 69aed604feb96b28aa34bdef 2026-03-11 14:15:34,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:15:34,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed604feb96b28aa34bdef HTTP/1.1" 200 None 2026-03-11 14:15:34,232 - lava_callback - DEBUG - Processing node 69aed604feb96b28aa34bdef: baseline-arm64-baylibre 2026-03-11 14:15:34,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed604feb96b28aa34bdef 2026-03-11 14:15:34,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:15:34,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed604feb96b28aa34bdef HTTP/1.1" 200 None 2026-03-11 14:15:34,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:15:34,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 14:15:34,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:15:34,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed604feb96b28aa34bdef HTTP/1.1" 200 None 2026-03-11 14:15:34,295 - lava_callback - ERROR - Error processing callback for node 69aed604feb96b28aa34bdef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:18:33,723 - lava_callback - INFO - Received callback for node 69aed6a4feb96b28aa34be09 INFO: 172.21.0.1:42736 - "POST /node/69aed6a4feb96b28aa34be09 HTTP/1.0" 202 Accepted 2026-03-11 14:18:33,729 - lava_callback - INFO - Starting async job submit for node 69aed6a4feb96b28aa34be09 2026-03-11 14:18:33,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:18:33,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed6a4feb96b28aa34be09 HTTP/1.1" 200 None 2026-03-11 14:18:33,745 - lava_callback - DEBUG - Processing node 69aed6a4feb96b28aa34be09: baseline-arm64-baylibre 2026-03-11 14:18:33,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed6a4feb96b28aa34be09 2026-03-11 14:18:33,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:18:33,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed6a4feb96b28aa34be09 HTTP/1.1" 200 None 2026-03-11 14:18:33,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:18:33,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 14:18:33,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:18:33,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed6a4feb96b28aa34be09 HTTP/1.1" 200 None 2026-03-11 14:18:33,843 - lava_callback - ERROR - Error processing callback for node 69aed6a4feb96b28aa34be09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:20:53,960 - lava_callback - INFO - Received callback for node 69aed73efeb96b28aa34be2b INFO: 172.21.0.1:39502 - "POST /node/69aed73efeb96b28aa34be2b HTTP/1.0" 202 Accepted 2026-03-11 14:20:53,965 - lava_callback - INFO - Starting async job submit for node 69aed73efeb96b28aa34be2b 2026-03-11 14:20:53,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:20:53,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed73efeb96b28aa34be2b HTTP/1.1" 200 None 2026-03-11 14:20:53,997 - lava_callback - DEBUG - Processing node 69aed73efeb96b28aa34be2b: baseline-arm64-baylibre 2026-03-11 14:20:53,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed73efeb96b28aa34be2b 2026-03-11 14:20:53,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:20:54,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed73efeb96b28aa34be2b HTTP/1.1" 200 None 2026-03-11 14:20:54,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:20:54,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:20:54,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:20:54,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed73efeb96b28aa34be2b HTTP/1.1" 200 None 2026-03-11 14:20:54,085 - lava_callback - ERROR - Error processing callback for node 69aed73efeb96b28aa34be2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:22:13,845 - lava_callback - INFO - Received callback for node 69aed78dfeb96b28aa34be44 INFO: 172.21.0.1:35248 - "POST /node/69aed78dfeb96b28aa34be44 HTTP/1.0" 202 Accepted 2026-03-11 14:22:13,851 - lava_callback - INFO - Starting async job submit for node 69aed78dfeb96b28aa34be44 2026-03-11 14:22:13,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:22:13,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed78dfeb96b28aa34be44 HTTP/1.1" 200 None 2026-03-11 14:22:13,891 - lava_callback - DEBUG - Processing node 69aed78dfeb96b28aa34be44: baseline-arm64-baylibre 2026-03-11 14:22:13,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed78dfeb96b28aa34be44 2026-03-11 14:22:13,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:22:13,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed78dfeb96b28aa34be44 HTTP/1.1" 200 None 2026-03-11 14:22:13,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:22:13,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:22:13,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:22:13,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed78dfeb96b28aa34be44 HTTP/1.1" 200 None 2026-03-11 14:22:13,973 - lava_callback - ERROR - Error processing callback for node 69aed78dfeb96b28aa34be44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:23:34,230 - lava_callback - INFO - Received callback for node 69aed7dcfeb96b28aa34be4d INFO: 172.21.0.1:50798 - "POST /node/69aed7dcfeb96b28aa34be4d HTTP/1.0" 202 Accepted 2026-03-11 14:23:34,235 - lava_callback - INFO - Starting async job submit for node 69aed7dcfeb96b28aa34be4d 2026-03-11 14:23:34,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:23:34,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed7dcfeb96b28aa34be4d HTTP/1.1" 200 None 2026-03-11 14:23:34,251 - lava_callback - DEBUG - Processing node 69aed7dcfeb96b28aa34be4d: baseline-arm64-baylibre 2026-03-11 14:23:34,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed7dcfeb96b28aa34be4d 2026-03-11 14:23:34,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:23:34,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed7dcfeb96b28aa34be4d HTTP/1.1" 200 None 2026-03-11 14:23:34,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:23:34,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:23:34,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:23:34,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed7dcfeb96b28aa34be4d HTTP/1.1" 200 None 2026-03-11 14:23:34,340 - lava_callback - ERROR - Error processing callback for node 69aed7dcfeb96b28aa34be4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:30:14,409 - lava_callback - INFO - Received callback for node 69aed962feb96b28aa34be84 INFO: 172.21.0.1:42092 - "POST /node/69aed962feb96b28aa34be84 HTTP/1.0" 202 Accepted 2026-03-11 14:30:14,415 - lava_callback - INFO - Starting async job submit for node 69aed962feb96b28aa34be84 2026-03-11 14:30:14,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:30:14,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed962feb96b28aa34be84 HTTP/1.1" 200 None 2026-03-11 14:30:14,431 - lava_callback - DEBUG - Processing node 69aed962feb96b28aa34be84: baseline-arm64-baylibre 2026-03-11 14:30:14,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed962feb96b28aa34be84 2026-03-11 14:30:14,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:30:14,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed962feb96b28aa34be84 HTTP/1.1" 200 None 2026-03-11 14:30:14,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:30:14,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:30:14,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:30:14,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed962feb96b28aa34be84 HTTP/1.1" 200 None 2026-03-11 14:30:14,490 - lava_callback - ERROR - Error processing callback for node 69aed962feb96b28aa34be84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57826 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:31:14,359 - lava_callback - INFO - Received callback for node 69aed9affeb96b28aa34be8f INFO: 172.21.0.1:60320 - "POST /node/69aed9affeb96b28aa34be8f HTTP/1.0" 202 Accepted 2026-03-11 14:31:14,364 - lava_callback - INFO - Starting async job submit for node 69aed9affeb96b28aa34be8f 2026-03-11 14:31:14,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:31:14,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed9affeb96b28aa34be8f HTTP/1.1" 200 None 2026-03-11 14:31:14,406 - lava_callback - DEBUG - Processing node 69aed9affeb96b28aa34be8f: baseline-arm64-baylibre 2026-03-11 14:31:14,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed9affeb96b28aa34be8f 2026-03-11 14:31:14,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:31:14,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed9affeb96b28aa34be8f HTTP/1.1" 200 None 2026-03-11 14:31:14,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:31:14,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:31:14,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:31:14,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed9affeb96b28aa34be8f HTTP/1.1" 200 None 2026-03-11 14:31:14,534 - lava_callback - ERROR - Error processing callback for node 69aed9affeb96b28aa34be8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:32:34,615 - lava_callback - INFO - Received callback for node 69aed9f9feb96b28aa34be94 INFO: 172.21.0.1:49578 - "POST /node/69aed9f9feb96b28aa34be94 HTTP/1.0" 202 Accepted 2026-03-11 14:32:34,620 - lava_callback - INFO - Starting async job submit for node 69aed9f9feb96b28aa34be94 2026-03-11 14:32:34,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:32:34,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed9f9feb96b28aa34be94 HTTP/1.1" 200 None 2026-03-11 14:32:34,670 - lava_callback - DEBUG - Processing node 69aed9f9feb96b28aa34be94: baseline-arm64-baylibre 2026-03-11 14:32:34,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed9f9feb96b28aa34be94 2026-03-11 14:32:34,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:32:34,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed9f9feb96b28aa34be94 HTTP/1.1" 200 None 2026-03-11 14:32:34,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:32:34,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:32:34,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:32:34,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed9f9feb96b28aa34be94 HTTP/1.1" 200 None 2026-03-11 14:32:34,749 - lava_callback - ERROR - Error processing callback for node 69aed9f9feb96b28aa34be94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:33:54,547 - lava_callback - INFO - Received callback for node 69aeda46feb96b28aa34be9e INFO: 172.21.0.1:52482 - "POST /node/69aeda46feb96b28aa34be9e HTTP/1.0" 202 Accepted 2026-03-11 14:33:54,553 - lava_callback - INFO - Starting async job submit for node 69aeda46feb96b28aa34be9e 2026-03-11 14:33:54,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:33:54,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeda46feb96b28aa34be9e HTTP/1.1" 200 None 2026-03-11 14:33:54,571 - lava_callback - DEBUG - Processing node 69aeda46feb96b28aa34be9e: baseline-arm64-baylibre 2026-03-11 14:33:54,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeda46feb96b28aa34be9e 2026-03-11 14:33:54,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:33:54,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeda46feb96b28aa34be9e HTTP/1.1" 200 None 2026-03-11 14:33:54,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:33:54,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:33:54,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:33:54,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeda46feb96b28aa34be9e HTTP/1.1" 200 None 2026-03-11 14:33:54,637 - lava_callback - ERROR - Error processing callback for node 69aeda46feb96b28aa34be9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 14:35:16,034 - lava_callback - INFO - Received callback for node 69aeda9cfeb96b28aa34bea9 INFO: 172.21.0.1:58492 - "POST /node/69aeda9cfeb96b28aa34bea9 HTTP/1.0" 202 Accepted 2026-03-11 14:35:16,039 - lava_callback - INFO - Starting async job submit for node 69aeda9cfeb96b28aa34bea9 2026-03-11 14:35:16,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:35:16,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeda9cfeb96b28aa34bea9 HTTP/1.1" 200 None 2026-03-11 14:35:16,056 - lava_callback - DEBUG - Processing node 69aeda9cfeb96b28aa34bea9: baseline-arm64-clabbe 2026-03-11 14:35:16,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeda9cfeb96b28aa34bea9 2026-03-11 14:35:16,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:35:16,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeda9cfeb96b28aa34bea9 HTTP/1.1" 200 None 2026-03-11 14:35:16,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:35:16,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:35:16,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:35:16,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeda9cfeb96b28aa34bea9 HTTP/1.1" 200 None 2026-03-11 14:35:16,118 - lava_callback - ERROR - Error processing callback for node 69aeda9cfeb96b28aa34bea9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38964 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:36:37,094 - lava_callback - INFO - Received callback for node 69aedaebfeb96b28aa34bebe INFO: 172.21.0.1:38980 - "POST /node/69aedaebfeb96b28aa34bebe HTTP/1.0" 202 Accepted 2026-03-11 14:36:37,099 - lava_callback - INFO - Starting async job submit for node 69aedaebfeb96b28aa34bebe 2026-03-11 14:36:37,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:36:37,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedaebfeb96b28aa34bebe HTTP/1.1" 200 None 2026-03-11 14:36:37,115 - lava_callback - DEBUG - Processing node 69aedaebfeb96b28aa34bebe: baseline-arm64-clabbe 2026-03-11 14:36:37,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedaebfeb96b28aa34bebe 2026-03-11 14:36:37,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:36:37,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedaebfeb96b28aa34bebe HTTP/1.1" 200 None 2026-03-11 14:36:37,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:36:37,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:36:37,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:36:37,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedaebfeb96b28aa34bebe HTTP/1.1" 200 None 2026-03-11 14:36:37,172 - lava_callback - ERROR - Error processing callback for node 69aedaebfeb96b28aa34bebe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44300 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:37:54,740 - lava_callback - INFO - Received callback for node 69aedb33feb96b28aa34bed6 INFO: 172.21.0.1:46834 - "POST /node/69aedb33feb96b28aa34bed6 HTTP/1.0" 202 Accepted 2026-03-11 14:37:54,745 - lava_callback - INFO - Starting async job submit for node 69aedb33feb96b28aa34bed6 2026-03-11 14:37:54,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:37:54,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedb33feb96b28aa34bed6 HTTP/1.1" 200 None 2026-03-11 14:37:54,762 - lava_callback - DEBUG - Processing node 69aedb33feb96b28aa34bed6: baseline-arm64-baylibre 2026-03-11 14:37:54,762 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedb33feb96b28aa34bed6 2026-03-11 14:37:54,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:37:54,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedb33feb96b28aa34bed6 HTTP/1.1" 200 None 2026-03-11 14:37:54,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:37:54,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:37:54,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:37:54,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedb33feb96b28aa34bed6 HTTP/1.1" 200 None 2026-03-11 14:37:54,827 - lava_callback - ERROR - Error processing callback for node 69aedb33feb96b28aa34bed6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:40:34,980 - lava_callback - INFO - Received callback for node 69aedbd0feb96b28aa34bef4 INFO: 172.21.0.1:49568 - "POST /node/69aedbd0feb96b28aa34bef4 HTTP/1.0" 202 Accepted 2026-03-11 14:40:34,985 - lava_callback - INFO - Starting async job submit for node 69aedbd0feb96b28aa34bef4 2026-03-11 14:40:34,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:40:35,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedbd0feb96b28aa34bef4 HTTP/1.1" 200 None 2026-03-11 14:40:35,027 - lava_callback - DEBUG - Processing node 69aedbd0feb96b28aa34bef4: baseline-arm64-baylibre 2026-03-11 14:40:35,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedbd0feb96b28aa34bef4 2026-03-11 14:40:35,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:40:35,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedbd0feb96b28aa34bef4 HTTP/1.1" 200 None 2026-03-11 14:40:35,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:40:35,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:40:35,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:40:35,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedbd0feb96b28aa34bef4 HTTP/1.1" 200 None 2026-03-11 14:40:35,102 - lava_callback - ERROR - Error processing callback for node 69aedbd0feb96b28aa34bef4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 14:43:16,362 - lava_callback - INFO - Received callback for node 69aedc6efeb96b28aa34bf10 INFO: 172.21.0.1:54258 - "POST /node/69aedc6efeb96b28aa34bf10 HTTP/1.0" 202 Accepted 2026-03-11 14:43:16,368 - lava_callback - INFO - Starting async job submit for node 69aedc6efeb96b28aa34bf10 2026-03-11 14:43:16,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:43:16,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedc6efeb96b28aa34bf10 HTTP/1.1" 200 None 2026-03-11 14:43:16,404 - lava_callback - DEBUG - Processing node 69aedc6efeb96b28aa34bf10: baseline-arm64-clabbe 2026-03-11 14:43:16,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedc6efeb96b28aa34bf10 2026-03-11 14:43:16,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:43:16,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedc6efeb96b28aa34bf10 HTTP/1.1" 200 None 2026-03-11 14:43:16,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:43:16,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:43:16,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:43:16,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedc6efeb96b28aa34bf10 HTTP/1.1" 200 None 2026-03-11 14:43:16,494 - lava_callback - ERROR - Error processing callback for node 69aedc6efeb96b28aa34bf10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:44:15,102 - lava_callback - INFO - Received callback for node 69aedcb3feb96b28aa34bf1a INFO: 172.21.0.1:41278 - "POST /node/69aedcb3feb96b28aa34bf1a HTTP/1.0" 202 Accepted 2026-03-11 14:44:15,107 - lava_callback - INFO - Starting async job submit for node 69aedcb3feb96b28aa34bf1a 2026-03-11 14:44:15,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:44:15,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedcb3feb96b28aa34bf1a HTTP/1.1" 200 None 2026-03-11 14:44:15,125 - lava_callback - DEBUG - Processing node 69aedcb3feb96b28aa34bf1a: baseline-arm64-baylibre 2026-03-11 14:44:15,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedcb3feb96b28aa34bf1a 2026-03-11 14:44:15,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:41280 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 14:44:15,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedcb3feb96b28aa34bf1a HTTP/1.1" 200 None 2026-03-11 14:44:15,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:44:15,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:44:15,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:44:15,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedcb3feb96b28aa34bf1a HTTP/1.1" 200 None 2026-03-11 14:44:15,227 - lava_callback - ERROR - Error processing callback for node 69aedcb3feb96b28aa34bf1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:48:16,533 - lava_callback - INFO - Received callback for node 69aedda4feb96b28aa34bf4c INFO: 172.21.0.1:45372 - "POST /node/69aedda4feb96b28aa34bf4c HTTP/1.0" 202 Accepted 2026-03-11 14:48:16,538 - lava_callback - INFO - Starting async job submit for node 69aedda4feb96b28aa34bf4c 2026-03-11 14:48:16,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:48:16,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedda4feb96b28aa34bf4c HTTP/1.1" 200 None 2026-03-11 14:48:16,554 - lava_callback - DEBUG - Processing node 69aedda4feb96b28aa34bf4c: baseline-arm64-clabbe 2026-03-11 14:48:16,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedda4feb96b28aa34bf4c 2026-03-11 14:48:16,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:48:16,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedda4feb96b28aa34bf4c HTTP/1.1" 200 None 2026-03-11 14:48:16,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:48:16,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:48:16,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:48:16,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedda4feb96b28aa34bf4c HTTP/1.1" 200 None 2026-03-11 14:48:16,613 - lava_callback - ERROR - Error processing callback for node 69aedda4feb96b28aa34bf4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:49:35,322 - lava_callback - INFO - Received callback for node 69aeddedfeb96b28aa34bf99 INFO: 172.21.0.1:54906 - "POST /node/69aeddedfeb96b28aa34bf99 HTTP/1.0" 202 Accepted 2026-03-11 14:49:35,328 - lava_callback - INFO - Starting async job submit for node 69aeddedfeb96b28aa34bf99 2026-03-11 14:49:35,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:49:35,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeddedfeb96b28aa34bf99 HTTP/1.1" 200 None 2026-03-11 14:49:35,345 - lava_callback - DEBUG - Processing node 69aeddedfeb96b28aa34bf99: baseline-arm64-baylibre 2026-03-11 14:49:35,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeddedfeb96b28aa34bf99 2026-03-11 14:49:35,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:49:35,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeddedfeb96b28aa34bf99 HTTP/1.1" 200 None 2026-03-11 14:49:35,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:49:35,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:49:35,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:49:35,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeddedfeb96b28aa34bf99 HTTP/1.1" 200 None 2026-03-11 14:49:35,410 - lava_callback - ERROR - Error processing callback for node 69aeddedfeb96b28aa34bf99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET /node/698a9b49d9a1cfa777a24e88%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:50:56,651 - lava_callback - INFO - Received callback for node 69aede41feb96b28aa34bfb4 INFO: 172.21.0.1:36562 - "POST /node/69aede41feb96b28aa34bfb4 HTTP/1.0" 202 Accepted 2026-03-11 14:50:56,657 - lava_callback - INFO - Starting async job submit for node 69aede41feb96b28aa34bfb4 2026-03-11 14:50:56,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:50:56,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aede41feb96b28aa34bfb4 HTTP/1.1" 200 None 2026-03-11 14:50:56,673 - lava_callback - DEBUG - Processing node 69aede41feb96b28aa34bfb4: baseline-arm64-clabbe 2026-03-11 14:50:56,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aede41feb96b28aa34bfb4 2026-03-11 14:50:56,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:50:56,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aede41feb96b28aa34bfb4 HTTP/1.1" 200 None 2026-03-11 14:50:56,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:50:56,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:50:56,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:50:56,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aede41feb96b28aa34bfb4 HTTP/1.1" 200 None 2026-03-11 14:50:56,734 - lava_callback - ERROR - Error processing callback for node 69aede41feb96b28aa34bfb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:54:56,920 - lava_callback - INFO - Received callback for node 69aedf33feb96b28aa34bff1 INFO: 172.21.0.1:43970 - "POST /node/69aedf33feb96b28aa34bff1 HTTP/1.0" 202 Accepted 2026-03-11 14:54:56,926 - lava_callback - INFO - Starting async job submit for node 69aedf33feb96b28aa34bff1 2026-03-11 14:54:56,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:54:56,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedf33feb96b28aa34bff1 HTTP/1.1" 200 None 2026-03-11 14:54:56,941 - lava_callback - DEBUG - Processing node 69aedf33feb96b28aa34bff1: baseline-arm64-clabbe 2026-03-11 14:54:56,941 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedf33feb96b28aa34bff1 2026-03-11 14:54:56,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:54:56,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedf33feb96b28aa34bff1 HTTP/1.1" 200 None 2026-03-11 14:54:56,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:54:56,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:54:56,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:54:56,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedf33feb96b28aa34bff1 HTTP/1.1" 200 None 2026-03-11 14:54:57,000 - lava_callback - ERROR - Error processing callback for node 69aedf33feb96b28aa34bff1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:57:36,953 - lava_callback - INFO - Received callback for node 69aedfd5feb96b28aa34c022 INFO: 172.21.0.1:39516 - "POST /node/69aedfd5feb96b28aa34c022 HTTP/1.0" 202 Accepted 2026-03-11 14:57:36,958 - lava_callback - INFO - Starting async job submit for node 69aedfd5feb96b28aa34c022 2026-03-11 14:57:36,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:57:36,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedfd5feb96b28aa34c022 HTTP/1.1" 200 None 2026-03-11 14:57:36,975 - lava_callback - DEBUG - Processing node 69aedfd5feb96b28aa34c022: baseline-arm64-clabbe 2026-03-11 14:57:36,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedfd5feb96b28aa34c022 2026-03-11 14:57:36,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:57:37,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedfd5feb96b28aa34c022 HTTP/1.1" 200 None 2026-03-11 14:57:37,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:57:37,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:57:37,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:57:37,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedfd5feb96b28aa34c022 HTTP/1.1" 200 None 2026-03-11 14:57:37,054 - lava_callback - ERROR - Error processing callback for node 69aedfd5feb96b28aa34c022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:58:35,919 - lava_callback - INFO - Received callback for node 69aee011feb96b28aa34c040 INFO: 172.21.0.1:35772 - "POST /node/69aee011feb96b28aa34c040 HTTP/1.0" 202 Accepted 2026-03-11 14:58:35,925 - lava_callback - INFO - Starting async job submit for node 69aee011feb96b28aa34c040 2026-03-11 14:58:35,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:58:35,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee011feb96b28aa34c040 HTTP/1.1" 200 None 2026-03-11 14:58:35,943 - lava_callback - DEBUG - Processing node 69aee011feb96b28aa34c040: baseline-arm-baylibre 2026-03-11 14:58:35,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee011feb96b28aa34c040 2026-03-11 14:58:35,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:58:35,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee011feb96b28aa34c040 HTTP/1.1" 200 None 2026-03-11 14:58:35,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:58:35,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 14:58:35,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:58:36,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee011feb96b28aa34c040 HTTP/1.1" 200 None 2026-03-11 14:58:36,009 - lava_callback - ERROR - Error processing callback for node 69aee011feb96b28aa34c040: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:00:35,775 - lava_callback - INFO - Received callback for node 69aee08bfeb96b28aa34c086 INFO: 172.21.0.1:48278 - "POST /node/69aee08bfeb96b28aa34c086 HTTP/1.0" 202 Accepted 2026-03-11 15:00:35,780 - lava_callback - INFO - Starting async job submit for node 69aee08bfeb96b28aa34c086 2026-03-11 15:00:35,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:00:35,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee08bfeb96b28aa34c086 HTTP/1.1" 200 None 2026-03-11 15:00:35,797 - lava_callback - DEBUG - Processing node 69aee08bfeb96b28aa34c086: baseline-arm-baylibre 2026-03-11 15:00:35,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee08bfeb96b28aa34c086 2026-03-11 15:00:35,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:00:35,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee08bfeb96b28aa34c086 HTTP/1.1" 200 None 2026-03-11 15:00:35,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:00:35,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 15:00:35,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:00:35,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee08bfeb96b28aa34c086 HTTP/1.1" 200 None 2026-03-11 15:00:35,868 - lava_callback - ERROR - Error processing callback for node 69aee08bfeb96b28aa34c086: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:02:57,164 - lava_callback - INFO - Received callback for node 69aee118feb96b28aa34c0cd INFO: 172.21.0.1:50246 - "POST /node/69aee118feb96b28aa34c0cd HTTP/1.0" 202 Accepted 2026-03-11 15:02:57,173 - lava_callback - INFO - Starting async job submit for node 69aee118feb96b28aa34c0cd 2026-03-11 15:02:57,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:02:57,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee118feb96b28aa34c0cd HTTP/1.1" 200 None 2026-03-11 15:02:57,237 - lava_callback - DEBUG - Processing node 69aee118feb96b28aa34c0cd: baseline-arm64-clabbe 2026-03-11 15:02:57,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee118feb96b28aa34c0cd 2026-03-11 15:02:57,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:02:57,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee118feb96b28aa34c0cd HTTP/1.1" 200 None 2026-03-11 15:02:57,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:02:57,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:02:57,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:02:57,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee118feb96b28aa34c0cd HTTP/1.1" 200 None 2026-03-11 15:02:57,362 - lava_callback - ERROR - Error processing callback for node 69aee118feb96b28aa34c0cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 15:04:16,045 - lava_callback - INFO - Received callback for node 69aee15efeb96b28aa34c0de INFO: 172.21.0.1:57098 - "POST /node/69aee15efeb96b28aa34c0de HTTP/1.0" 202 Accepted 2026-03-11 15:04:16,050 - lava_callback - INFO - Starting async job submit for node 69aee15efeb96b28aa34c0de 2026-03-11 15:04:16,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:04:16,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee15efeb96b28aa34c0de HTTP/1.1" 200 None 2026-03-11 15:04:16,069 - lava_callback - DEBUG - Processing node 69aee15efeb96b28aa34c0de: baseline-arm64-baylibre 2026-03-11 15:04:16,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee15efeb96b28aa34c0de 2026-03-11 15:04:16,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:04:16,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee15efeb96b28aa34c0de HTTP/1.1" 200 None 2026-03-11 15:04:16,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:04:16,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:04:16,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:04:16,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee15efeb96b28aa34c0de HTTP/1.1" 200 None 2026-03-11 15:04:16,134 - lava_callback - ERROR - Error processing callback for node 69aee15efeb96b28aa34c0de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33878 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 15:05:16,010 - lava_callback - INFO - Received callback for node 69aee1a5feb96b28aa34c0ea INFO: 172.21.0.1:33888 - "POST /node/69aee1a5feb96b28aa34c0ea HTTP/1.0" 202 Accepted 2026-03-11 15:05:16,016 - lava_callback - INFO - Starting async job submit for node 69aee1a5feb96b28aa34c0ea 2026-03-11 15:05:16,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:05:16,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee1a5feb96b28aa34c0ea HTTP/1.1" 200 None 2026-03-11 15:05:16,033 - lava_callback - DEBUG - Processing node 69aee1a5feb96b28aa34c0ea: baseline-arm-baylibre 2026-03-11 15:05:16,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee1a5feb96b28aa34c0ea 2026-03-11 15:05:16,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:05:16,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee1a5feb96b28aa34c0ea HTTP/1.1" 200 None 2026-03-11 15:05:16,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:05:16,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 15:05:16,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:05:16,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee1a5feb96b28aa34c0ea HTTP/1.1" 200 None 2026-03-11 15:05:16,114 - lava_callback - ERROR - Error processing callback for node 69aee1a5feb96b28aa34c0ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 15:09:16,302 - lava_callback - INFO - Received callback for node 69aee28dfeb96b28aa34c163 INFO: 172.21.0.1:52082 - "POST /node/69aee28dfeb96b28aa34c163 HTTP/1.0" 202 Accepted 2026-03-11 15:09:16,307 - lava_callback - INFO - Starting async job submit for node 69aee28dfeb96b28aa34c163 2026-03-11 15:09:16,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:16,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee28dfeb96b28aa34c163 HTTP/1.1" 200 None 2026-03-11 15:09:16,327 - lava_callback - DEBUG - Processing node 69aee28dfeb96b28aa34c163: baseline-arm-baylibre 2026-03-11 15:09:16,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee28dfeb96b28aa34c163 2026-03-11 15:09:16,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:16,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee28dfeb96b28aa34c163 HTTP/1.1" 200 None 2026-03-11 15:09:16,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:16,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 15:09:16,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:16,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee28dfeb96b28aa34c163 HTTP/1.1" 200 None 2026-03-11 15:09:16,382 - lava_callback - ERROR - Error processing callback for node 69aee28dfeb96b28aa34c163: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:09:56,370 - lava_callback - INFO - Received callback for node 69aee2b8feb96b28aa34c193 INFO: 172.21.0.1:33016 - "POST /node/69aee2b8feb96b28aa34c193 HTTP/1.0" 202 Accepted 2026-03-11 15:09:56,376 - lava_callback - INFO - Starting async job submit for node 69aee2b8feb96b28aa34c193 2026-03-11 15:09:56,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:56,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee2b8feb96b28aa34c193 HTTP/1.1" 200 None 2026-03-11 15:09:56,392 - lava_callback - DEBUG - Processing node 69aee2b8feb96b28aa34c193: baseline-arm-baylibre 2026-03-11 15:09:56,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee2b8feb96b28aa34c193 2026-03-11 15:09:56,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:56,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee2b8feb96b28aa34c193 HTTP/1.1" 200 None 2026-03-11 15:09:56,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:56,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 15:09:56,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:56,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee2b8feb96b28aa34c193 HTTP/1.1" 200 None 2026-03-11 15:09:56,495 - lava_callback - ERROR - Error processing callback for node 69aee2b8feb96b28aa34c193: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:11:56,479 - lava_callback - INFO - Received callback for node 69aee32dfeb96b28aa34c1d4 INFO: 172.21.0.1:45438 - "POST /node/69aee32dfeb96b28aa34c1d4 HTTP/1.0" 202 Accepted 2026-03-11 15:11:56,484 - lava_callback - INFO - Starting async job submit for node 69aee32dfeb96b28aa34c1d4 2026-03-11 15:11:56,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:11:56,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee32dfeb96b28aa34c1d4 HTTP/1.1" 200 None 2026-03-11 15:11:56,501 - lava_callback - DEBUG - Processing node 69aee32dfeb96b28aa34c1d4: baseline-arm-baylibre 2026-03-11 15:11:56,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee32dfeb96b28aa34c1d4 2026-03-11 15:11:56,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:11:56,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee32dfeb96b28aa34c1d4 HTTP/1.1" 200 None 2026-03-11 15:11:56,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:45454 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:11:56,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 15:11:56,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:11:56,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee32dfeb96b28aa34c1d4 HTTP/1.1" 200 None 2026-03-11 15:11:56,570 - lava_callback - ERROR - Error processing callback for node 69aee32dfeb96b28aa34c1d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:15:16,621 - lava_callback - INFO - Received callback for node 69aee3fafeb96b28aa34c215 INFO: 172.21.0.1:54184 - "POST /node/69aee3fafeb96b28aa34c215 HTTP/1.0" 202 Accepted 2026-03-11 15:15:16,627 - lava_callback - INFO - Starting async job submit for node 69aee3fafeb96b28aa34c215 2026-03-11 15:15:16,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:15:16,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee3fafeb96b28aa34c215 HTTP/1.1" 200 None 2026-03-11 15:15:16,644 - lava_callback - DEBUG - Processing node 69aee3fafeb96b28aa34c215: baseline-arm64-baylibre 2026-03-11 15:15:16,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee3fafeb96b28aa34c215 2026-03-11 15:15:16,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:15:16,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee3fafeb96b28aa34c215 HTTP/1.1" 200 None 2026-03-11 15:15:16,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:15:16,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:15:16,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:15:16,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee3fafeb96b28aa34c215 HTTP/1.1" 200 None 2026-03-11 15:15:16,706 - lava_callback - ERROR - Error processing callback for node 69aee3fafeb96b28aa34c215: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:17:56,768 - lava_callback - INFO - Received callback for node 69aee496feb96b28aa34c237 INFO: 172.21.0.1:56902 - "POST /node/69aee496feb96b28aa34c237 HTTP/1.0" 202 Accepted 2026-03-11 15:17:56,774 - lava_callback - INFO - Starting async job submit for node 69aee496feb96b28aa34c237 2026-03-11 15:17:56,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:17:56,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee496feb96b28aa34c237 HTTP/1.1" 200 None 2026-03-11 15:17:56,789 - lava_callback - DEBUG - Processing node 69aee496feb96b28aa34c237: baseline-arm64-baylibre 2026-03-11 15:17:56,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee496feb96b28aa34c237 2026-03-11 15:17:56,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:17:56,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee496feb96b28aa34c237 HTTP/1.1" 200 None 2026-03-11 15:17:56,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:17:56,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:17:56,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:17:56,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee496feb96b28aa34c237 HTTP/1.1" 200 None 2026-03-11 15:17:56,858 - lava_callback - ERROR - Error processing callback for node 69aee496feb96b28aa34c237: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:19:56,928 - lava_callback - INFO - Received callback for node 69aee50afeb96b28aa34c255 INFO: 172.21.0.1:34080 - "POST /node/69aee50afeb96b28aa34c255 HTTP/1.0" 202 Accepted 2026-03-11 15:19:56,934 - lava_callback - INFO - Starting async job submit for node 69aee50afeb96b28aa34c255 2026-03-11 15:19:56,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:19:56,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee50afeb96b28aa34c255 HTTP/1.1" 200 None 2026-03-11 15:19:56,958 - lava_callback - DEBUG - Processing node 69aee50afeb96b28aa34c255: baseline-arm64-baylibre 2026-03-11 15:19:56,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee50afeb96b28aa34c255 2026-03-11 15:19:56,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:19:56,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee50afeb96b28aa34c255 HTTP/1.1" 200 None 2026-03-11 15:19:56,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:19:56,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:19:56,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:19:57,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee50afeb96b28aa34c255 HTTP/1.1" 200 None 2026-03-11 15:19:57,017 - lava_callback - ERROR - Error processing callback for node 69aee50afeb96b28aa34c255: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:22:37,063 - lava_callback - INFO - Received callback for node 69aee5a7feb96b28aa34c28b INFO: 172.21.0.1:42866 - "POST /node/69aee5a7feb96b28aa34c28b HTTP/1.0" 202 Accepted 2026-03-11 15:22:37,069 - lava_callback - INFO - Starting async job submit for node 69aee5a7feb96b28aa34c28b 2026-03-11 15:22:37,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:22:37,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee5a7feb96b28aa34c28b HTTP/1.1" 200 None 2026-03-11 15:22:37,085 - lava_callback - DEBUG - Processing node 69aee5a7feb96b28aa34c28b: baseline-arm64-baylibre 2026-03-11 15:22:37,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee5a7feb96b28aa34c28b 2026-03-11 15:22:37,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:22:37,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee5a7feb96b28aa34c28b HTTP/1.1" 200 None 2026-03-11 15:22:37,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:22:37,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 15:22:37,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:22:37,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee5a7feb96b28aa34c28b HTTP/1.1" 200 None 2026-03-11 15:22:37,153 - lava_callback - ERROR - Error processing callback for node 69aee5a7feb96b28aa34c28b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:23:37,092 - lava_callback - INFO - Received callback for node 69aee5f3feb96b28aa34c29f INFO: 172.21.0.1:55284 - "POST /node/69aee5f3feb96b28aa34c29f HTTP/1.0" 202 Accepted 2026-03-11 15:23:37,097 - lava_callback - INFO - Starting async job submit for node 69aee5f3feb96b28aa34c29f 2026-03-11 15:23:37,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:23:37,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee5f3feb96b28aa34c29f HTTP/1.1" 200 None 2026-03-11 15:23:37,115 - lava_callback - DEBUG - Processing node 69aee5f3feb96b28aa34c29f: baseline-arm64-baylibre 2026-03-11 15:23:37,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee5f3feb96b28aa34c29f 2026-03-11 15:23:37,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:23:37,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee5f3feb96b28aa34c29f HTTP/1.1" 200 None 2026-03-11 15:23:37,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:23:37,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:23:37,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:23:37,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee5f3feb96b28aa34c29f HTTP/1.1" 200 None 2026-03-11 15:23:37,174 - lava_callback - ERROR - Error processing callback for node 69aee5f3feb96b28aa34c29f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35694 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:26:17,277 - lava_callback - INFO - Received callback for node 69aee68dfeb96b28aa34c2b9 INFO: 172.21.0.1:35704 - "POST /node/69aee68dfeb96b28aa34c2b9 HTTP/1.0" 202 Accepted 2026-03-11 15:26:17,283 - lava_callback - INFO - Starting async job submit for node 69aee68dfeb96b28aa34c2b9 2026-03-11 15:26:17,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:26:17,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee68dfeb96b28aa34c2b9 HTTP/1.1" 200 None 2026-03-11 15:26:17,298 - lava_callback - DEBUG - Processing node 69aee68dfeb96b28aa34c2b9: baseline-arm64-baylibre 2026-03-11 15:26:17,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee68dfeb96b28aa34c2b9 2026-03-11 15:26:17,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:26:17,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee68dfeb96b28aa34c2b9 HTTP/1.1" 200 None 2026-03-11 15:26:17,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:26:17,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:26:17,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:26:17,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee68dfeb96b28aa34c2b9 HTTP/1.1" 200 None 2026-03-11 15:26:17,351 - lava_callback - ERROR - Error processing callback for node 69aee68dfeb96b28aa34c2b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:28:57,430 - lava_callback - INFO - Received callback for node 69aee728feb96b28aa34c2d7 INFO: 172.21.0.1:57568 - "POST /node/69aee728feb96b28aa34c2d7 HTTP/1.0" 202 Accepted 2026-03-11 15:28:57,435 - lava_callback - INFO - Starting async job submit for node 69aee728feb96b28aa34c2d7 2026-03-11 15:28:57,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:28:57,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee728feb96b28aa34c2d7 HTTP/1.1" 200 None 2026-03-11 15:28:57,463 - lava_callback - DEBUG - Processing node 69aee728feb96b28aa34c2d7: baseline-arm64-baylibre 2026-03-11 15:28:57,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee728feb96b28aa34c2d7 2026-03-11 15:28:57,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:28:57,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee728feb96b28aa34c2d7 HTTP/1.1" 200 None 2026-03-11 15:28:57,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:28:57,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:28:57,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:28:57,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee728feb96b28aa34c2d7 HTTP/1.1" 200 None 2026-03-11 15:28:57,518 - lava_callback - ERROR - Error processing callback for node 69aee728feb96b28aa34c2d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:33:58,087 - lava_callback - INFO - Received callback for node 69aee859feb96b28aa34c30d INFO: 172.21.0.1:44100 - "POST /node/69aee859feb96b28aa34c30d HTTP/1.0" 202 Accepted 2026-03-11 15:33:58,092 - lava_callback - INFO - Starting async job submit for node 69aee859feb96b28aa34c30d 2026-03-11 15:33:58,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:33:58,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee859feb96b28aa34c30d HTTP/1.1" 200 None 2026-03-11 15:33:58,108 - lava_callback - DEBUG - Processing node 69aee859feb96b28aa34c30d: baseline-arm64-baylibre 2026-03-11 15:33:58,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee859feb96b28aa34c30d 2026-03-11 15:33:58,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:33:58,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee859feb96b28aa34c30d HTTP/1.1" 200 None 2026-03-11 15:33:58,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:33:58,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:33:58,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:33:58,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee859feb96b28aa34c30d HTTP/1.1" 200 None 2026-03-11 15:33:58,167 - lava_callback - ERROR - Error processing callback for node 69aee859feb96b28aa34c30d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:35:17,758 - lava_callback - INFO - Received callback for node 69aee8a6feb96b28aa34c317 INFO: 172.21.0.1:48810 - "POST /node/69aee8a6feb96b28aa34c317 HTTP/1.0" 202 Accepted 2026-03-11 15:35:17,764 - lava_callback - INFO - Starting async job submit for node 69aee8a6feb96b28aa34c317 2026-03-11 15:35:17,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:35:17,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee8a6feb96b28aa34c317 HTTP/1.1" 200 None 2026-03-11 15:35:17,781 - lava_callback - DEBUG - Processing node 69aee8a6feb96b28aa34c317: baseline-arm64-baylibre 2026-03-11 15:35:17,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee8a6feb96b28aa34c317 2026-03-11 15:35:17,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:35:17,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee8a6feb96b28aa34c317 HTTP/1.1" 200 None 2026-03-11 15:35:17,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:35:17,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:35:17,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:35:17,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee8a6feb96b28aa34c317 HTTP/1.1" 200 None 2026-03-11 15:35:17,847 - lava_callback - ERROR - Error processing callback for node 69aee8a6feb96b28aa34c317: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:36:38,598 - lava_callback - INFO - Received callback for node 69aee8fafeb96b28aa34c32a INFO: 172.21.0.1:35326 - "POST /node/69aee8fafeb96b28aa34c32a HTTP/1.0" 202 Accepted 2026-03-11 15:36:38,604 - lava_callback - INFO - Starting async job submit for node 69aee8fafeb96b28aa34c32a 2026-03-11 15:36:38,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:36:38,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee8fafeb96b28aa34c32a HTTP/1.1" 200 None 2026-03-11 15:36:38,619 - lava_callback - DEBUG - Processing node 69aee8fafeb96b28aa34c32a: baseline-arm64-clabbe 2026-03-11 15:36:38,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee8fafeb96b28aa34c32a 2026-03-11 15:36:38,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:36:38,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee8fafeb96b28aa34c32a HTTP/1.1" 200 None 2026-03-11 15:36:38,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:36:38,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:36:38,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:36:38,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee8fafeb96b28aa34c32a HTTP/1.1" 200 None 2026-03-11 15:36:38,682 - lava_callback - ERROR - Error processing callback for node 69aee8fafeb96b28aa34c32a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:37:58,662 - lava_callback - INFO - Received callback for node 69aee949feb96b28aa34c337 INFO: 172.21.0.1:39506 - "POST /node/69aee949feb96b28aa34c337 HTTP/1.0" 202 Accepted 2026-03-11 15:37:58,667 - lava_callback - INFO - Starting async job submit for node 69aee949feb96b28aa34c337 2026-03-11 15:37:58,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:37:58,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee949feb96b28aa34c337 HTTP/1.1" 200 None 2026-03-11 15:37:58,686 - lava_callback - DEBUG - Processing node 69aee949feb96b28aa34c337: baseline-arm64-clabbe 2026-03-11 15:37:58,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee949feb96b28aa34c337 2026-03-11 15:37:58,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:37:58,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee949feb96b28aa34c337 HTTP/1.1" 200 None 2026-03-11 15:37:58,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:37:58,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:37:58,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:37:58,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee949feb96b28aa34c337 HTTP/1.1" 200 None 2026-03-11 15:37:58,739 - lava_callback - ERROR - Error processing callback for node 69aee949feb96b28aa34c337: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:41:58,788 - lava_callback - INFO - Received callback for node 69aeea36feb96b28aa34c361 INFO: 172.21.0.1:49954 - "POST /node/69aeea36feb96b28aa34c361 HTTP/1.0" 202 Accepted 2026-03-11 15:41:58,794 - lava_callback - INFO - Starting async job submit for node 69aeea36feb96b28aa34c361 2026-03-11 15:41:58,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:41:58,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeea36feb96b28aa34c361 HTTP/1.1" 200 None 2026-03-11 15:41:58,810 - lava_callback - DEBUG - Processing node 69aeea36feb96b28aa34c361: baseline-arm64-clabbe 2026-03-11 15:41:58,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeea36feb96b28aa34c361 2026-03-11 15:41:58,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:41:58,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeea36feb96b28aa34c361 HTTP/1.1" 200 None 2026-03-11 15:41:58,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:41:58,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:41:58,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:41:58,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeea36feb96b28aa34c361 HTTP/1.1" 200 None 2026-03-11 15:41:58,870 - lava_callback - ERROR - Error processing callback for node 69aeea36feb96b28aa34c361: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:43:18,863 - lava_callback - INFO - Received callback for node 69aeea86feb96b28aa34c368 INFO: 172.21.0.1:48004 - "POST /node/69aeea86feb96b28aa34c368 HTTP/1.0" 202 Accepted 2026-03-11 15:43:18,869 - lava_callback - INFO - Starting async job submit for node 69aeea86feb96b28aa34c368 2026-03-11 15:43:18,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:43:18,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeea86feb96b28aa34c368 HTTP/1.1" 200 None 2026-03-11 15:43:18,908 - lava_callback - DEBUG - Processing node 69aeea86feb96b28aa34c368: baseline-arm64-clabbe 2026-03-11 15:43:18,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeea86feb96b28aa34c368 2026-03-11 15:43:18,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:43:18,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeea86feb96b28aa34c368 HTTP/1.1" 200 None 2026-03-11 15:43:18,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:43:18,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:43:18,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:43:18,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeea86feb96b28aa34c368 HTTP/1.1" 200 None 2026-03-11 15:43:18,995 - lava_callback - ERROR - Error processing callback for node 69aeea86feb96b28aa34c368: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:13:39,847 - lava_callback - INFO - Received callback for node 69aef1b0feb96b28aa34c4d6 INFO: 172.21.0.1:58466 - "POST /node/69aef1b0feb96b28aa34c4d6 HTTP/1.0" 202 Accepted 2026-03-11 16:13:39,852 - lava_callback - INFO - Starting async job submit for node 69aef1b0feb96b28aa34c4d6 2026-03-11 16:13:39,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:13:39,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef1b0feb96b28aa34c4d6 HTTP/1.1" 200 None 2026-03-11 16:13:39,869 - lava_callback - DEBUG - Processing node 69aef1b0feb96b28aa34c4d6: baseline-arm-baylibre 2026-03-11 16:13:39,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef1b0feb96b28aa34c4d6 2026-03-11 16:13:39,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:13:39,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef1b0feb96b28aa34c4d6 HTTP/1.1" 200 None 2026-03-11 16:13:39,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:13:39,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-11 16:13:39,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:13:39,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef1b0feb96b28aa34c4d6 HTTP/1.1" 200 None 2026-03-11 16:13:39,932 - lava_callback - ERROR - Error processing callback for node 69aef1b0feb96b28aa34c4d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:14:19,859 - lava_callback - INFO - Received callback for node 69aef1d5feb96b28aa34c50b INFO: 172.21.0.1:37706 - "POST /node/69aef1d5feb96b28aa34c50b HTTP/1.0" 202 Accepted 2026-03-11 16:14:19,867 - lava_callback - INFO - Starting async job submit for node 69aef1d5feb96b28aa34c50b 2026-03-11 16:14:19,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:14:19,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef1d5feb96b28aa34c50b HTTP/1.1" 200 None 2026-03-11 16:14:19,892 - lava_callback - DEBUG - Processing node 69aef1d5feb96b28aa34c50b: baseline-arm-baylibre 2026-03-11 16:14:19,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef1d5feb96b28aa34c50b 2026-03-11 16:14:19,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:14:19,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef1d5feb96b28aa34c50b HTTP/1.1" 200 None 2026-03-11 16:14:19,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:14:19,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-11 16:14:19,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:14:19,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef1d5feb96b28aa34c50b HTTP/1.1" 200 None 2026-03-11 16:14:19,981 - lava_callback - ERROR - Error processing callback for node 69aef1d5feb96b28aa34c50b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1] INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50994 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.21.0.1:51000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:33:53,201 - lava_callback - INFO - Received callback for node 69b12878a870a1dc3343bac8 2026-03-11 08:33:53,208 - lava_callback - INFO - Starting async job submit for node 69b12878a870a1dc3343bac8 INFO: 172.21.0.1:39072 - "POST /node/69b12878a870a1dc3343bac8 HTTP/1.0" 202 Accepted 2026-03-11 08:33:53,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:33:53,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12878a870a1dc3343bac8 HTTP/1.1" 200 None 2026-03-11 08:33:53,281 - lava_callback - DEBUG - Processing node 69b12878a870a1dc3343bac8: baseline-arm 2026-03-11 08:33:53,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:33:53,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:33:53,727 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b12878a870a1dc3343bac8/log.txt.gz 2026-03-11 08:33:53,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:33:54,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:33:54,042 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b12878a870a1dc3343bac8/lava-logs.yaml 2026-03-11 08:33:54,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:33:54,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:33:54,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b12878a870a1dc3343bac8/lava_callback.json.gz 2026-03-11 08:33:54,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:33:54,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12878a870a1dc3343bac8 HTTP/1.1" 200 None 2026-03-11 08:33:54,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:33:54,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12599a870a1dc3343ba8b HTTP/1.1" 200 None 2026-03-11 08:33:54,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:33:54,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12878a870a1dc3343bac8 HTTP/1.1" 200 None 2026-03-11 08:33:54,286 - lava_callback - INFO - Completed processing callback for node 69b12878a870a1dc3343bac8 INFO: 172.21.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36774 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:34:24,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:34:24,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52404 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:38:35,443 - lava_callback - INFO - Received callback for node 69b129eea870a1dc3343bae8 INFO: 172.21.0.1:52416 - "POST /node/69b129eea870a1dc3343bae8 HTTP/1.0" 202 Accepted 2026-03-11 08:38:35,490 - lava_callback - INFO - Starting async job submit for node 69b129eea870a1dc3343bae8 2026-03-11 08:38:35,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:35,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eea870a1dc3343bae8 HTTP/1.1" 200 None 2026-03-11 08:38:35,525 - lava_callback - DEBUG - Processing node 69b129eea870a1dc3343bae8: baseline-arm 2026-03-11 08:38:35,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:35,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:35,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343bae8/log.txt.gz 2026-03-11 08:38:35,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:36,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:36,186 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343bae8/lava-logs.yaml 2026-03-11 08:38:36,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:36,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:36,318 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343bae8/lava_callback.json.gz 2026-03-11 08:38:36,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:36,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eea870a1dc3343bae8 HTTP/1.1" 200 None 2026-03-11 08:38:36,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:36,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:38:36,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:36,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129eea870a1dc3343bae8 HTTP/1.1" 200 None 2026-03-11 08:38:36,410 - lava_callback - INFO - Completed processing callback for node 69b129eea870a1dc3343bae8 INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:38:36,558 - lava_callback - INFO - Received callback for node 69b129eda870a1dc3343bae5 INFO: 172.21.0.1:52424 - "POST /node/69b129eda870a1dc3343bae5 HTTP/1.0" 202 Accepted 2026-03-11 08:38:36,568 - lava_callback - INFO - Starting async job submit for node 69b129eda870a1dc3343bae5 2026-03-11 08:38:36,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:36,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eda870a1dc3343bae5 HTTP/1.1" 200 None 2026-03-11 08:38:36,603 - lava_callback - DEBUG - Processing node 69b129eda870a1dc3343bae5: baseline-arm 2026-03-11 08:38:36,611 - lava_callback - WARNING - Failed to upload log 2026-03-11 08:38:36,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:36,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:36,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eda870a1dc3343bae5/lava-logs.yaml 2026-03-11 08:38:36,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:36,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:36,959 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eda870a1dc3343bae5/lava_callback.json.gz 2026-03-11 08:38:36,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:36,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eda870a1dc3343bae5 HTTP/1.1" 200 None 2026-03-11 08:38:36,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:37,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:38:37,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:37,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129eda870a1dc3343bae5 HTTP/1.1" 200 None 2026-03-11 08:38:37,037 - lava_callback - INFO - Completed processing callback for node 69b129eda870a1dc3343bae5 INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:38:54,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:54,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 08:38:54,632 - lava_callback - INFO - Received callback for node 69b129f1a870a1dc3343baf1 INFO: 172.21.0.1:46210 - "POST /node/69b129f1a870a1dc3343baf1 HTTP/1.0" 202 Accepted 2026-03-11 08:38:54,681 - lava_callback - INFO - Starting async job submit for node 69b129f1a870a1dc3343baf1 2026-03-11 08:38:54,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:54,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f1a870a1dc3343baf1 HTTP/1.1" 200 None 2026-03-11 08:38:54,714 - lava_callback - DEBUG - Processing node 69b129f1a870a1dc3343baf1: baseline-arm 2026-03-11 08:38:54,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:54,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:54,981 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f1a870a1dc3343baf1/log.txt.gz 2026-03-11 08:38:55,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:55,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:55,315 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f1a870a1dc3343baf1/lava-logs.yaml 2026-03-11 08:38:55,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:38:55,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:38:55,437 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f1a870a1dc3343baf1/lava_callback.json.gz 2026-03-11 08:38:55,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:55,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f1a870a1dc3343baf1 HTTP/1.1" 200 None 2026-03-11 08:38:55,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:55,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:38:55,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:38:55,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129f1a870a1dc3343baf1 HTTP/1.1" 200 None 2026-03-11 08:38:55,521 - lava_callback - INFO - Completed processing callback for node 69b129f1a870a1dc3343baf1 INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:39:24,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:24,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56786 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:39:39,300 - lava_callback - INFO - Received callback for node 69b12a0ea870a1dc3343bb77 INFO: 172.21.0.1:56802 - "POST /node/69b12a0ea870a1dc3343bb77 HTTP/1.0" 202 Accepted 2026-03-11 08:39:39,345 - lava_callback - INFO - Starting async job submit for node 69b12a0ea870a1dc3343bb77 2026-03-11 08:39:39,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:39,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0ea870a1dc3343bb77 HTTP/1.1" 200 None 2026-03-11 08:39:39,392 - lava_callback - DEBUG - Processing node 69b12a0ea870a1dc3343bb77: baseline-arm-pengutronix 2026-03-11 08:39:39,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:39,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:39,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ea870a1dc3343bb77/log.txt.gz 2026-03-11 08:39:39,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:39,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:39,897 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ea870a1dc3343bb77/lava-logs.yaml 2026-03-11 08:39:39,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:40,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:40,049 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ea870a1dc3343bb77/lava_callback.json.gz 2026-03-11 08:39:40,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:40,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0ea870a1dc3343bb77 HTTP/1.1" 200 None 2026-03-11 08:39:40,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:40,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:39:40,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:40,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a0ea870a1dc3343bb77 HTTP/1.1" 200 None 2026-03-11 08:39:40,153 - lava_callback - INFO - Completed processing callback for node 69b12a0ea870a1dc3343bb77 2026-03-11 08:39:44,972 - lava_callback - INFO - Received callback for node 69b12a0ba870a1dc3343bb6b INFO: 172.21.0.1:59564 - "POST /node/69b12a0ba870a1dc3343bb6b HTTP/1.0" 202 Accepted 2026-03-11 08:39:44,978 - lava_callback - INFO - Starting async job submit for node 69b12a0ba870a1dc3343bb6b 2026-03-11 08:39:44,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:45,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0ba870a1dc3343bb6b HTTP/1.1" 200 None 2026-03-11 08:39:45,012 - lava_callback - DEBUG - Processing node 69b12a0ba870a1dc3343bb6b: baseline-arm-pengutronix 2026-03-11 08:39:45,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:45,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:45,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ba870a1dc3343bb6b/log.txt.gz 2026-03-11 08:39:45,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:45,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:45,642 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ba870a1dc3343bb6b/lava-logs.yaml 2026-03-11 08:39:45,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:45,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:45,778 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0ba870a1dc3343bb6b/lava_callback.json.gz 2026-03-11 08:39:45,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:45,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0ba870a1dc3343bb6b HTTP/1.1" 200 None 2026-03-11 08:39:45,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:45,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:39:45,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:45,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a0ba870a1dc3343bb6b HTTP/1.1" 200 None 2026-03-11 08:39:45,908 - lava_callback - INFO - Completed processing callback for node 69b12a0ba870a1dc3343bb6b INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:39:53,416 - lava_callback - INFO - Received callback for node 69b129fba870a1dc3343bb06 INFO: 172.21.0.1:38496 - "POST /node/69b129fba870a1dc3343bb06 HTTP/1.0" 202 Accepted 2026-03-11 08:39:53,424 - lava_callback - INFO - Starting async job submit for node 69b129fba870a1dc3343bb06 2026-03-11 08:39:53,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:53,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129fba870a1dc3343bb06 HTTP/1.1" 200 None 2026-03-11 08:39:53,461 - lava_callback - DEBUG - Processing node 69b129fba870a1dc3343bb06: baseline-arm-broonie 2026-03-11 08:39:53,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:53,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:53,801 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fba870a1dc3343bb06/log.txt.gz 2026-03-11 08:39:53,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:54,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:54,113 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fba870a1dc3343bb06/lava-logs.yaml 2026-03-11 08:39:54,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:54,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:54,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fba870a1dc3343bb06/lava_callback.json.gz 2026-03-11 08:39:54,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:54,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129fba870a1dc3343bb06 HTTP/1.1" 200 None 2026-03-11 08:39:54,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:54,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:39:54,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:54,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129fba870a1dc3343bb06 HTTP/1.1" 200 None 2026-03-11 08:39:54,334 - lava_callback - INFO - Completed processing callback for node 69b129fba870a1dc3343bb06 2026-03-11 08:39:54,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:54,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 08:39:54,883 - lava_callback - INFO - Received callback for node 69b129eca870a1dc3343bae2 INFO: 172.21.0.1:38504 - "POST /node/69b129eca870a1dc3343bae2 HTTP/1.0" 202 Accepted 2026-03-11 08:39:54,889 - lava_callback - INFO - Starting async job submit for node 69b129eca870a1dc3343bae2 2026-03-11 08:39:54,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:54,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eca870a1dc3343bae2 HTTP/1.1" 200 None 2026-03-11 08:39:54,935 - lava_callback - DEBUG - Processing node 69b129eca870a1dc3343bae2: baseline-arm 2026-03-11 08:39:55,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:55,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:55,235 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eca870a1dc3343bae2/log.txt.gz 2026-03-11 08:39:55,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:55,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:55,526 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eca870a1dc3343bae2/lava-logs.yaml 2026-03-11 08:39:55,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:39:55,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:39:55,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eca870a1dc3343bae2/lava_callback.json.gz 2026-03-11 08:39:55,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:55,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eca870a1dc3343bae2 HTTP/1.1" 200 None 2026-03-11 08:39:55,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:55,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:39:55,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:39:55,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129eca870a1dc3343bae2 HTTP/1.1" 200 None 2026-03-11 08:39:55,765 - lava_callback - INFO - Completed processing callback for node 69b129eca870a1dc3343bae2 INFO: 172.21.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:40:09,937 - lava_callback - INFO - Received callback for node 69b12a00a870a1dc3343bb18 INFO: 172.21.0.1:40794 - "POST /node/69b12a00a870a1dc3343bb18 HTTP/1.0" 202 Accepted 2026-03-11 08:40:09,943 - lava_callback - INFO - Starting async job submit for node 69b12a00a870a1dc3343bb18 2026-03-11 08:40:09,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:09,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a00a870a1dc3343bb18 HTTP/1.1" 200 None 2026-03-11 08:40:09,978 - lava_callback - DEBUG - Processing node 69b12a00a870a1dc3343bb18: baseline-arm-clabbe 2026-03-11 08:40:10,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:10,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:10,353 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a00a870a1dc3343bb18/log.txt.gz 2026-03-11 08:40:10,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:10,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:10,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a00a870a1dc3343bb18/lava-logs.yaml 2026-03-11 08:40:10,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:10,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:10,828 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a00a870a1dc3343bb18/lava_callback.json.gz 2026-03-11 08:40:10,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:10,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a00a870a1dc3343bb18 HTTP/1.1" 200 None 2026-03-11 08:40:10,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:10,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:40:10,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:10,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a00a870a1dc3343bb18 HTTP/1.1" 200 None 2026-03-11 08:40:10,912 - lava_callback - INFO - Completed processing callback for node 69b12a00a870a1dc3343bb18 2026-03-11 08:40:13,662 - lava_callback - INFO - Received callback for node 69b129faa870a1dc3343baff INFO: 172.21.0.1:40796 - "POST /node/69b129faa870a1dc3343baff HTTP/1.0" 202 Accepted 2026-03-11 08:40:13,668 - lava_callback - INFO - Starting async job submit for node 69b129faa870a1dc3343baff 2026-03-11 08:40:13,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:13,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129faa870a1dc3343baff HTTP/1.1" 200 None 2026-03-11 08:40:13,705 - lava_callback - DEBUG - Processing node 69b129faa870a1dc3343baff: baseline-arm-broonie 2026-03-11 08:40:13,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:14,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:14,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129faa870a1dc3343baff/log.txt.gz 2026-03-11 08:40:14,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:14,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:14,327 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129faa870a1dc3343baff/lava-logs.yaml 2026-03-11 08:40:14,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:14,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:14,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129faa870a1dc3343baff/lava_callback.json.gz 2026-03-11 08:40:14,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:14,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129faa870a1dc3343baff HTTP/1.1" 200 None 2026-03-11 08:40:14,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:14,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:40:14,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:14,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129faa870a1dc3343baff HTTP/1.1" 200 None 2026-03-11 08:40:14,568 - lava_callback - INFO - Completed processing callback for node 69b129faa870a1dc3343baff INFO: 172.21.0.1:40812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40828 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:40:19,106 - lava_callback - INFO - Received callback for node 69b129fca870a1dc3343bb09 INFO: 172.21.0.1:40844 - "POST /node/69b129fca870a1dc3343bb09 HTTP/1.0" 202 Accepted 2026-03-11 08:40:19,112 - lava_callback - INFO - Starting async job submit for node 69b129fca870a1dc3343bb09 2026-03-11 08:40:19,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:19,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129fca870a1dc3343bb09 HTTP/1.1" 200 None 2026-03-11 08:40:19,151 - lava_callback - DEBUG - Processing node 69b129fca870a1dc3343bb09: baseline-arm-broonie 2026-03-11 08:40:19,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:19,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:19,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fca870a1dc3343bb09/log.txt.gz 2026-03-11 08:40:19,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:19,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:19,861 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fca870a1dc3343bb09/lava-logs.yaml 2026-03-11 08:40:19,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:20,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:20,026 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129fca870a1dc3343bb09/lava_callback.json.gz 2026-03-11 08:40:20,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:20,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129fca870a1dc3343bb09 HTTP/1.1" 200 None 2026-03-11 08:40:20,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:20,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:40:20,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:20,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129fca870a1dc3343bb09 HTTP/1.1" 200 None 2026-03-11 08:40:20,106 - lava_callback - INFO - Completed processing callback for node 69b129fca870a1dc3343bb09 2026-03-11 08:40:20,432 - lava_callback - INFO - Received callback for node 69b12a09a870a1dc3343bb60 INFO: 172.21.0.1:48176 - "POST /node/69b12a09a870a1dc3343bb60 HTTP/1.0" 202 Accepted 2026-03-11 08:40:20,442 - lava_callback - INFO - Starting async job submit for node 69b12a09a870a1dc3343bb60 2026-03-11 08:40:20,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:20,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a09a870a1dc3343bb60 HTTP/1.1" 200 None 2026-03-11 08:40:20,493 - lava_callback - DEBUG - Processing node 69b12a09a870a1dc3343bb60: baseline-arm-kontron 2026-03-11 08:40:20,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:20,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:20,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b12a09a870a1dc3343bb60/log.txt.gz 2026-03-11 08:40:20,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:21,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:21,090 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b12a09a870a1dc3343bb60/lava-logs.yaml 2026-03-11 08:40:21,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:21,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:21,242 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69b12a09a870a1dc3343bb60/lava_callback.json.gz 2026-03-11 08:40:21,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:21,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a09a870a1dc3343bb60 HTTP/1.1" 200 None 2026-03-11 08:40:21,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:21,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:40:21,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:21,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a09a870a1dc3343bb60 HTTP/1.1" 200 None 2026-03-11 08:40:21,327 - lava_callback - INFO - Completed processing callback for node 69b12a09a870a1dc3343bb60 2026-03-11 08:40:24,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:24,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53250 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:40:59,096 - lava_callback - INFO - Received callback for node 69b129f8a870a1dc3343bafc INFO: 172.21.0.1:53260 - "POST /node/69b129f8a870a1dc3343bafc HTTP/1.0" 202 Accepted 2026-03-11 08:40:59,103 - lava_callback - INFO - Starting async job submit for node 69b129f8a870a1dc3343bafc 2026-03-11 08:40:59,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:59,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f8a870a1dc3343bafc HTTP/1.1" 200 None 2026-03-11 08:40:59,142 - lava_callback - DEBUG - Processing node 69b129f8a870a1dc3343bafc: baseline-arm-broonie 2026-03-11 08:40:59,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:59,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:59,499 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129f8a870a1dc3343bafc/log.txt.gz 2026-03-11 08:40:59,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:59,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:59,814 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129f8a870a1dc3343bafc/lava-logs.yaml 2026-03-11 08:40:59,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:40:59,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:40:59,958 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69b129f8a870a1dc3343bafc/lava_callback.json.gz 2026-03-11 08:40:59,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:40:59,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f8a870a1dc3343bafc HTTP/1.1" 200 None 2026-03-11 08:40:59,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:00,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:41:00,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:00,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129f8a870a1dc3343bafc HTTP/1.1" 200 None 2026-03-11 08:41:00,073 - lava_callback - INFO - Completed processing callback for node 69b129f8a870a1dc3343bafc INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:41:24,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:24,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:41:57,190 - lava_callback - INFO - Received callback for node 69b12a01a870a1dc3343bb1c INFO: 172.21.0.1:47432 - "POST /node/69b12a01a870a1dc3343bb1c HTTP/1.0" 202 Accepted 2026-03-11 08:41:57,199 - lava_callback - INFO - Starting async job submit for node 69b12a01a870a1dc3343bb1c 2026-03-11 08:41:57,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:57,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a01a870a1dc3343bb1c HTTP/1.1" 200 None 2026-03-11 08:41:57,272 - lava_callback - DEBUG - Processing node 69b12a01a870a1dc3343bb1c: baseline-arm-clabbe 2026-03-11 08:41:57,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:41:57,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:41:57,990 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a01a870a1dc3343bb1c/log.txt.gz 2026-03-11 08:41:58,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:41:58,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:41:58,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a01a870a1dc3343bb1c/lava-logs.yaml 2026-03-11 08:41:58,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:41:59,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:41:59,173 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a01a870a1dc3343bb1c/lava_callback.json.gz 2026-03-11 08:41:59,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:59,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a01a870a1dc3343bb1c HTTP/1.1" 200 None 2026-03-11 08:41:59,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:59,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:41:59,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:41:59,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a01a870a1dc3343bb1c HTTP/1.1" 200 None 2026-03-11 08:41:59,309 - lava_callback - INFO - Completed processing callback for node 69b12a01a870a1dc3343bb1c INFO: 172.21.0.1:39266 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:42:09,596 - lava_callback - INFO - Received callback for node 69b12ad9a870a1dc3343bc68 INFO: 172.21.0.1:39282 - "POST /node/69b12ad9a870a1dc3343bc68 HTTP/1.0" 202 Accepted 2026-03-11 08:42:09,605 - lava_callback - INFO - Starting async job submit for node 69b12ad9a870a1dc3343bc68 2026-03-11 08:42:09,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:42:09,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ad9a870a1dc3343bc68 HTTP/1.1" 200 None 2026-03-11 08:42:09,638 - lava_callback - DEBUG - Processing node 69b12ad9a870a1dc3343bc68: baseline-arm 2026-03-11 08:42:09,646 - lava_callback - WARNING - Failed to upload log 2026-03-11 08:42:09,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:42:10,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:42:10,052 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b12ad9a870a1dc3343bc68/lava-logs.yaml 2026-03-11 08:42:10,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:42:10,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:42:10,449 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b12ad9a870a1dc3343bc68/lava_callback.json.gz 2026-03-11 08:42:10,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:42:10,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ad9a870a1dc3343bc68 HTTP/1.1" 200 None 2026-03-11 08:42:10,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:42:10,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:42:10,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:42:10,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12ad9a870a1dc3343bc68 HTTP/1.1" 200 None 2026-03-11 08:42:10,563 - lava_callback - INFO - Completed processing callback for node 69b12ad9a870a1dc3343bc68 INFO: 172.21.0.1:58908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:42:24,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:42:24,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:43:36,045 - lava_callback - INFO - Received callback for node 69b12a05a870a1dc3343bb29 INFO: 172.21.0.1:35608 - "POST /node/69b12a05a870a1dc3343bb29 HTTP/1.0" 202 Accepted 2026-03-11 08:43:36,051 - lava_callback - INFO - Starting async job submit for node 69b12a05a870a1dc3343bb29 2026-03-11 08:43:36,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:36,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a05a870a1dc3343bb29 HTTP/1.1" 200 None 2026-03-11 08:43:36,088 - lava_callback - DEBUG - Processing node 69b12a05a870a1dc3343bb29: baseline-arm-clabbe 2026-03-11 08:43:36,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:43:36,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:43:36,443 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a05a870a1dc3343bb29/log.txt.gz INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:43:36,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:43:36,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:43:36,797 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a05a870a1dc3343bb29/lava-logs.yaml 2026-03-11 08:43:36,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:43:36,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:43:36,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a05a870a1dc3343bb29/lava_callback.json.gz 2026-03-11 08:43:36,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:36,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a05a870a1dc3343bb29 HTTP/1.1" 200 None 2026-03-11 08:43:36,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:37,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:43:37,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:37,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a05a870a1dc3343bb29 HTTP/1.1" 200 None 2026-03-11 08:43:37,040 - lava_callback - INFO - Completed processing callback for node 69b12a05a870a1dc3343bb29 INFO: 172.21.0.1:36348 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:43:54,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:54,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55412 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:43:59,337 - lava_callback - INFO - Received callback for node 69b12a36a870a1dc3343bbc6 INFO: 172.21.0.1:55414 - "POST /node/69b12a36a870a1dc3343bbc6 HTTP/1.0" 202 Accepted 2026-03-11 08:43:59,347 - lava_callback - INFO - Starting async job submit for node 69b12a36a870a1dc3343bbc6 2026-03-11 08:43:59,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:43:59,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a36a870a1dc3343bbc6 HTTP/1.1" 200 None 2026-03-11 08:43:59,403 - lava_callback - DEBUG - Processing node 69b12a36a870a1dc3343bbc6: ltp-syscalls 2026-03-11 08:44:00,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:00,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:00,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b12a36a870a1dc3343bbc6/log.txt.gz 2026-03-11 08:44:00,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:01,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:01,101 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b12a36a870a1dc3343bbc6/lava-logs.yaml 2026-03-11 08:44:01,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:01,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:01,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69b12a36a870a1dc3343bbc6/lava_callback.json.gz 2026-03-11 08:44:01,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:01,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a36a870a1dc3343bbc6 HTTP/1.1" 200 None 2026-03-11 08:44:01,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:01,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:44:01,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:01,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a36a870a1dc3343bbc6 HTTP/1.1" 200 None 2026-03-11 08:44:01,363 - lava_callback - INFO - Completed processing callback for node 69b12a36a870a1dc3343bbc6 INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:44:19,164 - lava_callback - INFO - Received callback for node 69b12a1ea870a1dc3343bb82 INFO: 172.21.0.1:42200 - "POST /node/69b12a1ea870a1dc3343bb82 HTTP/1.0" 202 Accepted 2026-03-11 08:44:19,170 - lava_callback - INFO - Starting async job submit for node 69b12a1ea870a1dc3343bb82 2026-03-11 08:44:19,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:19,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a1ea870a1dc3343bb82 HTTP/1.1" 200 None 2026-03-11 08:44:19,211 - lava_callback - DEBUG - Processing node 69b12a1ea870a1dc3343bb82: ltp-cap_bounds 2026-03-11 08:44:19,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:19,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:19,752 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b12a1ea870a1dc3343bb82/log.txt.gz 2026-03-11 08:44:19,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:20,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:20,188 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b12a1ea870a1dc3343bb82/lava-logs.yaml 2026-03-11 08:44:20,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:44:20,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:44:20,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69b12a1ea870a1dc3343bb82/lava_callback.json.gz 2026-03-11 08:44:20,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:20,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a1ea870a1dc3343bb82 HTTP/1.1" 200 None 2026-03-11 08:44:20,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:20,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:44:20,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:20,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a1ea870a1dc3343bb82 HTTP/1.1" 200 None 2026-03-11 08:44:20,443 - lava_callback - INFO - Completed processing callback for node 69b12a1ea870a1dc3343bb82 2026-03-11 08:44:24,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:44:24,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:45:13,709 - lava_callback - INFO - Received callback for node 69b12a20a870a1dc3343bb89 INFO: 172.21.0.1:43960 - "POST /node/69b12a20a870a1dc3343bb89 HTTP/1.0" 202 Accepted 2026-03-11 08:45:13,715 - lava_callback - INFO - Starting async job submit for node 69b12a20a870a1dc3343bb89 2026-03-11 08:45:13,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:13,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a20a870a1dc3343bb89 HTTP/1.1" 200 None 2026-03-11 08:45:13,754 - lava_callback - DEBUG - Processing node 69b12a20a870a1dc3343bb89: ltp-containers 2026-03-11 08:45:14,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:14,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:14,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69b12a20a870a1dc3343bb89/log.txt.gz 2026-03-11 08:45:14,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:14,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:14,731 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69b12a20a870a1dc3343bb89/lava-logs.yaml 2026-03-11 08:45:14,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:14,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:14,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69b12a20a870a1dc3343bb89/lava_callback.json.gz 2026-03-11 08:45:14,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:14,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a20a870a1dc3343bb89 HTTP/1.1" 200 None 2026-03-11 08:45:14,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:14,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:45:14,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:15,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a20a870a1dc3343bb89 HTTP/1.1" 200 None 2026-03-11 08:45:15,032 - lava_callback - INFO - Completed processing callback for node 69b12a20a870a1dc3343bb89 INFO: 172.21.0.1:43962 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 08:45:15,208 - lava_callback - INFO - Received callback for node 69b12a06a870a1dc3343bb2c INFO: 172.21.0.1:43970 - "POST /node/69b12a06a870a1dc3343bb2c HTTP/1.0" 202 Accepted 2026-03-11 08:45:15,218 - lava_callback - INFO - Starting async job submit for node 69b12a06a870a1dc3343bb2c 2026-03-11 08:45:15,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:15,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a06a870a1dc3343bb2c HTTP/1.1" 200 None 2026-03-11 08:45:15,271 - lava_callback - DEBUG - Processing node 69b12a06a870a1dc3343bb2c: baseline-arm-clabbe 2026-03-11 08:45:15,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:15,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:15,651 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a06a870a1dc3343bb2c/log.txt.gz 2026-03-11 08:45:15,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:15,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:15,973 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a06a870a1dc3343bb2c/lava-logs.yaml 2026-03-11 08:45:15,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:16,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:16,154 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69b12a06a870a1dc3343bb2c/lava_callback.json.gz 2026-03-11 08:45:16,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:16,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a06a870a1dc3343bb2c HTTP/1.1" 200 None 2026-03-11 08:45:16,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:16,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:45:16,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:16,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a06a870a1dc3343bb2c HTTP/1.1" 200 None 2026-03-11 08:45:16,242 - lava_callback - INFO - Completed processing callback for node 69b12a06a870a1dc3343bb2c INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:45:19,467 - lava_callback - INFO - Received callback for node 69b12a21a870a1dc3343bb90 INFO: 172.21.0.1:43982 - "POST /node/69b12a21a870a1dc3343bb90 HTTP/1.0" 202 Accepted 2026-03-11 08:45:19,475 - lava_callback - INFO - Starting async job submit for node 69b12a21a870a1dc3343bb90 2026-03-11 08:45:19,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:19,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a21a870a1dc3343bb90 HTTP/1.1" 200 None 2026-03-11 08:45:19,524 - lava_callback - DEBUG - Processing node 69b12a21a870a1dc3343bb90: ltp-controllers 2026-03-11 08:45:19,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:20,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:20,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69b12a21a870a1dc3343bb90/log.txt.gz 2026-03-11 08:45:20,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:20,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:20,598 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69b12a21a870a1dc3343bb90/lava-logs.yaml 2026-03-11 08:45:20,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:20,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:20,768 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69b12a21a870a1dc3343bb90/lava_callback.json.gz 2026-03-11 08:45:20,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:20,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a21a870a1dc3343bb90 HTTP/1.1" 200 None 2026-03-11 08:45:20,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:20,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:45:20,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:20,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a21a870a1dc3343bb90 HTTP/1.1" 200 None 2026-03-11 08:45:20,870 - lava_callback - INFO - Completed processing callback for node 69b12a21a870a1dc3343bb90 2026-03-11 08:45:24,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:24,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:45:39,828 - lava_callback - INFO - Received callback for node 69b12a24a870a1dc3343bbab INFO: 172.21.0.1:42584 - "POST /node/69b12a24a870a1dc3343bbab HTTP/1.0" 202 Accepted 2026-03-11 08:45:39,835 - lava_callback - INFO - Starting async job submit for node 69b12a24a870a1dc3343bbab 2026-03-11 08:45:39,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:39,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a24a870a1dc3343bbab HTTP/1.1" 200 None 2026-03-11 08:45:39,875 - lava_callback - DEBUG - Processing node 69b12a24a870a1dc3343bbab: ltp-cve 2026-03-11 08:45:40,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:40,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:40,379 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69b12a24a870a1dc3343bbab/log.txt.gz 2026-03-11 08:45:40,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:40,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:40,887 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69b12a24a870a1dc3343bbab/lava-logs.yaml 2026-03-11 08:45:40,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:45:41,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:45:41,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69b12a24a870a1dc3343bbab/lava_callback.json.gz 2026-03-11 08:45:41,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:41,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a24a870a1dc3343bbab HTTP/1.1" 200 None 2026-03-11 08:45:41,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:41,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:45:41,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:41,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a24a870a1dc3343bbab HTTP/1.1" 200 None 2026-03-11 08:45:41,200 - lava_callback - INFO - Completed processing callback for node 69b12a24a870a1dc3343bbab INFO: 172.21.0.1:42600 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:45:54,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:45:54,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:46:51,683 - lava_callback - INFO - Received callback for node 69b12be7a870a1dc3343bd14 INFO: 172.21.0.1:40862 - "POST /node/69b12be7a870a1dc3343bd14 HTTP/1.0" 202 Accepted 2026-03-11 08:46:51,689 - lava_callback - INFO - Starting async job submit for node 69b12be7a870a1dc3343bd14 2026-03-11 08:46:51,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:46:51,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12be7a870a1dc3343bd14 HTTP/1.1" 200 None 2026-03-11 08:46:51,709 - lava_callback - DEBUG - Processing node 69b12be7a870a1dc3343bd14: baseline-arm 2026-03-11 08:46:51,714 - lava_callback - WARNING - Failed to upload log 2026-03-11 08:46:51,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:46:51,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:46:51,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b12be7a870a1dc3343bd14/lava-logs.yaml 2026-03-11 08:46:51,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:46:52,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:46:52,037 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b12be7a870a1dc3343bd14/lava_callback.json.gz 2026-03-11 08:46:52,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:46:52,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12be7a870a1dc3343bd14 HTTP/1.1" 200 None 2026-03-11 08:46:52,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:46:52,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:46:52,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:46:52,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12be7a870a1dc3343bd14 HTTP/1.1" 200 None 2026-03-11 08:46:52,102 - lava_callback - INFO - Completed processing callback for node 69b12be7a870a1dc3343bd14 2026-03-11 08:46:54,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:46:54,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:47:55,713 - lava_callback - INFO - Received callback for node 69ae8928c660ead8a389aebd INFO: 172.21.0.1:46496 - "POST /node/69ae8928c660ead8a389aebd HTTP/1.0" 202 Accepted 2026-03-11 08:47:55,718 - lava_callback - INFO - Starting async job submit for node 69ae8928c660ead8a389aebd 2026-03-11 08:47:55,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:55,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8928c660ead8a389aebd HTTP/1.1" 200 None 2026-03-11 08:47:55,734 - lava_callback - DEBUG - Processing node 69ae8928c660ead8a389aebd: baseline-arm-baylibre 2026-03-11 08:47:55,734 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8928c660ead8a389aebd 2026-03-11 08:47:55,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:55,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8928c660ead8a389aebd HTTP/1.1" 200 None 2026-03-11 08:47:55,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:55,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:55,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:55,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8928c660ead8a389aebd HTTP/1.1" 200 None 2026-03-11 08:47:55,810 - lava_callback - ERROR - Error processing callback for node 69ae8928c660ead8a389aebd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:47:56,376 - lava_callback - INFO - Received callback for node 69ae8929c660ead8a389aec0 INFO: 172.21.0.1:46510 - "POST /node/69ae8929c660ead8a389aec0 HTTP/1.0" 202 Accepted 2026-03-11 08:47:56,383 - lava_callback - INFO - Starting async job submit for node 69ae8929c660ead8a389aec0 2026-03-11 08:47:56,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:56,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8929c660ead8a389aec0 HTTP/1.1" 200 None 2026-03-11 08:47:56,399 - lava_callback - DEBUG - Processing node 69ae8929c660ead8a389aec0: baseline-arm-baylibre 2026-03-11 08:47:56,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8929c660ead8a389aec0 2026-03-11 08:47:56,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:56,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8929c660ead8a389aec0 HTTP/1.1" 200 None 2026-03-11 08:47:56,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:56,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:56,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:56,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8929c660ead8a389aec0 HTTP/1.1" 200 None 2026-03-11 08:47:56,453 - lava_callback - ERROR - Error processing callback for node 69ae8929c660ead8a389aec0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46518 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:47:57,050 - lava_callback - INFO - Received callback for node 69ae892bc660ead8a389aec7 INFO: 172.21.0.1:46534 - "POST /node/69ae892bc660ead8a389aec7 HTTP/1.0" 202 Accepted 2026-03-11 08:47:57,056 - lava_callback - INFO - Starting async job submit for node 69ae892bc660ead8a389aec7 2026-03-11 08:47:57,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892bc660ead8a389aec7 HTTP/1.1" 200 None 2026-03-11 08:47:57,072 - lava_callback - DEBUG - Processing node 69ae892bc660ead8a389aec7: baseline-arm-baylibre 2026-03-11 08:47:57,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae892bc660ead8a389aec7 2026-03-11 08:47:57,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892bc660ead8a389aec7 HTTP/1.1" 200 None 2026-03-11 08:47:57,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:57,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae892bc660ead8a389aec7 HTTP/1.1" 200 None 2026-03-11 08:47:57,131 - lava_callback - ERROR - Error processing callback for node 69ae892bc660ead8a389aec7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:47:57,695 - lava_callback - INFO - Received callback for node 69ae892cc660ead8a389aece INFO: 172.21.0.1:46540 - "POST /node/69ae892cc660ead8a389aece HTTP/1.0" 202 Accepted 2026-03-11 08:47:57,701 - lava_callback - INFO - Starting async job submit for node 69ae892cc660ead8a389aece 2026-03-11 08:47:57,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892cc660ead8a389aece HTTP/1.1" 200 None 2026-03-11 08:47:57,728 - lava_callback - DEBUG - Processing node 69ae892cc660ead8a389aece: baseline-arm-baylibre 2026-03-11 08:47:57,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae892cc660ead8a389aece 2026-03-11 08:47:57,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892cc660ead8a389aece HTTP/1.1" 200 None 2026-03-11 08:47:57,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:57,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:57,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae892cc660ead8a389aece HTTP/1.1" 200 None 2026-03-11 08:47:57,794 - lava_callback - ERROR - Error processing callback for node 69ae892cc660ead8a389aece: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:47:58,385 - lava_callback - INFO - Received callback for node 69ae892dc660ead8a389aed0 INFO: 172.21.0.1:46548 - "POST /node/69ae892dc660ead8a389aed0 HTTP/1.0" 202 Accepted 2026-03-11 08:47:58,390 - lava_callback - INFO - Starting async job submit for node 69ae892dc660ead8a389aed0 2026-03-11 08:47:58,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:58,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892dc660ead8a389aed0 HTTP/1.1" 200 None 2026-03-11 08:47:58,418 - lava_callback - DEBUG - Processing node 69ae892dc660ead8a389aed0: baseline-arm-baylibre 2026-03-11 08:47:58,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae892dc660ead8a389aed0 2026-03-11 08:47:58,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:58,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae892dc660ead8a389aed0 HTTP/1.1" 200 None 2026-03-11 08:47:58,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:58,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:47:58,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:58,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae892dc660ead8a389aed0 HTTP/1.1" 200 None 2026-03-11 08:47:58,471 - lava_callback - ERROR - Error processing callback for node 69ae892dc660ead8a389aed0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:47:59,054 - lava_callback - INFO - Received callback for node 69ae8930c660ead8a389aedc INFO: 172.21.0.1:46558 - "POST /node/69ae8930c660ead8a389aedc HTTP/1.0" 202 Accepted 2026-03-11 08:47:59,060 - lava_callback - INFO - Starting async job submit for node 69ae8930c660ead8a389aedc 2026-03-11 08:47:59,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8930c660ead8a389aedc HTTP/1.1" 200 None 2026-03-11 08:47:59,075 - lava_callback - DEBUG - Processing node 69ae8930c660ead8a389aedc: baseline-arm-baylibre 2026-03-11 08:47:59,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8930c660ead8a389aedc 2026-03-11 08:47:59,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8930c660ead8a389aedc HTTP/1.1" 200 None 2026-03-11 08:47:59,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:59,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8930c660ead8a389aedc HTTP/1.1" 200 None 2026-03-11 08:47:59,137 - lava_callback - ERROR - Error processing callback for node 69ae8930c660ead8a389aedc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:47:59,697 - lava_callback - INFO - Received callback for node 69ae8931c660ead8a389aedf INFO: 172.21.0.1:47906 - "POST /node/69ae8931c660ead8a389aedf HTTP/1.0" 202 Accepted 2026-03-11 08:47:59,703 - lava_callback - INFO - Starting async job submit for node 69ae8931c660ead8a389aedf 2026-03-11 08:47:59,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8931c660ead8a389aedf HTTP/1.1" 200 None 2026-03-11 08:47:59,719 - lava_callback - DEBUG - Processing node 69ae8931c660ead8a389aedf: baseline-arm-baylibre 2026-03-11 08:47:59,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8931c660ead8a389aedf 2026-03-11 08:47:59,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8931c660ead8a389aedf HTTP/1.1" 200 None 2026-03-11 08:47:59,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:47:59,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:47:59,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8931c660ead8a389aedf HTTP/1.1" 200 None 2026-03-11 08:47:59,783 - lava_callback - ERROR - Error processing callback for node 69ae8931c660ead8a389aedf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:48:01,031 - lava_callback - INFO - Received callback for node 69ae893cc660ead8a389af17 INFO: 172.21.0.1:47922 - "POST /node/69ae893cc660ead8a389af17 HTTP/1.0" 202 Accepted 2026-03-11 08:48:01,036 - lava_callback - INFO - Starting async job submit for node 69ae893cc660ead8a389af17 2026-03-11 08:48:01,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:01,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae893cc660ead8a389af17 HTTP/1.1" 200 None 2026-03-11 08:48:01,053 - lava_callback - DEBUG - Processing node 69ae893cc660ead8a389af17: baseline-arm-clabbe 2026-03-11 08:48:01,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae893cc660ead8a389af17 2026-03-11 08:48:01,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:01,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae893cc660ead8a389af17 HTTP/1.1" 200 None 2026-03-11 08:48:01,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:01,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:48:01,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:01,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae893cc660ead8a389af17 HTTP/1.1" 200 None 2026-03-11 08:48:01,113 - lava_callback - ERROR - Error processing callback for node 69ae893cc660ead8a389af17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41404 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:48:21,007 - lava_callback - INFO - Received callback for node 69ae8941c660ead8a389af2d INFO: 172.21.0.1:35938 - "POST /node/69ae8941c660ead8a389af2d HTTP/1.0" 202 Accepted 2026-03-11 08:48:21,013 - lava_callback - INFO - Starting async job submit for node 69ae8941c660ead8a389af2d 2026-03-11 08:48:21,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8941c660ead8a389af2d HTTP/1.1" 200 None 2026-03-11 08:48:21,029 - lava_callback - DEBUG - Processing node 69ae8941c660ead8a389af2d: baseline-arm-clabbe 2026-03-11 08:48:21,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8941c660ead8a389af2d 2026-03-11 08:48:21,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8941c660ead8a389af2d HTTP/1.1" 200 None 2026-03-11 08:48:21,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:48:21,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8941c660ead8a389af2d HTTP/1.1" 200 None 2026-03-11 08:48:21,091 - lava_callback - ERROR - Error processing callback for node 69ae8941c660ead8a389af2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:48:21,673 - lava_callback - INFO - Received callback for node 69ae8943c660ead8a389af30 INFO: 172.21.0.1:35954 - "POST /node/69ae8943c660ead8a389af30 HTTP/1.0" 202 Accepted 2026-03-11 08:48:21,679 - lava_callback - INFO - Starting async job submit for node 69ae8943c660ead8a389af30 2026-03-11 08:48:21,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8943c660ead8a389af30 HTTP/1.1" 200 None 2026-03-11 08:48:21,694 - lava_callback - DEBUG - Processing node 69ae8943c660ead8a389af30: baseline-arm-clabbe 2026-03-11 08:48:21,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8943c660ead8a389af30 2026-03-11 08:48:21,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8943c660ead8a389af30 HTTP/1.1" 200 None 2026-03-11 08:48:21,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:48:21,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:21,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8943c660ead8a389af30 HTTP/1.1" 200 None 2026-03-11 08:48:21,755 - lava_callback - ERROR - Error processing callback for node 69ae8943c660ead8a389af30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:48:22,334 - lava_callback - INFO - Received callback for node 69ae8943c660ead8a389af33 INFO: 172.21.0.1:35966 - "POST /node/69ae8943c660ead8a389af33 HTTP/1.0" 202 Accepted 2026-03-11 08:48:22,339 - lava_callback - INFO - Starting async job submit for node 69ae8943c660ead8a389af33 2026-03-11 08:48:22,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:22,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8943c660ead8a389af33 HTTP/1.1" 200 None 2026-03-11 08:48:22,355 - lava_callback - DEBUG - Processing node 69ae8943c660ead8a389af33: baseline-arm-clabbe 2026-03-11 08:48:22,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8943c660ead8a389af33 2026-03-11 08:48:22,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:22,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8943c660ead8a389af33 HTTP/1.1" 200 None 2026-03-11 08:48:22,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:22,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:48:22,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:22,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8943c660ead8a389af33 HTTP/1.1" 200 None 2026-03-11 08:48:22,414 - lava_callback - ERROR - Error processing callback for node 69ae8943c660ead8a389af33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:48:22,991 - lava_callback - INFO - Received callback for node 69ae8947c660ead8a389af3d INFO: 172.21.0.1:35980 - "POST /node/69ae8947c660ead8a389af3d HTTP/1.0" 202 Accepted 2026-03-11 08:48:22,997 - lava_callback - INFO - Starting async job submit for node 69ae8947c660ead8a389af3d 2026-03-11 08:48:22,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:23,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8947c660ead8a389af3d HTTP/1.1" 200 None 2026-03-11 08:48:23,026 - lava_callback - DEBUG - Processing node 69ae8947c660ead8a389af3d: baseline-arm-clabbe 2026-03-11 08:48:23,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8947c660ead8a389af3d 2026-03-11 08:48:23,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:23,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8947c660ead8a389af3d HTTP/1.1" 200 None 2026-03-11 08:48:23,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:23,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8223c660ead8a389aafd HTTP/1.1" 200 None 2026-03-11 08:48:23,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:23,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8947c660ead8a389af3d HTTP/1.1" 200 None 2026-03-11 08:48:23,084 - lava_callback - ERROR - Error processing callback for node 69ae8947c660ead8a389af3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48044 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:48:35,600 - lava_callback - INFO - Received callback for node 69ae8957c660ead8a389af66 INFO: 172.21.0.1:48058 - "POST /node/69ae8957c660ead8a389af66 HTTP/1.0" 202 Accepted 2026-03-11 08:48:35,606 - lava_callback - INFO - Starting async job submit for node 69ae8957c660ead8a389af66 2026-03-11 08:48:35,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:35,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8957c660ead8a389af66 HTTP/1.1" 200 None 2026-03-11 08:48:35,622 - lava_callback - DEBUG - Processing node 69ae8957c660ead8a389af66: baseline-arm-baylibre 2026-03-11 08:48:35,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8957c660ead8a389af66 2026-03-11 08:48:35,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:35,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8957c660ead8a389af66 HTTP/1.1" 200 None 2026-03-11 08:48:35,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:35,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:48:35,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:48:35,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8957c660ead8a389af66 HTTP/1.1" 200 None 2026-03-11 08:48:35,681 - lava_callback - ERROR - Error processing callback for node 69ae8957c660ead8a389af66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:49:14,453 - lava_callback - INFO - Received callback for node 69b12a2ba870a1dc3343bbb1 INFO: 172.21.0.1:44812 - "POST /node/69b12a2ba870a1dc3343bbb1 HTTP/1.0" 202 Accepted 2026-03-11 08:49:14,460 - lava_callback - INFO - Starting async job submit for node 69b12a2ba870a1dc3343bbb1 2026-03-11 08:49:14,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:14,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2ba870a1dc3343bbb1 HTTP/1.1" 200 None 2026-03-11 08:49:14,502 - lava_callback - DEBUG - Processing node 69b12a2ba870a1dc3343bbb1: ltp-fs_bind 2026-03-11 08:49:15,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44824 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 08:49:15,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:15,196 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b12a2ba870a1dc3343bbb1/log.txt.gz 2026-03-11 08:49:15,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:15,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:15,663 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b12a2ba870a1dc3343bbb1/lava-logs.yaml 2026-03-11 08:49:15,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:15,687 - lava_callback - INFO - Received callback for node 69ae8981c660ead8a389afd5 2026-03-11 08:49:15,693 - lava_callback - INFO - Starting async job submit for node 69ae8981c660ead8a389afd5 INFO: 172.21.0.1:44832 - "POST /node/69ae8981c660ead8a389afd5 HTTP/1.0" 202 Accepted 2026-03-11 08:49:15,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8981c660ead8a389afd5 HTTP/1.1" 200 None 2026-03-11 08:49:15,712 - lava_callback - DEBUG - Processing node 69ae8981c660ead8a389afd5: baseline-arm-baylibre 2026-03-11 08:49:15,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8981c660ead8a389afd5 2026-03-11 08:49:15,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8981c660ead8a389afd5 HTTP/1.1" 200 None 2026-03-11 08:49:15,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:49:15,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8981c660ead8a389afd5 HTTP/1.1" 200 None 2026-03-11 08:49:15,781 - lava_callback - ERROR - Error processing callback for node 69ae8981c660ead8a389afd5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:49:15,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:15,865 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69b12a2ba870a1dc3343bbb1/lava_callback.json.gz 2026-03-11 08:49:15,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2ba870a1dc3343bbb1 HTTP/1.1" 200 None 2026-03-11 08:49:15,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:49:15,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:15,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a2ba870a1dc3343bbb1 HTTP/1.1" 200 None 2026-03-11 08:49:15,974 - lava_callback - INFO - Completed processing callback for node 69b12a2ba870a1dc3343bbb1 INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:49:24,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:24,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:49:39,437 - lava_callback - INFO - Received callback for node 69b12a2da870a1dc3343bbb4 INFO: 172.21.0.1:48090 - "POST /node/69b12a2da870a1dc3343bbb4 HTTP/1.0" 202 Accepted 2026-03-11 08:49:39,443 - lava_callback - INFO - Starting async job submit for node 69b12a2da870a1dc3343bbb4 2026-03-11 08:49:39,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:39,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2da870a1dc3343bbb4 HTTP/1.1" 200 None 2026-03-11 08:49:39,482 - lava_callback - DEBUG - Processing node 69b12a2da870a1dc3343bbb4: ltp-fsx 2026-03-11 08:49:39,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:39,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:39,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69b12a2da870a1dc3343bbb4/log.txt.gz 2026-03-11 08:49:40,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:40,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:40,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69b12a2da870a1dc3343bbb4/lava-logs.yaml 2026-03-11 08:49:40,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:40,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:40,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69b12a2da870a1dc3343bbb4/lava_callback.json.gz 2026-03-11 08:49:40,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:40,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2da870a1dc3343bbb4 HTTP/1.1" 200 None 2026-03-11 08:49:40,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:40,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:49:40,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:40,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a2da870a1dc3343bbb4 HTTP/1.1" 200 None 2026-03-11 08:49:40,724 - lava_callback - INFO - Completed processing callback for node 69b12a2da870a1dc3343bbb4 INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:49:54,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:54,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 08:49:55,674 - lava_callback - INFO - Received callback for node 69ae89a9c660ead8a389b022 INFO: 172.21.0.1:37612 - "POST /node/69ae89a9c660ead8a389b022 HTTP/1.0" 202 Accepted 2026-03-11 08:49:55,679 - lava_callback - INFO - Starting async job submit for node 69ae89a9c660ead8a389b022 2026-03-11 08:49:55,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:55,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae89a9c660ead8a389b022 HTTP/1.1" 200 None 2026-03-11 08:49:55,716 - lava_callback - DEBUG - Processing node 69ae89a9c660ead8a389b022: baseline-arm-baylibre 2026-03-11 08:49:55,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae89a9c660ead8a389b022 2026-03-11 08:49:55,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:55,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae89a9c660ead8a389b022 HTTP/1.1" 200 None 2026-03-11 08:49:55,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:55,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:49:55,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:55,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae89a9c660ead8a389b022 HTTP/1.1" 200 None 2026-03-11 08:49:55,810 - lava_callback - ERROR - Error processing callback for node 69ae89a9c660ead8a389b022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:49:59,431 - lava_callback - INFO - Received callback for node 69b12a2fa870a1dc3343bbb7 INFO: 172.21.0.1:37634 - "POST /node/69b12a2fa870a1dc3343bbb7 HTTP/1.0" 202 Accepted 2026-03-11 08:49:59,437 - lava_callback - INFO - Starting async job submit for node 69b12a2fa870a1dc3343bbb7 2026-03-11 08:49:59,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:49:59,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2fa870a1dc3343bbb7 HTTP/1.1" 200 None 2026-03-11 08:49:59,484 - lava_callback - DEBUG - Processing node 69b12a2fa870a1dc3343bbb7: ltp-input 2026-03-11 08:49:59,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:49:59,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:49:59,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69b12a2fa870a1dc3343bbb7/log.txt.gz 2026-03-11 08:50:00,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:50:00,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:50:00,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69b12a2fa870a1dc3343bbb7/lava-logs.yaml 2026-03-11 08:50:00,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:50:00,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:50:00,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69b12a2fa870a1dc3343bbb7/lava_callback.json.gz 2026-03-11 08:50:00,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:00,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a2fa870a1dc3343bbb7 HTTP/1.1" 200 None 2026-03-11 08:50:00,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:00,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:50:00,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:00,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a2fa870a1dc3343bbb7 HTTP/1.1" 200 None 2026-03-11 08:50:00,694 - lava_callback - INFO - Completed processing callback for node 69b12a2fa870a1dc3343bbb7 INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57452 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:50:24,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:24,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51576 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:50:32,681 - lava_callback - INFO - Received callback for node 69b12cd1a870a1dc3343bd94 INFO: 172.21.0.1:51582 - "POST /node/69b12cd1a870a1dc3343bd94 HTTP/1.0" 202 Accepted 2026-03-11 08:50:32,688 - lava_callback - INFO - Starting async job submit for node 69b12cd1a870a1dc3343bd94 2026-03-11 08:50:32,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:32,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12cd1a870a1dc3343bd94 HTTP/1.1" 200 None 2026-03-11 08:50:32,707 - lava_callback - DEBUG - Processing node 69b12cd1a870a1dc3343bd94: baseline-arm 2026-03-11 08:50:32,713 - lava_callback - WARNING - Failed to upload log 2026-03-11 08:50:32,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:50:33,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:50:33,077 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b12cd1a870a1dc3343bd94/lava-logs.yaml 2026-03-11 08:50:33,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:50:33,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:50:33,265 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b12cd1a870a1dc3343bd94/lava_callback.json.gz 2026-03-11 08:50:33,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:33,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12cd1a870a1dc3343bd94 HTTP/1.1" 200 None 2026-03-11 08:50:33,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:33,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:50:33,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:33,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12cd1a870a1dc3343bd94 HTTP/1.1" 200 None 2026-03-11 08:50:33,345 - lava_callback - INFO - Completed processing callback for node 69b12cd1a870a1dc3343bd94 INFO: 172.21.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:50:54,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:50:54,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:51:33,959 - lava_callback - INFO - Received callback for node 69b1287aa870a1dc3343bacb INFO: 172.21.0.1:34858 - "POST /node/69b1287aa870a1dc3343bacb HTTP/1.0" 202 Accepted 2026-03-11 08:51:33,969 - lava_callback - INFO - Starting async job submit for node 69b1287aa870a1dc3343bacb 2026-03-11 08:51:34,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:34,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1287aa870a1dc3343bacb HTTP/1.1" 200 None 2026-03-11 08:51:34,122 - lava_callback - DEBUG - Processing node 69b1287aa870a1dc3343bacb: ltp-smoke 2026-03-11 08:51:34,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:51:35,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:35,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1287aa870a1dc3343bacb/log.txt.gz 2026-03-11 08:51:35,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:51:36,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:36,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1287aa870a1dc3343bacb/lava-logs.yaml 2026-03-11 08:51:36,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:51:37,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:37,316 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b1287aa870a1dc3343bacb/lava_callback.json.gz 2026-03-11 08:51:37,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:37,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1287aa870a1dc3343bacb HTTP/1.1" 200 None 2026-03-11 08:51:37,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:37,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12599a870a1dc3343ba8b HTTP/1.1" 200 None 2026-03-11 08:51:37,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:37,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1287aa870a1dc3343bacb HTTP/1.1" 200 None 2026-03-11 08:51:37,812 - lava_callback - INFO - Completed processing callback for node 69b1287aa870a1dc3343bacb 2026-03-11 08:51:39,386 - lava_callback - INFO - Received callback for node 69b12a30a870a1dc3343bbba INFO: 172.21.0.1:34868 - "POST /node/69b12a30a870a1dc3343bbba HTTP/1.0" 202 Accepted 2026-03-11 08:51:39,398 - lava_callback - INFO - Starting async job submit for node 69b12a30a870a1dc3343bbba 2026-03-11 08:51:39,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:39,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a30a870a1dc3343bbba HTTP/1.1" 200 None 2026-03-11 08:51:39,478 - lava_callback - DEBUG - Processing node 69b12a30a870a1dc3343bbba: ltp-ipc 2026-03-11 08:51:40,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:51:40,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:40,670 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69b12a30a870a1dc3343bbba/log.txt.gz 2026-03-11 08:51:40,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:51:41,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:41,822 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69b12a30a870a1dc3343bbba/lava-logs.yaml 2026-03-11 08:51:41,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:51:42,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:51:42,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69b12a30a870a1dc3343bbba/lava_callback.json.gz 2026-03-11 08:51:42,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:42,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a30a870a1dc3343bbba HTTP/1.1" 200 None 2026-03-11 08:51:42,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:42,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:51:42,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:42,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a30a870a1dc3343bbba HTTP/1.1" 200 None 2026-03-11 08:51:42,212 - lava_callback - INFO - Completed processing callback for node 69b12a30a870a1dc3343bbba INFO: 172.21.0.1:32876 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:51:54,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:51:54,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47560 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:52:41,459 - lava_callback - INFO - Received callback for node 69ae8a49c660ead8a389b127 INFO: 172.21.0.1:38332 - "POST /node/69ae8a49c660ead8a389b127 HTTP/1.0" 202 Accepted 2026-03-11 08:52:41,465 - lava_callback - INFO - Starting async job submit for node 69ae8a49c660ead8a389b127 2026-03-11 08:52:41,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:52:41,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a49c660ead8a389b127 HTTP/1.1" 200 None 2026-03-11 08:52:41,495 - lava_callback - DEBUG - Processing node 69ae8a49c660ead8a389b127: baseline-arm-clabbe 2026-03-11 08:52:41,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8a49c660ead8a389b127 2026-03-11 08:52:41,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:52:41,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a49c660ead8a389b127 HTTP/1.1" 200 None 2026-03-11 08:52:41,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:52:41,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:52:41,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:52:41,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8a49c660ead8a389b127 HTTP/1.1" 200 None 2026-03-11 08:52:41,552 - lava_callback - ERROR - Error processing callback for node 69ae8a49c660ead8a389b127: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:53:14,011 - lava_callback - INFO - Received callback for node 69b12a32a870a1dc3343bbbd INFO: 172.21.0.1:41186 - "POST /node/69b12a32a870a1dc3343bbbd HTTP/1.0" 202 Accepted 2026-03-11 08:53:14,017 - lava_callback - INFO - Starting async job submit for node 69b12a32a870a1dc3343bbbd 2026-03-11 08:53:14,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:14,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a32a870a1dc3343bbbd HTTP/1.1" 200 None 2026-03-11 08:53:14,057 - lava_callback - DEBUG - Processing node 69b12a32a870a1dc3343bbbd: ltp-pty 2026-03-11 08:53:14,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:53:14,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:53:14,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69b12a32a870a1dc3343bbbd/log.txt.gz 2026-03-11 08:53:14,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:53:14,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:53:14,964 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69b12a32a870a1dc3343bbbd/lava-logs.yaml 2026-03-11 08:53:14,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:53:15,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:53:15,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69b12a32a870a1dc3343bbbd/lava_callback.json.gz INFO: 172.21.0.1:41200 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 08:53:15,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:15,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a32a870a1dc3343bbbd HTTP/1.1" 200 None 2026-03-11 08:53:15,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:15,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:53:15,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:15,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a32a870a1dc3343bbbd HTTP/1.1" 200 None 2026-03-11 08:53:15,228 - lava_callback - INFO - Completed processing callback for node 69b12a32a870a1dc3343bbbd INFO: 172.21.0.1:41206 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:53:21,225 - lava_callback - INFO - Received callback for node 69ae8a72c660ead8a389b142 INFO: 172.21.0.1:49240 - "POST /node/69ae8a72c660ead8a389b142 HTTP/1.0" 202 Accepted 2026-03-11 08:53:21,232 - lava_callback - INFO - Starting async job submit for node 69ae8a72c660ead8a389b142 2026-03-11 08:53:21,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:21,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a72c660ead8a389b142 HTTP/1.1" 200 None 2026-03-11 08:53:21,263 - lava_callback - DEBUG - Processing node 69ae8a72c660ead8a389b142: baseline-arm-clabbe 2026-03-11 08:53:21,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8a72c660ead8a389b142 2026-03-11 08:53:21,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:21,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a72c660ead8a389b142 HTTP/1.1" 200 None 2026-03-11 08:53:21,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:21,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:53:21,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:21,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8a72c660ead8a389b142 HTTP/1.1" 200 None 2026-03-11 08:53:21,389 - lava_callback - ERROR - Error processing callback for node 69ae8a72c660ead8a389b142: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:53:24,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:24,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:53:55,930 - lava_callback - INFO - Received callback for node 69ae8a98c660ead8a389b158 INFO: 172.21.0.1:37174 - "POST /node/69ae8a98c660ead8a389b158 HTTP/1.0" 202 Accepted 2026-03-11 08:53:55,938 - lava_callback - INFO - Starting async job submit for node 69ae8a98c660ead8a389b158 2026-03-11 08:53:55,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:55,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a98c660ead8a389b158 HTTP/1.1" 200 None 2026-03-11 08:53:55,966 - lava_callback - DEBUG - Processing node 69ae8a98c660ead8a389b158: baseline-arm-baylibre 2026-03-11 08:53:55,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8a98c660ead8a389b158 2026-03-11 08:53:55,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:55,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8a98c660ead8a389b158 HTTP/1.1" 200 None 2026-03-11 08:53:55,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:56,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:53:56,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:56,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8a98c660ead8a389b158 HTTP/1.1" 200 None 2026-03-11 08:53:56,071 - lava_callback - ERROR - Error processing callback for node 69ae8a98c660ead8a389b158: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:53:59,464 - lava_callback - INFO - Received callback for node 69b12a33a870a1dc3343bbc0 INFO: 172.21.0.1:37184 - "POST /node/69b12a33a870a1dc3343bbc0 HTTP/1.0" 202 Accepted 2026-03-11 08:53:59,475 - lava_callback - INFO - Starting async job submit for node 69b12a33a870a1dc3343bbc0 2026-03-11 08:53:59,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:53:59,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a33a870a1dc3343bbc0 HTTP/1.1" 200 None 2026-03-11 08:53:59,557 - lava_callback - DEBUG - Processing node 69b12a33a870a1dc3343bbc0: ltp-sched 2026-03-11 08:54:00,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:00,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:00,545 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69b12a33a870a1dc3343bbc0/log.txt.gz 2026-03-11 08:54:00,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:01,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:01,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69b12a33a870a1dc3343bbc0/lava-logs.yaml 2026-03-11 08:54:01,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:01,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:01,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69b12a33a870a1dc3343bbc0/lava_callback.json.gz 2026-03-11 08:54:01,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:01,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a33a870a1dc3343bbc0 HTTP/1.1" 200 None 2026-03-11 08:54:01,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:02,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:54:02,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:02,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a33a870a1dc3343bbc0 HTTP/1.1" 200 None 2026-03-11 08:54:02,060 - lava_callback - INFO - Completed processing callback for node 69b12a33a870a1dc3343bbc0 INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38590 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:54:19,537 - lava_callback - INFO - Received callback for node 69b12a35a870a1dc3343bbc3 INFO: 172.21.0.1:38602 - "POST /node/69b12a35a870a1dc3343bbc3 HTTP/1.0" 202 Accepted 2026-03-11 08:54:19,548 - lava_callback - INFO - Starting async job submit for node 69b12a35a870a1dc3343bbc3 2026-03-11 08:54:19,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:19,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a35a870a1dc3343bbc3 HTTP/1.1" 200 None 2026-03-11 08:54:19,622 - lava_callback - DEBUG - Processing node 69b12a35a870a1dc3343bbc3: ltp-smoke 2026-03-11 08:54:20,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:20,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:20,549 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12a35a870a1dc3343bbc3/log.txt.gz 2026-03-11 08:54:20,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:21,433 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:21,435 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12a35a870a1dc3343bbc3/lava-logs.yaml 2026-03-11 08:54:21,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:54:21,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:54:21,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12a35a870a1dc3343bbc3/lava_callback.json.gz 2026-03-11 08:54:21,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:21,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a35a870a1dc3343bbc3 HTTP/1.1" 200 None 2026-03-11 08:54:21,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:21,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:54:21,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:22,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a35a870a1dc3343bbc3 HTTP/1.1" 200 None 2026-03-11 08:54:22,010 - lava_callback - INFO - Completed processing callback for node 69b12a35a870a1dc3343bbc3 2026-03-11 08:54:24,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:24,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:54:35,927 - lava_callback - INFO - Received callback for node 69ae8ac0c660ead8a389b171 INFO: 172.21.0.1:51674 - "POST /node/69ae8ac0c660ead8a389b171 HTTP/1.0" 202 Accepted 2026-03-11 08:54:35,932 - lava_callback - INFO - Starting async job submit for node 69ae8ac0c660ead8a389b171 2026-03-11 08:54:35,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:35,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8ac0c660ead8a389b171 HTTP/1.1" 200 None 2026-03-11 08:54:35,948 - lava_callback - DEBUG - Processing node 69ae8ac0c660ead8a389b171: baseline-arm-baylibre 2026-03-11 08:54:35,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8ac0c660ead8a389b171 2026-03-11 08:54:35,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:35,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8ac0c660ead8a389b171 HTTP/1.1" 200 None 2026-03-11 08:54:35,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:35,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:54:35,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:54:36,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8ac0c660ead8a389b171 HTTP/1.1" 200 None 2026-03-11 08:54:36,016 - lava_callback - ERROR - Error processing callback for node 69ae8ac0c660ead8a389b171: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:55:34,979 - lava_callback - INFO - Received callback for node 69b129eea870a1dc3343baeb INFO: 172.21.0.1:60380 - "POST /node/69b129eea870a1dc3343baeb HTTP/1.0" 202 Accepted 2026-03-11 08:55:34,986 - lava_callback - INFO - Starting async job submit for node 69b129eea870a1dc3343baeb 2026-03-11 08:55:35,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:55:35,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eea870a1dc3343baeb HTTP/1.1" 200 None 2026-03-11 08:55:35,068 - lava_callback - DEBUG - Processing node 69b129eea870a1dc3343baeb: baseline-arm 2026-03-11 08:55:35,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:55:35,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:55:35,779 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343baeb/log.txt.gz 2026-03-11 08:55:36,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:55:36,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:55:36,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343baeb/lava-logs.yaml 2026-03-11 08:55:36,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:60388 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:55:36,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:55:36,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129eea870a1dc3343baeb/lava_callback.json.gz DEBUG: Setup failed for 69b129eea870a1dc3343baeb. Transitting job node result: incomplete -> fail 2026-03-11 08:55:36,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:55:36,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129eea870a1dc3343baeb HTTP/1.1" 200 None 2026-03-11 08:55:36,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:55:36,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:55:36,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:55:36,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129eea870a1dc3343baeb HTTP/1.1" 200 None 2026-03-11 08:55:36,910 - lava_callback - INFO - Completed processing callback for node 69b129eea870a1dc3343baeb INFO: 172.21.0.1:54372 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:55:54,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:55:54,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:56:19,679 - lava_callback - INFO - Received callback for node 69b12a38a870a1dc3343bbc9 INFO: 172.21.0.1:56118 - "POST /node/69b12a38a870a1dc3343bbc9 HTTP/1.0" 202 Accepted 2026-03-11 08:56:19,686 - lava_callback - INFO - Starting async job submit for node 69b12a38a870a1dc3343bbc9 2026-03-11 08:56:19,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:56:19,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a38a870a1dc3343bbc9 HTTP/1.1" 200 None 2026-03-11 08:56:19,730 - lava_callback - DEBUG - Processing node 69b12a38a870a1dc3343bbc9: ltp-syscalls-ipc 2026-03-11 08:56:20,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:56:20,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:56:20,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b12a38a870a1dc3343bbc9/log.txt.gz 2026-03-11 08:56:20,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:56:20,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:56:20,726 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b12a38a870a1dc3343bbc9/lava-logs.yaml 2026-03-11 08:56:20,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:56:20,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:56:20,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69b12a38a870a1dc3343bbc9/lava_callback.json.gz 2026-03-11 08:56:20,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:56:20,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a38a870a1dc3343bbc9 HTTP/1.1" 200 None 2026-03-11 08:56:20,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:56:21,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:56:21,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:56:21,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a38a870a1dc3343bbc9 HTTP/1.1" 200 None 2026-03-11 08:56:21,041 - lava_callback - INFO - Completed processing callback for node 69b12a38a870a1dc3343bbc9 2026-03-11 08:56:24,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:56:24,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45410 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:57:14,239 - lava_callback - INFO - Received callback for node 69b12a39a870a1dc3343bbcc INFO: 172.21.0.1:49278 - "POST /node/69b12a39a870a1dc3343bbcc HTTP/1.0" 202 Accepted 2026-03-11 08:57:14,246 - lava_callback - INFO - Starting async job submit for node 69b12a39a870a1dc3343bbcc 2026-03-11 08:57:14,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:14,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a39a870a1dc3343bbcc HTTP/1.1" 200 None 2026-03-11 08:57:14,286 - lava_callback - DEBUG - Processing node 69b12a39a870a1dc3343bbcc: ltp-timers 2026-03-11 08:57:14,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:57:14,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:57:14,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69b12a39a870a1dc3343bbcc/log.txt.gz 2026-03-11 08:57:15,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49294 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 08:57:15,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:57:15,235 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69b12a39a870a1dc3343bbcc/lava-logs.yaml 2026-03-11 08:57:15,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:57:15,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:57:15,401 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69b12a39a870a1dc3343bbcc/lava_callback.json.gz 2026-03-11 08:57:15,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:15,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a39a870a1dc3343bbcc HTTP/1.1" 200 None 2026-03-11 08:57:15,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:15,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:57:15,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:15,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a39a870a1dc3343bbcc HTTP/1.1" 200 None 2026-03-11 08:57:15,489 - lava_callback - INFO - Completed processing callback for node 69b12a39a870a1dc3343bbcc INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:57:16,530 - lava_callback - INFO - Received callback for node 69ae8b5dc660ead8a389b25f INFO: 172.21.0.1:49318 - "POST /node/69ae8b5dc660ead8a389b25f HTTP/1.0" 202 Accepted 2026-03-11 08:57:16,535 - lava_callback - INFO - Starting async job submit for node 69ae8b5dc660ead8a389b25f 2026-03-11 08:57:16,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:16,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b5dc660ead8a389b25f HTTP/1.1" 200 None 2026-03-11 08:57:16,552 - lava_callback - DEBUG - Processing node 69ae8b5dc660ead8a389b25f: baseline-arm64-baylibre 2026-03-11 08:57:16,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b5dc660ead8a389b25f 2026-03-11 08:57:16,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:16,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b5dc660ead8a389b25f HTTP/1.1" 200 None 2026-03-11 08:57:16,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:16,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:16,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:16,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b5dc660ead8a389b25f HTTP/1.1" 200 None 2026-03-11 08:57:16,610 - lava_callback - ERROR - Error processing callback for node 69ae8b5dc660ead8a389b25f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:17,174 - lava_callback - INFO - Received callback for node 69ae8b5fc660ead8a389b263 INFO: 172.21.0.1:49328 - "POST /node/69ae8b5fc660ead8a389b263 HTTP/1.0" 202 Accepted 2026-03-11 08:57:17,180 - lava_callback - INFO - Starting async job submit for node 69ae8b5fc660ead8a389b263 2026-03-11 08:57:17,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b5fc660ead8a389b263 HTTP/1.1" 200 None 2026-03-11 08:57:17,201 - lava_callback - DEBUG - Processing node 69ae8b5fc660ead8a389b263: baseline-arm64-baylibre 2026-03-11 08:57:17,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b5fc660ead8a389b263 2026-03-11 08:57:17,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b5fc660ead8a389b263 HTTP/1.1" 200 None 2026-03-11 08:57:17,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:17,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b5fc660ead8a389b263 HTTP/1.1" 200 None 2026-03-11 08:57:17,269 - lava_callback - ERROR - Error processing callback for node 69ae8b5fc660ead8a389b263: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:17,837 - lava_callback - INFO - Received callback for node 69ae8b60c660ead8a389b266 INFO: 172.21.0.1:49334 - "POST /node/69ae8b60c660ead8a389b266 HTTP/1.0" 202 Accepted 2026-03-11 08:57:17,843 - lava_callback - INFO - Starting async job submit for node 69ae8b60c660ead8a389b266 2026-03-11 08:57:17,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b60c660ead8a389b266 HTTP/1.1" 200 None 2026-03-11 08:57:17,859 - lava_callback - DEBUG - Processing node 69ae8b60c660ead8a389b266: baseline-arm64-baylibre 2026-03-11 08:57:17,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b60c660ead8a389b266 2026-03-11 08:57:17,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b60c660ead8a389b266 HTTP/1.1" 200 None 2026-03-11 08:57:17,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:17,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:17,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b60c660ead8a389b266 HTTP/1.1" 200 None 2026-03-11 08:57:17,923 - lava_callback - ERROR - Error processing callback for node 69ae8b60c660ead8a389b266: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:18,498 - lava_callback - INFO - Received callback for node 69ae8b62c660ead8a389b26f INFO: 172.21.0.1:49342 - "POST /node/69ae8b62c660ead8a389b26f HTTP/1.0" 202 Accepted 2026-03-11 08:57:18,504 - lava_callback - INFO - Starting async job submit for node 69ae8b62c660ead8a389b26f 2026-03-11 08:57:18,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:18,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b62c660ead8a389b26f HTTP/1.1" 200 None 2026-03-11 08:57:18,524 - lava_callback - DEBUG - Processing node 69ae8b62c660ead8a389b26f: baseline-arm64-baylibre 2026-03-11 08:57:18,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b62c660ead8a389b26f 2026-03-11 08:57:18,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:18,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b62c660ead8a389b26f HTTP/1.1" 200 None 2026-03-11 08:57:18,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:18,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:18,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:18,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b62c660ead8a389b26f HTTP/1.1" 200 None 2026-03-11 08:57:18,579 - lava_callback - ERROR - Error processing callback for node 69ae8b62c660ead8a389b26f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:19,159 - lava_callback - INFO - Received callback for node 69ae8b64c660ead8a389b273 INFO: 172.21.0.1:49350 - "POST /node/69ae8b64c660ead8a389b273 HTTP/1.0" 202 Accepted 2026-03-11 08:57:19,165 - lava_callback - INFO - Starting async job submit for node 69ae8b64c660ead8a389b273 2026-03-11 08:57:19,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b64c660ead8a389b273 HTTP/1.1" 200 None 2026-03-11 08:57:19,181 - lava_callback - DEBUG - Processing node 69ae8b64c660ead8a389b273: baseline-arm64-baylibre 2026-03-11 08:57:19,182 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b64c660ead8a389b273 2026-03-11 08:57:19,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b64c660ead8a389b273 HTTP/1.1" 200 None 2026-03-11 08:57:19,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:19,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b64c660ead8a389b273 HTTP/1.1" 200 None 2026-03-11 08:57:19,237 - lava_callback - ERROR - Error processing callback for node 69ae8b64c660ead8a389b273: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:19,802 - lava_callback - INFO - Received callback for node 69ae8b65c660ead8a389b277 INFO: 172.21.0.1:60630 - "POST /node/69ae8b65c660ead8a389b277 HTTP/1.0" 202 Accepted 2026-03-11 08:57:19,807 - lava_callback - INFO - Starting async job submit for node 69ae8b65c660ead8a389b277 2026-03-11 08:57:19,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b65c660ead8a389b277 HTTP/1.1" 200 None 2026-03-11 08:57:19,826 - lava_callback - DEBUG - Processing node 69ae8b65c660ead8a389b277: baseline-arm64-baylibre 2026-03-11 08:57:19,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b65c660ead8a389b277 2026-03-11 08:57:19,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b65c660ead8a389b277 HTTP/1.1" 200 None 2026-03-11 08:57:19,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:19,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:19,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b65c660ead8a389b277 HTTP/1.1" 200 None 2026-03-11 08:57:19,884 - lava_callback - ERROR - Error processing callback for node 69ae8b65c660ead8a389b277: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:21,421 - lava_callback - INFO - Received callback for node 69ae8b62c660ead8a389b26d INFO: 172.21.0.1:60632 - "POST /node/69ae8b62c660ead8a389b26d HTTP/1.0" 202 Accepted 2026-03-11 08:57:21,426 - lava_callback - INFO - Starting async job submit for node 69ae8b62c660ead8a389b26d 2026-03-11 08:57:21,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:21,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b62c660ead8a389b26d HTTP/1.1" 200 None 2026-03-11 08:57:21,442 - lava_callback - DEBUG - Processing node 69ae8b62c660ead8a389b26d: baseline-arm-clabbe 2026-03-11 08:57:21,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b62c660ead8a389b26d 2026-03-11 08:57:21,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:21,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b62c660ead8a389b26d HTTP/1.1" 200 None 2026-03-11 08:57:21,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:21,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-11 08:57:21,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:21,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b62c660ead8a389b26d HTTP/1.1" 200 None 2026-03-11 08:57:21,499 - lava_callback - ERROR - Error processing callback for node 69ae8b62c660ead8a389b26d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:24,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:24,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:57:41,389 - lava_callback - INFO - Received callback for node 69ae8b75c660ead8a389b2a1 INFO: 172.21.0.1:36760 - "POST /node/69ae8b75c660ead8a389b2a1 HTTP/1.0" 202 Accepted 2026-03-11 08:57:41,395 - lava_callback - INFO - Starting async job submit for node 69ae8b75c660ead8a389b2a1 2026-03-11 08:57:41,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:41,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b75c660ead8a389b2a1 HTTP/1.1" 200 None 2026-03-11 08:57:41,411 - lava_callback - DEBUG - Processing node 69ae8b75c660ead8a389b2a1: baseline-arm64-clabbe 2026-03-11 08:57:41,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b75c660ead8a389b2a1 2026-03-11 08:57:41,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:41,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b75c660ead8a389b2a1 HTTP/1.1" 200 None 2026-03-11 08:57:41,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:41,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:41,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:41,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b75c660ead8a389b2a1 HTTP/1.1" 200 None 2026-03-11 08:57:41,475 - lava_callback - ERROR - Error processing callback for node 69ae8b75c660ead8a389b2a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:42,048 - lava_callback - INFO - Received callback for node 69ae8b77c660ead8a389b2c3 INFO: 172.21.0.1:36768 - "POST /node/69ae8b77c660ead8a389b2c3 HTTP/1.0" 202 Accepted 2026-03-11 08:57:42,054 - lava_callback - INFO - Starting async job submit for node 69ae8b77c660ead8a389b2c3 2026-03-11 08:57:42,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b77c660ead8a389b2c3 HTTP/1.1" 200 None 2026-03-11 08:57:42,077 - lava_callback - DEBUG - Processing node 69ae8b77c660ead8a389b2c3: baseline-arm64-clabbe 2026-03-11 08:57:42,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b77c660ead8a389b2c3 2026-03-11 08:57:42,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b77c660ead8a389b2c3 HTTP/1.1" 200 None 2026-03-11 08:57:42,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:42,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b77c660ead8a389b2c3 HTTP/1.1" 200 None 2026-03-11 08:57:42,134 - lava_callback - ERROR - Error processing callback for node 69ae8b77c660ead8a389b2c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:42,704 - lava_callback - INFO - Received callback for node 69ae8b78c660ead8a389b2c6 INFO: 172.21.0.1:36776 - "POST /node/69ae8b78c660ead8a389b2c6 HTTP/1.0" 202 Accepted 2026-03-11 08:57:42,710 - lava_callback - INFO - Starting async job submit for node 69ae8b78c660ead8a389b2c6 2026-03-11 08:57:42,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b78c660ead8a389b2c6 HTTP/1.1" 200 None 2026-03-11 08:57:42,726 - lava_callback - DEBUG - Processing node 69ae8b78c660ead8a389b2c6: baseline-arm64-clabbe 2026-03-11 08:57:42,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b78c660ead8a389b2c6 2026-03-11 08:57:42,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b78c660ead8a389b2c6 HTTP/1.1" 200 None 2026-03-11 08:57:42,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:42,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:42,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b78c660ead8a389b2c6 HTTP/1.1" 200 None 2026-03-11 08:57:42,786 - lava_callback - ERROR - Error processing callback for node 69ae8b78c660ead8a389b2c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:43,358 - lava_callback - INFO - Received callback for node 69ae8b79c660ead8a389b2c9 INFO: 172.21.0.1:36788 - "POST /node/69ae8b79c660ead8a389b2c9 HTTP/1.0" 202 Accepted 2026-03-11 08:57:43,364 - lava_callback - INFO - Starting async job submit for node 69ae8b79c660ead8a389b2c9 2026-03-11 08:57:43,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:43,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b79c660ead8a389b2c9 HTTP/1.1" 200 None 2026-03-11 08:57:43,380 - lava_callback - DEBUG - Processing node 69ae8b79c660ead8a389b2c9: baseline-arm64-clabbe 2026-03-11 08:57:43,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b79c660ead8a389b2c9 2026-03-11 08:57:43,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:43,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b79c660ead8a389b2c9 HTTP/1.1" 200 None 2026-03-11 08:57:43,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:43,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:43,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:43,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b79c660ead8a389b2c9 HTTP/1.1" 200 None 2026-03-11 08:57:43,431 - lava_callback - ERROR - Error processing callback for node 69ae8b79c660ead8a389b2c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:44,018 - lava_callback - INFO - Received callback for node 69ae8b7cc660ead8a389b2d7 INFO: 172.21.0.1:36794 - "POST /node/69ae8b7cc660ead8a389b2d7 HTTP/1.0" 202 Accepted 2026-03-11 08:57:44,025 - lava_callback - INFO - Starting async job submit for node 69ae8b7cc660ead8a389b2d7 2026-03-11 08:57:44,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b7cc660ead8a389b2d7 HTTP/1.1" 200 None 2026-03-11 08:57:44,041 - lava_callback - DEBUG - Processing node 69ae8b7cc660ead8a389b2d7: baseline-arm64-clabbe 2026-03-11 08:57:44,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b7cc660ead8a389b2d7 2026-03-11 08:57:44,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b7cc660ead8a389b2d7 HTTP/1.1" 200 None 2026-03-11 08:57:44,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:44,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b7cc660ead8a389b2d7 HTTP/1.1" 200 None 2026-03-11 08:57:44,107 - lava_callback - ERROR - Error processing callback for node 69ae8b7cc660ead8a389b2d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 08:57:44,693 - lava_callback - INFO - Received callback for node 69ae8b7bc660ead8a389b2d4 INFO: 172.21.0.1:36802 - "POST /node/69ae8b7bc660ead8a389b2d4 HTTP/1.0" 202 Accepted 2026-03-11 08:57:44,698 - lava_callback - INFO - Starting async job submit for node 69ae8b7bc660ead8a389b2d4 2026-03-11 08:57:44,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b7bc660ead8a389b2d4 HTTP/1.1" 200 None 2026-03-11 08:57:44,716 - lava_callback - DEBUG - Processing node 69ae8b7bc660ead8a389b2d4: baseline-arm64-clabbe 2026-03-11 08:57:44,716 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8b7bc660ead8a389b2d4 2026-03-11 08:57:44,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8b7bc660ead8a389b2d4 HTTP/1.1" 200 None 2026-03-11 08:57:44,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae822fc660ead8a389ab0e HTTP/1.1" 200 None 2026-03-11 08:57:44,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:57:44,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8b7bc660ead8a389b2d4 HTTP/1.1" 200 None 2026-03-11 08:57:44,795 - lava_callback - ERROR - Error processing callback for node 69ae8b7bc660ead8a389b2d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44408 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:58:19,658 - lava_callback - INFO - Received callback for node 69b12a3aa870a1dc3343bbcf INFO: 172.21.0.1:44414 - "POST /node/69b12a3aa870a1dc3343bbcf HTTP/1.0" 202 Accepted 2026-03-11 08:58:19,665 - lava_callback - INFO - Starting async job submit for node 69b12a3aa870a1dc3343bbcf 2026-03-11 08:58:19,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:19,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a3aa870a1dc3343bbcf HTTP/1.1" 200 None 2026-03-11 08:58:19,710 - lava_callback - DEBUG - Processing node 69b12a3aa870a1dc3343bbcf: ltp-watchqueue 2026-03-11 08:58:20,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:58:20,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:58:20,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b12a3aa870a1dc3343bbcf/log.txt.gz 2026-03-11 08:58:20,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:58:20,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:58:20,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b12a3aa870a1dc3343bbcf/lava-logs.yaml 2026-03-11 08:58:20,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 08:58:20,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 08:58:20,902 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69b12a3aa870a1dc3343bbcf/lava_callback.json.gz 2026-03-11 08:58:20,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:20,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a3aa870a1dc3343bbcf HTTP/1.1" 200 None 2026-03-11 08:58:20,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:20,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 08:58:20,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:21,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a3aa870a1dc3343bbcf HTTP/1.1" 200 None 2026-03-11 08:58:21,016 - lava_callback - INFO - Completed processing callback for node 69b12a3aa870a1dc3343bbcf 2026-03-11 08:58:24,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:24,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45684 - "GET / HTTP/1.0" 200 OK 2026-03-11 08:58:36,215 - lava_callback - INFO - Received callback for node 69ae8bb7c660ead8a389b32f INFO: 172.21.0.1:45696 - "POST /node/69ae8bb7c660ead8a389b32f HTTP/1.0" 202 Accepted 2026-03-11 08:58:36,220 - lava_callback - INFO - Starting async job submit for node 69ae8bb7c660ead8a389b32f 2026-03-11 08:58:36,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:36,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8bb7c660ead8a389b32f HTTP/1.1" 200 None 2026-03-11 08:58:36,241 - lava_callback - DEBUG - Processing node 69ae8bb7c660ead8a389b32f: baseline-arm64-baylibre 2026-03-11 08:58:36,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8bb7c660ead8a389b32f 2026-03-11 08:58:36,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:36,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8bb7c660ead8a389b32f HTTP/1.1" 200 None 2026-03-11 08:58:36,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:36,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 08:58:36,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 08:58:36,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8bb7c660ead8a389b32f HTTP/1.1" 200 None 2026-03-11 08:58:36,298 - lava_callback - ERROR - Error processing callback for node 69ae8bb7c660ead8a389b32f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53586 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:01:56,389 - lava_callback - INFO - Received callback for node 69ae8c7dc660ead8a389b450 INFO: 172.21.0.1:52486 - "POST /node/69ae8c7dc660ead8a389b450 HTTP/1.0" 202 Accepted 2026-03-11 09:01:56,402 - lava_callback - INFO - Starting async job submit for node 69ae8c7dc660ead8a389b450 2026-03-11 09:01:56,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:01:56,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8c7dc660ead8a389b450 HTTP/1.1" 200 None 2026-03-11 09:01:56,433 - lava_callback - DEBUG - Processing node 69ae8c7dc660ead8a389b450: baseline-arm64-baylibre 2026-03-11 09:01:56,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8c7dc660ead8a389b450 2026-03-11 09:01:56,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:01:56,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8c7dc660ead8a389b450 HTTP/1.1" 200 None 2026-03-11 09:01:56,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:01:56,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:01:56,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:01:56,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8c7dc660ead8a389b450 HTTP/1.1" 200 None 2026-03-11 09:01:56,512 - lava_callback - ERROR - Error processing callback for node 69ae8c7dc660ead8a389b450: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56692 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:03:40,123 - lava_callback - INFO - Received callback for node 69b129f0a870a1dc3343baee INFO: 172.21.0.1:44302 - "POST /node/69b129f0a870a1dc3343baee HTTP/1.0" 202 Accepted 2026-03-11 09:03:40,129 - lava_callback - INFO - Starting async job submit for node 69b129f0a870a1dc3343baee 2026-03-11 09:03:40,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:03:40,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f0a870a1dc3343baee HTTP/1.1" 200 None 2026-03-11 09:03:40,176 - lava_callback - DEBUG - Processing node 69b129f0a870a1dc3343baee: baseline-arm 2026-03-11 09:03:40,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:03:41,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:03:41,448 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f0a870a1dc3343baee/log.txt.gz 2026-03-11 09:03:41,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:03:41,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:03:41,782 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f0a870a1dc3343baee/lava-logs.yaml 2026-03-11 09:03:41,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:03:41,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:03:41,967 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b129f0a870a1dc3343baee/lava_callback.json.gz 2026-03-11 09:03:41,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:03:42,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b129f0a870a1dc3343baee HTTP/1.1" 200 None 2026-03-11 09:03:42,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:03:42,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:03:42,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:03:42,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b129f0a870a1dc3343baee HTTP/1.1" 200 None 2026-03-11 09:03:42,086 - lava_callback - INFO - Completed processing callback for node 69b129f0a870a1dc3343baee INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:03:54,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:03:54,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49760 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:04:36,511 - lava_callback - INFO - Received callback for node 69ae8d13c660ead8a389b49e INFO: 172.21.0.1:49774 - "POST /node/69ae8d13c660ead8a389b49e HTTP/1.0" 202 Accepted 2026-03-11 09:04:36,517 - lava_callback - INFO - Starting async job submit for node 69ae8d13c660ead8a389b49e 2026-03-11 09:04:36,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:04:36,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d13c660ead8a389b49e HTTP/1.1" 200 None 2026-03-11 09:04:36,534 - lava_callback - DEBUG - Processing node 69ae8d13c660ead8a389b49e: baseline-arm64-baylibre 2026-03-11 09:04:36,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8d13c660ead8a389b49e 2026-03-11 09:04:36,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:36,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d13c660ead8a389b49e HTTP/1.1" 200 None 2026-03-11 09:04:36,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:36,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:04:36,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:36,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8d13c660ead8a389b49e HTTP/1.1" 200 None 2026-03-11 09:04:36,595 - lava_callback - ERROR - Error processing callback for node 69ae8d13c660ead8a389b49e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 09:04:43,719 - lava_callback - INFO - Received callback for node 69b12a26a870a1dc3343bbae INFO: 172.21.0.1:51592 - "POST /node/69b12a26a870a1dc3343bbae HTTP/1.0" 202 Accepted 2026-03-11 09:04:43,725 - lava_callback - INFO - Starting async job submit for node 69b12a26a870a1dc3343bbae 2026-03-11 09:04:43,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:43,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a26a870a1dc3343bbae HTTP/1.1" 200 None 2026-03-11 09:04:43,765 - lava_callback - DEBUG - Processing node 69b12a26a870a1dc3343bbae: ltp-dio 2026-03-11 09:04:44,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:04:44,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:04:44,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69b12a26a870a1dc3343bbae/log.txt.gz 2026-03-11 09:04:44,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:04:44,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:04:44,780 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69b12a26a870a1dc3343bbae/lava-logs.yaml 2026-03-11 09:04:44,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:04:44,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:04:44,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69b12a26a870a1dc3343bbae/lava_callback.json.gz 2026-03-11 09:04:44,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:45,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a26a870a1dc3343bbae HTTP/1.1" 200 None 2026-03-11 09:04:45,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:45,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:04:45,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:45,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a26a870a1dc3343bbae HTTP/1.1" 200 None 2026-03-11 09:04:45,054 - lava_callback - INFO - Completed processing callback for node 69b12a26a870a1dc3343bbae INFO: 172.21.0.1:51600 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:04:54,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:04:54,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52076 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:05:36,508 - lava_callback - INFO - Received callback for node 69ae8d50c660ead8a389b4b7 INFO: 172.21.0.1:52086 - "POST /node/69ae8d50c660ead8a389b4b7 HTTP/1.0" 202 Accepted 2026-03-11 09:05:36,514 - lava_callback - INFO - Starting async job submit for node 69ae8d50c660ead8a389b4b7 2026-03-11 09:05:36,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:05:36,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d50c660ead8a389b4b7 HTTP/1.1" 200 None 2026-03-11 09:05:36,532 - lava_callback - DEBUG - Processing node 69ae8d50c660ead8a389b4b7: baseline-arm-baylibre 2026-03-11 09:05:36,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8d50c660ead8a389b4b7 2026-03-11 09:05:36,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:05:36,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d50c660ead8a389b4b7 HTTP/1.1" 200 None 2026-03-11 09:05:36,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:05:36,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:05:36,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:05:36,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8d50c660ead8a389b4b7 HTTP/1.1" 200 None 2026-03-11 09:05:36,585 - lava_callback - ERROR - Error processing callback for node 69ae8d50c660ead8a389b4b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:06:16,577 - lava_callback - INFO - Received callback for node 69ae8d78c660ead8a389b4e0 INFO: 172.21.0.1:34858 - "POST /node/69ae8d78c660ead8a389b4e0 HTTP/1.0" 202 Accepted 2026-03-11 09:06:16,582 - lava_callback - INFO - Starting async job submit for node 69ae8d78c660ead8a389b4e0 2026-03-11 09:06:16,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:06:16,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d78c660ead8a389b4e0 HTTP/1.1" 200 None 2026-03-11 09:06:16,601 - lava_callback - DEBUG - Processing node 69ae8d78c660ead8a389b4e0: baseline-arm-baylibre 2026-03-11 09:06:16,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8d78c660ead8a389b4e0 2026-03-11 09:06:16,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:06:16,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8d78c660ead8a389b4e0 HTTP/1.1" 200 None 2026-03-11 09:06:16,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:06:16,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:06:16,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:06:16,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8d78c660ead8a389b4e0 HTTP/1.1" 200 None 2026-03-11 09:06:16,657 - lava_callback - ERROR - Error processing callback for node 69ae8d78c660ead8a389b4e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60532 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:07:36,653 - lava_callback - INFO - Received callback for node 69ae8dc7c660ead8a389b515 INFO: 172.21.0.1:60542 - "POST /node/69ae8dc7c660ead8a389b515 HTTP/1.0" 202 Accepted 2026-03-11 09:07:36,659 - lava_callback - INFO - Starting async job submit for node 69ae8dc7c660ead8a389b515 2026-03-11 09:07:36,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:07:36,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8dc7c660ead8a389b515 HTTP/1.1" 200 None 2026-03-11 09:07:36,675 - lava_callback - DEBUG - Processing node 69ae8dc7c660ead8a389b515: baseline-arm-baylibre 2026-03-11 09:07:36,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8dc7c660ead8a389b515 2026-03-11 09:07:36,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:07:36,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8dc7c660ead8a389b515 HTTP/1.1" 200 None 2026-03-11 09:07:36,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:07:36,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:07:36,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:07:36,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8dc7c660ead8a389b515 HTTP/1.1" 200 None 2026-03-11 09:07:36,734 - lava_callback - ERROR - Error processing callback for node 69ae8dc7c660ead8a389b515: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:09:01,930 - lava_callback - INFO - Received callback for node 69ae8e28c660ead8a389b544 INFO: 172.21.0.1:60052 - "POST /node/69ae8e28c660ead8a389b544 HTTP/1.0" 202 Accepted 2026-03-11 09:09:01,936 - lava_callback - INFO - Starting async job submit for node 69ae8e28c660ead8a389b544 2026-03-11 09:09:01,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:01,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8e28c660ead8a389b544 HTTP/1.1" 200 None 2026-03-11 09:09:01,952 - lava_callback - DEBUG - Processing node 69ae8e28c660ead8a389b544: baseline-arm64-clabbe 2026-03-11 09:09:01,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8e28c660ead8a389b544 2026-03-11 09:09:01,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:01,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8e28c660ead8a389b544 HTTP/1.1" 200 None 2026-03-11 09:09:01,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:01,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:09:01,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:02,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8e28c660ead8a389b544 HTTP/1.1" 200 None 2026-03-11 09:09:02,011 - lava_callback - ERROR - Error processing callback for node 69ae8e28c660ead8a389b544: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:09:56,819 - lava_callback - INFO - Received callback for node 69ae8e61c660ead8a389b551 INFO: 172.21.0.1:47338 - "POST /node/69ae8e61c660ead8a389b551 HTTP/1.0" 202 Accepted 2026-03-11 09:09:56,825 - lava_callback - INFO - Starting async job submit for node 69ae8e61c660ead8a389b551 2026-03-11 09:09:56,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:56,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8e61c660ead8a389b551 HTTP/1.1" 200 None 2026-03-11 09:09:56,841 - lava_callback - DEBUG - Processing node 69ae8e61c660ead8a389b551: baseline-arm-baylibre 2026-03-11 09:09:56,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8e61c660ead8a389b551 2026-03-11 09:09:56,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:56,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8e61c660ead8a389b551 HTTP/1.1" 200 None 2026-03-11 09:09:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:56,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:09:56,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:09:56,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8e61c660ead8a389b551 HTTP/1.1" 200 None 2026-03-11 09:09:56,897 - lava_callback - ERROR - Error processing callback for node 69ae8e61c660ead8a389b551: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:11:37,116 - lava_callback - INFO - Received callback for node 69ae8eb4c660ead8a389b583 INFO: 172.21.0.1:41704 - "POST /node/69ae8eb4c660ead8a389b583 HTTP/1.0" 202 Accepted 2026-03-11 09:11:37,122 - lava_callback - INFO - Starting async job submit for node 69ae8eb4c660ead8a389b583 2026-03-11 09:11:37,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:11:37,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8eb4c660ead8a389b583 HTTP/1.1" 200 None 2026-03-11 09:11:37,146 - lava_callback - DEBUG - Processing node 69ae8eb4c660ead8a389b583: baseline-arm-baylibre 2026-03-11 09:11:37,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8eb4c660ead8a389b583 2026-03-11 09:11:37,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:11:37,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8eb4c660ead8a389b583 HTTP/1.1" 200 None 2026-03-11 09:11:37,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:11:37,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:11:37,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:11:37,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8eb4c660ead8a389b583 HTTP/1.1" 200 None 2026-03-11 09:11:37,204 - lava_callback - ERROR - Error processing callback for node 69ae8eb4c660ead8a389b583: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:15:57,269 - lava_callback - INFO - Received callback for node 69ae8fbac660ead8a389b5eb INFO: 172.21.0.1:41538 - "POST /node/69ae8fbac660ead8a389b5eb HTTP/1.0" 202 Accepted 2026-03-11 09:15:57,274 - lava_callback - INFO - Starting async job submit for node 69ae8fbac660ead8a389b5eb 2026-03-11 09:15:57,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:15:57,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8fbac660ead8a389b5eb HTTP/1.1" 200 None 2026-03-11 09:15:57,291 - lava_callback - DEBUG - Processing node 69ae8fbac660ead8a389b5eb: baseline-arm-baylibre 2026-03-11 09:15:57,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae8fbac660ead8a389b5eb 2026-03-11 09:15:57,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:15:57,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae8fbac660ead8a389b5eb HTTP/1.1" 200 None 2026-03-11 09:15:57,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:15:57,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:15:57,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:15:57,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae8fbac660ead8a389b5eb HTTP/1.1" 200 None 2026-03-11 09:15:57,361 - lava_callback - ERROR - Error processing callback for node 69ae8fbac660ead8a389b5eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:18:27,568 - lava_callback - INFO - Received callback for node 69b12ffca870a1dc3343bf0f INFO: 172.21.0.1:39916 - "POST /node/69b12ffca870a1dc3343bf0f HTTP/1.0" 202 Accepted 2026-03-11 09:18:27,575 - lava_callback - INFO - Starting async job submit for node 69b12ffca870a1dc3343bf0f 2026-03-11 09:18:27,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:18:27,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ffca870a1dc3343bf0f HTTP/1.1" 200 None 2026-03-11 09:18:27,654 - lava_callback - DEBUG - Processing node 69b12ffca870a1dc3343bf0f: baseline-arm 2026-03-11 09:18:28,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:18:28,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:18:28,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b12ffca870a1dc3343bf0f/log.txt.gz 2026-03-11 09:18:28,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:18:28,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:18:28,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b12ffca870a1dc3343bf0f/lava-logs.yaml 2026-03-11 09:18:28,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:18:28,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:18:28,937 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b12ffca870a1dc3343bf0f/lava_callback.json.gz DEBUG: Setup failed for 69b12ffca870a1dc3343bf0f. Transitting job node result: incomplete -> fail 2026-03-11 09:18:29,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:18:29,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12ffca870a1dc3343bf0f HTTP/1.1" 200 None 2026-03-11 09:18:29,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:18:29,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:18:29,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:18:29,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12ffca870a1dc3343bf0f HTTP/1.1" 200 None 2026-03-11 09:18:29,221 - lava_callback - INFO - Completed processing callback for node 69b12ffca870a1dc3343bf0f INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:18:54,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:18:54,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42514 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 09:19:15,358 - lava_callback - INFO - Received callback for node 69b12f61a870a1dc3343bebd INFO: 172.21.0.1:42518 - "POST /node/69b12f61a870a1dc3343bebd HTTP/1.0" 202 Accepted 2026-03-11 09:19:15,366 - lava_callback - INFO - Starting async job submit for node 69b12f61a870a1dc3343bebd 2026-03-11 09:19:15,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:15,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f61a870a1dc3343bebd HTTP/1.1" 200 None 2026-03-11 09:19:15,440 - lava_callback - DEBUG - Processing node 69b12f61a870a1dc3343bebd: ltp-smoke 2026-03-11 09:19:15,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:19:16,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:19:16,065 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12f61a870a1dc3343bebd/log.txt.gz 2026-03-11 09:19:16,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:19:16,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:19:16,638 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12f61a870a1dc3343bebd/lava-logs.yaml 2026-03-11 09:19:16,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:19:16,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:19:16,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b12f61a870a1dc3343bebd/lava_callback.json.gz 2026-03-11 09:19:16,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:16,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12f61a870a1dc3343bebd HTTP/1.1" 200 None 2026-03-11 09:19:16,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:16,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12599a870a1dc3343ba8b HTTP/1.1" 200 None 2026-03-11 09:19:16,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:17,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12f61a870a1dc3343bebd HTTP/1.1" 200 None 2026-03-11 09:19:17,130 - lava_callback - INFO - Completed processing callback for node 69b12f61a870a1dc3343bebd 2026-03-11 09:19:24,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:24,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36490 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:19:34,548 - lava_callback - INFO - Received callback for node 69b13397a870a1dc3343c379 INFO: 172.21.0.1:36492 - "POST /node/69b13397a870a1dc3343c379 HTTP/1.0" 202 Accepted 2026-03-11 09:19:34,558 - lava_callback - INFO - Starting async job submit for node 69b13397a870a1dc3343c379 2026-03-11 09:19:34,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:34,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13397a870a1dc3343c379 HTTP/1.1" 200 None 2026-03-11 09:19:34,588 - lava_callback - DEBUG - Processing node 69b13397a870a1dc3343c379: baseline-x86 2026-03-11 09:19:34,595 - lava_callback - WARNING - Failed to upload log 2026-03-11 09:19:34,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:19:34,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:19:34,783 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b13397a870a1dc3343c379/lava-logs.yaml 2026-03-11 09:19:34,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:19:34,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:19:34,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b13397a870a1dc3343c379/lava_callback.json.gz 2026-03-11 09:19:34,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:34,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13397a870a1dc3343c379 HTTP/1.1" 200 None 2026-03-11 09:19:34,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:34,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:19:34,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:34,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13397a870a1dc3343c379 HTTP/1.1" 200 None 2026-03-11 09:19:35,011 - lava_callback - INFO - Completed processing callback for node 69b13397a870a1dc3343c379 INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:19:42,419 - lava_callback - INFO - Received callback for node 69ae90abc660ead8a389b665 INFO: 172.21.0.1:56974 - "POST /node/69ae90abc660ead8a389b665 HTTP/1.0" 202 Accepted 2026-03-11 09:19:42,425 - lava_callback - INFO - Starting async job submit for node 69ae90abc660ead8a389b665 2026-03-11 09:19:42,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:42,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae90abc660ead8a389b665 HTTP/1.1" 200 None 2026-03-11 09:19:42,441 - lava_callback - DEBUG - Processing node 69ae90abc660ead8a389b665: baseline-arm64-clabbe 2026-03-11 09:19:42,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae90abc660ead8a389b665 2026-03-11 09:19:42,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:42,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae90abc660ead8a389b665 HTTP/1.1" 200 None 2026-03-11 09:19:42,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:42,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:19:42,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:42,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae90abc660ead8a389b665 HTTP/1.1" 200 None 2026-03-11 09:19:42,504 - lava_callback - ERROR - Error processing callback for node 69ae90abc660ead8a389b665: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:19:54,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:19:54,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54134 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:20:02,529 - lava_callback - INFO - Received callback for node 69b13399a870a1dc3343c382 INFO: 172.21.0.1:58522 - "POST /node/69b13399a870a1dc3343c382 HTTP/1.0" 202 Accepted 2026-03-11 09:20:02,535 - lava_callback - INFO - Starting async job submit for node 69b13399a870a1dc3343c382 2026-03-11 09:20:02,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:02,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13399a870a1dc3343c382 HTTP/1.1" 200 None 2026-03-11 09:20:02,572 - lava_callback - DEBUG - Processing node 69b13399a870a1dc3343c382: baseline-x86 2026-03-11 09:20:02,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:02,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:02,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b13399a870a1dc3343c382/log.txt.gz 2026-03-11 09:20:02,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:03,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:03,179 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b13399a870a1dc3343c382/lava-logs.yaml 2026-03-11 09:20:03,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:03,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:03,319 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b13399a870a1dc3343c382/lava_callback.json.gz 2026-03-11 09:20:03,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:03,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13399a870a1dc3343c382 HTTP/1.1" 200 None 2026-03-11 09:20:03,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:03,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:20:03,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:03,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13399a870a1dc3343c382 HTTP/1.1" 200 None 2026-03-11 09:20:03,405 - lava_callback - INFO - Completed processing callback for node 69b13399a870a1dc3343c382 INFO: 172.21.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48068 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:20:24,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:24,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:20:38,948 - lava_callback - INFO - Received callback for node 69b13398a870a1dc3343c37c INFO: 172.21.0.1:42304 - "POST /node/69b13398a870a1dc3343c37c HTTP/1.0" 202 Accepted 2026-03-11 09:20:38,955 - lava_callback - INFO - Starting async job submit for node 69b13398a870a1dc3343c37c 2026-03-11 09:20:38,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:39,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13398a870a1dc3343c37c HTTP/1.1" 200 None 2026-03-11 09:20:39,014 - lava_callback - DEBUG - Processing node 69b13398a870a1dc3343c37c: baseline-x86 2026-03-11 09:20:39,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:39,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:39,574 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37c/log.txt.gz 2026-03-11 09:20:39,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:40,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:40,166 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37c/lava-logs.yaml 2026-03-11 09:20:40,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:20:40,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:20:40,328 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37c/lava_callback.json.gz 2026-03-11 09:20:40,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:40,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13398a870a1dc3343c37c HTTP/1.1" 200 None 2026-03-11 09:20:40,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:40,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:20:40,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:40,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13398a870a1dc3343c37c HTTP/1.1" 200 None 2026-03-11 09:20:40,429 - lava_callback - INFO - Completed processing callback for node 69b13398a870a1dc3343c37c INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:20:54,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:20:54,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51200 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:21:02,469 - lava_callback - INFO - Received callback for node 69ae90e8c660ead8a389b674 INFO: 172.21.0.1:47876 - "POST /node/69ae90e8c660ead8a389b674 HTTP/1.0" 202 Accepted 2026-03-11 09:21:02,479 - lava_callback - INFO - Starting async job submit for node 69ae90e8c660ead8a389b674 2026-03-11 09:21:02,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:21:02,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae90e8c660ead8a389b674 HTTP/1.1" 200 None 2026-03-11 09:21:02,529 - lava_callback - DEBUG - Processing node 69ae90e8c660ead8a389b674: baseline-arm-clabbe 2026-03-11 09:21:02,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae90e8c660ead8a389b674 2026-03-11 09:21:02,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:21:02,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae90e8c660ead8a389b674 HTTP/1.1" 200 None 2026-03-11 09:21:02,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:21:02,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:21:02,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:21:02,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae90e8c660ead8a389b674 HTTP/1.1" 200 None 2026-03-11 09:21:02,637 - lava_callback - ERROR - Error processing callback for node 69ae90e8c660ead8a389b674: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:22:42,588 - lava_callback - INFO - Received callback for node 69ae9159c660ead8a389b6a8 INFO: 172.21.0.1:53306 - "POST /node/69ae9159c660ead8a389b6a8 HTTP/1.0" 202 Accepted 2026-03-11 09:22:42,594 - lava_callback - INFO - Starting async job submit for node 69ae9159c660ead8a389b6a8 2026-03-11 09:22:42,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:22:42,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9159c660ead8a389b6a8 HTTP/1.1" 200 None 2026-03-11 09:22:42,614 - lava_callback - DEBUG - Processing node 69ae9159c660ead8a389b6a8: baseline-arm-clabbe 2026-03-11 09:22:42,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9159c660ead8a389b6a8 2026-03-11 09:22:42,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:22:42,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9159c660ead8a389b6a8 HTTP/1.1" 200 None 2026-03-11 09:22:42,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:22:42,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-11 09:22:42,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:22:42,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9159c660ead8a389b6a8 HTTP/1.1" 200 None 2026-03-11 09:22:42,685 - lava_callback - ERROR - Error processing callback for node 69ae9159c660ead8a389b6a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:23:37,634 - lava_callback - INFO - Received callback for node 69ae9189c660ead8a389b6ba INFO: 172.21.0.1:56466 - "POST /node/69ae9189c660ead8a389b6ba HTTP/1.0" 202 Accepted 2026-03-11 09:23:37,639 - lava_callback - INFO - Starting async job submit for node 69ae9189c660ead8a389b6ba 2026-03-11 09:23:37,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:23:37,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9189c660ead8a389b6ba HTTP/1.1" 200 None 2026-03-11 09:23:37,655 - lava_callback - DEBUG - Processing node 69ae9189c660ead8a389b6ba: baseline-arm64-baylibre 2026-03-11 09:23:37,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9189c660ead8a389b6ba 2026-03-11 09:23:37,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:23:37,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9189c660ead8a389b6ba HTTP/1.1" 200 None 2026-03-11 09:23:37,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:23:37,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:23:37,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:23:37,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9189c660ead8a389b6ba HTTP/1.1" 200 None 2026-03-11 09:23:37,711 - lava_callback - ERROR - Error processing callback for node 69ae9189c660ead8a389b6ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48520 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:26:02,669 - lava_callback - INFO - Received callback for node 69ae9227c660ead8a389b6f8 INFO: 172.21.0.1:47700 - "POST /node/69ae9227c660ead8a389b6f8 HTTP/1.0" 202 Accepted 2026-03-11 09:26:02,675 - lava_callback - INFO - Starting async job submit for node 69ae9227c660ead8a389b6f8 2026-03-11 09:26:02,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:26:02,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9227c660ead8a389b6f8 HTTP/1.1" 200 None 2026-03-11 09:26:02,691 - lava_callback - DEBUG - Processing node 69ae9227c660ead8a389b6f8: baseline-arm64-clabbe 2026-03-11 09:26:02,691 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9227c660ead8a389b6f8 2026-03-11 09:26:02,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:26:02,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9227c660ead8a389b6f8 HTTP/1.1" 200 None 2026-03-11 09:26:02,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:26:02,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:26:02,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:26:02,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9227c660ead8a389b6f8 HTTP/1.1" 200 None 2026-03-11 09:26:02,777 - lava_callback - ERROR - Error processing callback for node 69ae9227c660ead8a389b6f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50502 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:27:06,465 - lava_callback - INFO - Received callback for node 69b1354fa870a1dc3343c42b INFO: 172.21.0.1:38024 - "POST /node/69b1354fa870a1dc3343c42b HTTP/1.0" 202 Accepted 2026-03-11 09:27:06,471 - lava_callback - INFO - Starting async job submit for node 69b1354fa870a1dc3343c42b 2026-03-11 09:27:06,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:06,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1354fa870a1dc3343c42b HTTP/1.1" 200 None 2026-03-11 09:27:06,504 - lava_callback - DEBUG - Processing node 69b1354fa870a1dc3343c42b: baseline-x86 INFO: 172.21.0.1:38036 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:27:06,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:27:06,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:06,849 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b1354fa870a1dc3343c42b/log.txt.gz 2026-03-11 09:27:06,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:27:07,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:07,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b1354fa870a1dc3343c42b/lava-logs.yaml 2026-03-11 09:27:07,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:27:07,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:07,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b1354fa870a1dc3343c42b/lava_callback.json.gz 2026-03-11 09:27:07,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:07,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1354fa870a1dc3343c42b HTTP/1.1" 200 None 2026-03-11 09:27:07,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:07,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:27:07,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:07,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1354fa870a1dc3343c42b HTTP/1.1" 200 None 2026-03-11 09:27:07,425 - lava_callback - INFO - Completed processing callback for node 69b1354fa870a1dc3343c42b INFO: 172.21.0.1:44660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:27:24,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:25,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 09:27:25,824 - lava_callback - INFO - Received callback for node 69b13550a870a1dc3343c42e INFO: 172.21.0.1:39010 - "POST /node/69b13550a870a1dc3343c42e HTTP/1.0" 202 Accepted 2026-03-11 09:27:25,830 - lava_callback - INFO - Starting async job submit for node 69b13550a870a1dc3343c42e 2026-03-11 09:27:25,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:25,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13550a870a1dc3343c42e HTTP/1.1" 200 None 2026-03-11 09:27:25,864 - lava_callback - DEBUG - Processing node 69b13550a870a1dc3343c42e: baseline-x86 2026-03-11 09:27:26,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:27:26,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:26,172 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b13550a870a1dc3343c42e/log.txt.gz 2026-03-11 09:27:26,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:27:26,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:26,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b13550a870a1dc3343c42e/lava-logs.yaml 2026-03-11 09:27:26,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:27:26,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:27:26,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b13550a870a1dc3343c42e/lava_callback.json.gz 2026-03-11 09:27:26,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:26,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13550a870a1dc3343c42e HTTP/1.1" 200 None 2026-03-11 09:27:26,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:26,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:27:26,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:26,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13550a870a1dc3343c42e HTTP/1.1" 200 None 2026-03-11 09:27:26,735 - lava_callback - INFO - Completed processing callback for node 69b13550a870a1dc3343c42e INFO: 172.21.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:27:55,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:27:55,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53314 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:28:42,769 - lava_callback - INFO - Received callback for node 69ae92c1c660ead8a389b73b INFO: 172.21.0.1:59312 - "POST /node/69ae92c1c660ead8a389b73b HTTP/1.0" 202 Accepted 2026-03-11 09:28:42,774 - lava_callback - INFO - Starting async job submit for node 69ae92c1c660ead8a389b73b 2026-03-11 09:28:42,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:28:42,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae92c1c660ead8a389b73b HTTP/1.1" 200 None 2026-03-11 09:28:42,790 - lava_callback - DEBUG - Processing node 69ae92c1c660ead8a389b73b: baseline-arm64-clabbe 2026-03-11 09:28:42,790 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae92c1c660ead8a389b73b 2026-03-11 09:28:42,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:28:42,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae92c1c660ead8a389b73b HTTP/1.1" 200 None 2026-03-11 09:28:42,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:28:42,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:28:42,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:28:42,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae92c1c660ead8a389b73b HTTP/1.1" 200 None 2026-03-11 09:28:42,853 - lava_callback - ERROR - Error processing callback for node 69ae92c1c660ead8a389b73b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47900 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:29:04,004 - lava_callback - INFO - Received callback for node 69b12a0da870a1dc3343bb74 INFO: 172.21.0.1:37284 - "POST /node/69b12a0da870a1dc3343bb74 HTTP/1.0" 202 Accepted 2026-03-11 09:29:04,053 - lava_callback - INFO - Starting async job submit for node 69b12a0da870a1dc3343bb74 2026-03-11 09:29:04,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:04,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0da870a1dc3343bb74 HTTP/1.1" 200 None 2026-03-11 09:29:04,100 - lava_callback - DEBUG - Processing node 69b12a0da870a1dc3343bb74: baseline-arm-pengutronix 2026-03-11 09:29:04,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:29:04,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:29:04,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0da870a1dc3343bb74/log.txt.gz 2026-03-11 09:29:04,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:29:04,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:29:04,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0da870a1dc3343bb74/lava-logs.yaml 2026-03-11 09:29:04,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:29:04,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:29:04,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b12a0da870a1dc3343bb74/lava_callback.json.gz DEBUG: Setup failed for 69b12a0da870a1dc3343bb74. Transitting job node result: incomplete -> fail 2026-03-11 09:29:04,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:04,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12a0da870a1dc3343bb74 HTTP/1.1" 200 None 2026-03-11 09:29:04,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:04,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:29:04,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:04,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b12a0da870a1dc3343bb74 HTTP/1.1" 200 None 2026-03-11 09:29:04,968 - lava_callback - INFO - Completed processing callback for node 69b12a0da870a1dc3343bb74 INFO: 172.21.0.1:37286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53064 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:29:25,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:25,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:29:57,963 - lava_callback - INFO - Received callback for node 69ae9304c660ead8a389b749 INFO: 172.21.0.1:56620 - "POST /node/69ae9304c660ead8a389b749 HTTP/1.0" 202 Accepted 2026-03-11 09:29:57,969 - lava_callback - INFO - Starting async job submit for node 69ae9304c660ead8a389b749 2026-03-11 09:29:57,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:57,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9304c660ead8a389b749 HTTP/1.1" 200 None 2026-03-11 09:29:57,986 - lava_callback - DEBUG - Processing node 69ae9304c660ead8a389b749: baseline-arm64-baylibre 2026-03-11 09:29:57,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9304c660ead8a389b749 2026-03-11 09:29:57,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:58,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9304c660ead8a389b749 HTTP/1.1" 200 None 2026-03-11 09:29:58,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:58,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:29:58,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:29:58,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9304c660ead8a389b749 HTTP/1.1" 200 None 2026-03-11 09:29:58,045 - lava_callback - ERROR - Error processing callback for node 69ae9304c660ead8a389b749: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:30:57,940 - lava_callback - INFO - Received callback for node 69ae934ec660ead8a389b75c INFO: 172.21.0.1:39144 - "POST /node/69ae934ec660ead8a389b75c HTTP/1.0" 202 Accepted 2026-03-11 09:30:57,945 - lava_callback - INFO - Starting async job submit for node 69ae934ec660ead8a389b75c 2026-03-11 09:30:57,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:30:57,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae934ec660ead8a389b75c HTTP/1.1" 200 None 2026-03-11 09:30:57,961 - lava_callback - DEBUG - Processing node 69ae934ec660ead8a389b75c: baseline-arm64-baylibre 2026-03-11 09:30:57,962 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae934ec660ead8a389b75c 2026-03-11 09:30:57,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:30:57,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae934ec660ead8a389b75c HTTP/1.1" 200 None 2026-03-11 09:30:57,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:30:57,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:30:57,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:30:58,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae934ec660ead8a389b75c HTTP/1.1" 200 None 2026-03-11 09:30:58,014 - lava_callback - ERROR - Error processing callback for node 69ae934ec660ead8a389b75c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:32:18,109 - lava_callback - INFO - Received callback for node 69ae9399c660ead8a389b778 INFO: 172.21.0.1:36212 - "POST /node/69ae9399c660ead8a389b778 HTTP/1.0" 202 Accepted 2026-03-11 09:32:18,115 - lava_callback - INFO - Starting async job submit for node 69ae9399c660ead8a389b778 2026-03-11 09:32:18,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:32:18,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9399c660ead8a389b778 HTTP/1.1" 200 None 2026-03-11 09:32:18,137 - lava_callback - DEBUG - Processing node 69ae9399c660ead8a389b778: baseline-arm64-baylibre 2026-03-11 09:32:18,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9399c660ead8a389b778 2026-03-11 09:32:18,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:32:18,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9399c660ead8a389b778 HTTP/1.1" 200 None 2026-03-11 09:32:18,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:32:18,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:32:18,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:32:18,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9399c660ead8a389b778 HTTP/1.1" 200 None 2026-03-11 09:32:18,234 - lava_callback - ERROR - Error processing callback for node 69ae9399c660ead8a389b778: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45072 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:33:38,151 - lava_callback - INFO - Received callback for node 69ae93e5c660ead8a389b787 INFO: 172.21.0.1:45086 - "POST /node/69ae93e5c660ead8a389b787 HTTP/1.0" 202 Accepted 2026-03-11 09:33:38,157 - lava_callback - INFO - Starting async job submit for node 69ae93e5c660ead8a389b787 2026-03-11 09:33:38,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:33:38,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae93e5c660ead8a389b787 HTTP/1.1" 200 None 2026-03-11 09:33:38,174 - lava_callback - DEBUG - Processing node 69ae93e5c660ead8a389b787: baseline-arm64-baylibre 2026-03-11 09:33:38,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae93e5c660ead8a389b787 2026-03-11 09:33:38,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:33:38,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae93e5c660ead8a389b787 HTTP/1.1" 200 None 2026-03-11 09:33:38,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:33:38,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:33:38,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:33:38,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae93e5c660ead8a389b787 HTTP/1.1" 200 None 2026-03-11 09:33:38,237 - lava_callback - ERROR - Error processing callback for node 69ae93e5c660ead8a389b787: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:34:58,197 - lava_callback - INFO - Received callback for node 69ae942fc660ead8a389b7ad INFO: 172.21.0.1:57998 - "POST /node/69ae942fc660ead8a389b7ad HTTP/1.0" 202 Accepted 2026-03-11 09:34:58,203 - lava_callback - INFO - Starting async job submit for node 69ae942fc660ead8a389b7ad 2026-03-11 09:34:58,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:34:58,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae942fc660ead8a389b7ad HTTP/1.1" 200 None 2026-03-11 09:34:58,219 - lava_callback - DEBUG - Processing node 69ae942fc660ead8a389b7ad: baseline-arm64-baylibre 2026-03-11 09:34:58,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae942fc660ead8a389b7ad 2026-03-11 09:34:58,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:34:58,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae942fc660ead8a389b7ad HTTP/1.1" 200 None 2026-03-11 09:34:58,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:34:58,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:34:58,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:34:58,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae942fc660ead8a389b7ad HTTP/1.1" 200 None 2026-03-11 09:34:58,280 - lava_callback - ERROR - Error processing callback for node 69ae942fc660ead8a389b7ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:35:07,846 - lava_callback - INFO - Received callback for node 69b13398a870a1dc3343c37f INFO: 172.21.0.1:33212 - "POST /node/69b13398a870a1dc3343c37f HTTP/1.0" 202 Accepted 2026-03-11 09:35:07,853 - lava_callback - INFO - Starting async job submit for node 69b13398a870a1dc3343c37f 2026-03-11 09:35:07,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:07,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13398a870a1dc3343c37f HTTP/1.1" 200 None 2026-03-11 09:35:07,913 - lava_callback - DEBUG - Processing node 69b13398a870a1dc3343c37f: baseline-x86 2026-03-11 09:35:08,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:35:08,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:35:08,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37f/log.txt.gz 2026-03-11 09:35:09,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:35:09,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:35:09,541 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37f/lava-logs.yaml 2026-03-11 09:35:09,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:35:09,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:35:09,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b13398a870a1dc3343c37f/lava_callback.json.gz DEBUG: Setup failed for 69b13398a870a1dc3343c37f. Transitting job node result: incomplete -> fail 2026-03-11 09:35:09,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:09,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13398a870a1dc3343c37f HTTP/1.1" 200 None 2026-03-11 09:35:09,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:09,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:35:09,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:09,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13398a870a1dc3343c37f HTTP/1.1" 200 None 2026-03-11 09:35:10,000 - lava_callback - INFO - Completed processing callback for node 69b13398a870a1dc3343c37f INFO: 172.21.0.1:39930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:35:25,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:25,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:35:58,275 - lava_callback - INFO - Received callback for node 69ae947ac660ead8a389b7ba INFO: 172.21.0.1:56426 - "POST /node/69ae947ac660ead8a389b7ba HTTP/1.0" 202 Accepted 2026-03-11 09:35:58,281 - lava_callback - INFO - Starting async job submit for node 69ae947ac660ead8a389b7ba 2026-03-11 09:35:58,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:58,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae947ac660ead8a389b7ba HTTP/1.1" 200 None 2026-03-11 09:35:58,298 - lava_callback - DEBUG - Processing node 69ae947ac660ead8a389b7ba: baseline-arm64-baylibre 2026-03-11 09:35:58,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae947ac660ead8a389b7ba 2026-03-11 09:35:58,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:58,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae947ac660ead8a389b7ba HTTP/1.1" 200 None 2026-03-11 09:35:58,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:58,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:35:58,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:35:58,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae947ac660ead8a389b7ba HTTP/1.1" 200 None 2026-03-11 09:35:58,363 - lava_callback - ERROR - Error processing callback for node 69ae947ac660ead8a389b7ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:37:23,088 - lava_callback - INFO - Received callback for node 69ae94c8c660ead8a389b7e1 INFO: 172.21.0.1:47936 - "POST /node/69ae94c8c660ead8a389b7e1 HTTP/1.0" 202 Accepted 2026-03-11 09:37:23,100 - lava_callback - INFO - Starting async job submit for node 69ae94c8c660ead8a389b7e1 2026-03-11 09:37:23,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:37:23,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae94c8c660ead8a389b7e1 HTTP/1.1" 200 None 2026-03-11 09:37:23,131 - lava_callback - DEBUG - Processing node 69ae94c8c660ead8a389b7e1: baseline-arm64-clabbe 2026-03-11 09:37:23,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae94c8c660ead8a389b7e1 2026-03-11 09:37:23,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:37:23,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae94c8c660ead8a389b7e1 HTTP/1.1" 200 None 2026-03-11 09:37:23,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:37:23,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:37:23,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:37:23,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae94c8c660ead8a389b7e1 HTTP/1.1" 200 None 2026-03-11 09:37:23,206 - lava_callback - ERROR - Error processing callback for node 69ae94c8c660ead8a389b7e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47902 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:38:43,137 - lava_callback - INFO - Received callback for node 69ae9514c660ead8a389b7f7 INFO: 172.21.0.1:43578 - "POST /node/69ae9514c660ead8a389b7f7 HTTP/1.0" 202 Accepted 2026-03-11 09:38:43,143 - lava_callback - INFO - Starting async job submit for node 69ae9514c660ead8a389b7f7 2026-03-11 09:38:43,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:38:43,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9514c660ead8a389b7f7 HTTP/1.1" 200 None 2026-03-11 09:38:43,167 - lava_callback - DEBUG - Processing node 69ae9514c660ead8a389b7f7: baseline-arm64-clabbe 2026-03-11 09:38:43,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9514c660ead8a389b7f7 2026-03-11 09:38:43,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:38:43,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9514c660ead8a389b7f7 HTTP/1.1" 200 None 2026-03-11 09:38:43,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:38:43,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-11 09:38:43,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:38:43,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9514c660ead8a389b7f7 HTTP/1.1" 200 None 2026-03-11 09:38:43,239 - lava_callback - ERROR - Error processing callback for node 69ae9514c660ead8a389b7f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:39:58,876 - lava_callback - INFO - Received callback for node 69b137f5a870a1dc3343c4f7 INFO: 172.21.0.1:49350 - "POST /node/69b137f5a870a1dc3343c4f7 HTTP/1.0" 202 Accepted 2026-03-11 09:39:58,882 - lava_callback - INFO - Starting async job submit for node 69b137f5a870a1dc3343c4f7 2026-03-11 09:39:58,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:39:58,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b137f5a870a1dc3343c4f7 HTTP/1.1" 200 None 2026-03-11 09:39:58,915 - lava_callback - DEBUG - Processing node 69b137f5a870a1dc3343c4f7: baseline-x86 2026-03-11 09:39:59,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:39:59,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:39:59,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69b137f5a870a1dc3343c4f7/log.txt.gz 2026-03-11 09:39:59,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:39:59,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:39:59,690 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69b137f5a870a1dc3343c4f7/lava-logs.yaml 2026-03-11 09:39:59,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:39:59,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:39:59,837 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69b137f5a870a1dc3343c4f7/lava_callback.json.gz 2026-03-11 09:39:59,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:39:59,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b137f5a870a1dc3343c4f7 HTTP/1.1" 200 None 2026-03-11 09:39:59,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:39:59,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125bba870a1dc3343baae HTTP/1.1" 200 None 2026-03-11 09:39:59,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:39:59,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b137f5a870a1dc3343c4f7 HTTP/1.1" 200 None 2026-03-11 09:39:59,941 - lava_callback - INFO - Completed processing callback for node 69b137f5a870a1dc3343c4f7 INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:40:25,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:25,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 09:40:25,788 - lava_callback - INFO - Received callback for node 69b134aba870a1dc3343c40a INFO: 172.21.0.1:52796 - "POST /node/69b134aba870a1dc3343c40a HTTP/1.0" 202 Accepted 2026-03-11 09:40:25,795 - lava_callback - INFO - Starting async job submit for node 69b134aba870a1dc3343c40a 2026-03-11 09:40:25,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:25,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b134aba870a1dc3343c40a HTTP/1.1" 200 None 2026-03-11 09:40:25,863 - lava_callback - DEBUG - Processing node 69b134aba870a1dc3343c40a: baseline-arm 2026-03-11 09:40:26,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:40:26,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:40:26,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b134aba870a1dc3343c40a/log.txt.gz 2026-03-11 09:40:26,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:40:27,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:40:27,219 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b134aba870a1dc3343c40a/lava-logs.yaml 2026-03-11 09:40:27,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:40:27,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:40:27,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b134aba870a1dc3343c40a/lava_callback.json.gz DEBUG: Setup failed for 69b134aba870a1dc3343c40a. Transitting job node result: incomplete -> fail 2026-03-11 09:40:27,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:27,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b134aba870a1dc3343c40a HTTP/1.1" 200 None 2026-03-11 09:40:27,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:27,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:40:27,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:27,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b134aba870a1dc3343c40a HTTP/1.1" 200 None 2026-03-11 09:40:27,690 - lava_callback - INFO - Completed processing callback for node 69b134aba870a1dc3343c40a INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:40:55,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:40:55,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:41:57,068 - lava_callback - INFO - Received callback for node 69b134cea870a1dc3343c418 INFO: 172.21.0.1:55322 - "POST /node/69b134cea870a1dc3343c418 HTTP/1.0" 202 Accepted 2026-03-11 09:41:57,076 - lava_callback - INFO - Starting async job submit for node 69b134cea870a1dc3343c418 2026-03-11 09:41:57,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:41:57,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b134cea870a1dc3343c418 HTTP/1.1" 200 None 2026-03-11 09:41:57,163 - lava_callback - DEBUG - Processing node 69b134cea870a1dc3343c418: ltp-smoke 2026-03-11 09:41:57,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:41:57,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:41:57,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b134cea870a1dc3343c418/log.txt.gz 2026-03-11 09:41:58,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:41:58,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:41:58,365 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b134cea870a1dc3343c418/lava-logs.yaml 2026-03-11 09:41:58,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:41:58,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:41:58,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b134cea870a1dc3343c418/lava_callback.json.gz 2026-03-11 09:41:58,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:41:58,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b134cea870a1dc3343c418 HTTP/1.1" 200 None 2026-03-11 09:41:58,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:41:58,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12599a870a1dc3343ba8b HTTP/1.1" 200 None 2026-03-11 09:41:58,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:41:58,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b134cea870a1dc3343c418 HTTP/1.1" 200 None 2026-03-11 09:41:58,884 - lava_callback - INFO - Completed processing callback for node 69b134cea870a1dc3343c418 INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:42:25,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:42:25,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:45:19,250 - lava_callback - INFO - Received callback for node 69ae96abc660ead8a389b887 INFO: 172.21.0.1:60266 - "POST /node/69ae96abc660ead8a389b887 HTTP/1.0" 202 Accepted 2026-03-11 09:45:19,255 - lava_callback - INFO - Starting async job submit for node 69ae96abc660ead8a389b887 2026-03-11 09:45:19,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:45:19,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae96abc660ead8a389b887 HTTP/1.1" 200 None 2026-03-11 09:45:19,271 - lava_callback - DEBUG - Processing node 69ae96abc660ead8a389b887: baseline-arm64-baylibre 2026-03-11 09:45:19,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae96abc660ead8a389b887 2026-03-11 09:45:19,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:45:19,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae96abc660ead8a389b887 HTTP/1.1" 200 None 2026-03-11 09:45:19,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:45:19,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-11 09:45:19,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:45:19,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae96abc660ead8a389b887 HTTP/1.1" 200 None 2026-03-11 09:45:19,324 - lava_callback - ERROR - Error processing callback for node 69ae96abc660ead8a389b887: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:46:38,842 - lava_callback - INFO - Received callback for node 69ae96f7c660ead8a389b89b INFO: 172.21.0.1:33602 - "POST /node/69ae96f7c660ead8a389b89b HTTP/1.0" 202 Accepted 2026-03-11 09:46:38,848 - lava_callback - INFO - Starting async job submit for node 69ae96f7c660ead8a389b89b 2026-03-11 09:46:38,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:46:38,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae96f7c660ead8a389b89b HTTP/1.1" 200 None 2026-03-11 09:46:38,870 - lava_callback - DEBUG - Processing node 69ae96f7c660ead8a389b89b: baseline-arm64-baylibre 2026-03-11 09:46:38,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae96f7c660ead8a389b89b 2026-03-11 09:46:38,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:46:38,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae96f7c660ead8a389b89b HTTP/1.1" 200 None 2026-03-11 09:46:38,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:46:38,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-11 09:46:38,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:46:38,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae96f7c660ead8a389b89b HTTP/1.1" 200 None 2026-03-11 09:46:38,924 - lava_callback - ERROR - Error processing callback for node 69ae96f7c660ead8a389b89b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:49:45,230 - lava_callback - INFO - Received callback for node 69b1362aa870a1dc3343c485 INFO: 172.21.0.1:48036 - "POST /node/69b1362aa870a1dc3343c485 HTTP/1.0" 202 Accepted 2026-03-11 09:49:45,277 - lava_callback - INFO - Starting async job submit for node 69b1362aa870a1dc3343c485 2026-03-11 09:49:45,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:45,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1362aa870a1dc3343c485 HTTP/1.1" 200 None 2026-03-11 09:49:45,316 - lava_callback - DEBUG - Processing node 69b1362aa870a1dc3343c485: baseline-arm-pengutronix 2026-03-11 09:49:45,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:49:45,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:49:45,573 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1362aa870a1dc3343c485/log.txt.gz 2026-03-11 09:49:45,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:49:45,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:49:45,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1362aa870a1dc3343c485/lava-logs.yaml 2026-03-11 09:49:45,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:49:45,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:49:45,944 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b1362aa870a1dc3343c485/lava_callback.json.gz DEBUG: Setup failed for 69b1362aa870a1dc3343c485. Transitting job node result: incomplete -> fail 2026-03-11 09:49:46,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:46,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1362aa870a1dc3343c485 HTTP/1.1" 200 None 2026-03-11 09:49:46,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:46,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:49:46,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:46,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1362aa870a1dc3343c485 HTTP/1.1" 200 None 2026-03-11 09:49:46,160 - lava_callback - INFO - Completed processing callback for node 69b1362aa870a1dc3343c485 INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:49:55,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:55,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:49:59,027 - lava_callback - INFO - Received callback for node 69ae97b5c660ead8a389b8d3 INFO: 172.21.0.1:41638 - "POST /node/69ae97b5c660ead8a389b8d3 HTTP/1.0" 202 Accepted 2026-03-11 09:49:59,033 - lava_callback - INFO - Starting async job submit for node 69ae97b5c660ead8a389b8d3 2026-03-11 09:49:59,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:59,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae97b5c660ead8a389b8d3 HTTP/1.1" 200 None 2026-03-11 09:49:59,052 - lava_callback - DEBUG - Processing node 69ae97b5c660ead8a389b8d3: baseline-arm64-baylibre 2026-03-11 09:49:59,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae97b5c660ead8a389b8d3 2026-03-11 09:49:59,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:59,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae97b5c660ead8a389b8d3 HTTP/1.1" 200 None 2026-03-11 09:49:59,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:59,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-11 09:49:59,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:49:59,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae97b5c660ead8a389b8d3 HTTP/1.1" 200 None 2026-03-11 09:49:59,107 - lava_callback - ERROR - Error processing callback for node 69ae97b5c660ead8a389b8d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:52:19,374 - lava_callback - INFO - Received callback for node 69ae984cc660ead8a389b905 INFO: 172.21.0.1:44194 - "POST /node/69ae984cc660ead8a389b905 HTTP/1.0" 202 Accepted 2026-03-11 09:52:19,379 - lava_callback - INFO - Starting async job submit for node 69ae984cc660ead8a389b905 2026-03-11 09:52:19,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:52:19,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae984cc660ead8a389b905 HTTP/1.1" 200 None 2026-03-11 09:52:19,419 - lava_callback - DEBUG - Processing node 69ae984cc660ead8a389b905: baseline-arm64-baylibre 2026-03-11 09:52:19,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae984cc660ead8a389b905 2026-03-11 09:52:19,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:52:19,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae984cc660ead8a389b905 HTTP/1.1" 200 None 2026-03-11 09:52:19,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:52:19,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-11 09:52:19,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:52:19,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae984cc660ead8a389b905 HTTP/1.1" 200 None 2026-03-11 09:52:19,518 - lava_callback - ERROR - Error processing callback for node 69ae984cc660ead8a389b905: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:55:04,103 - lava_callback - INFO - Received callback for node 69ae98e6c660ead8a389b92e INFO: 172.21.0.1:56626 - "POST /node/69ae98e6c660ead8a389b92e HTTP/1.0" 202 Accepted 2026-03-11 09:55:04,110 - lava_callback - INFO - Starting async job submit for node 69ae98e6c660ead8a389b92e 2026-03-11 09:55:04,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:55:04,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae98e6c660ead8a389b92e HTTP/1.1" 200 None 2026-03-11 09:55:04,132 - lava_callback - DEBUG - Processing node 69ae98e6c660ead8a389b92e: baseline-arm64-clabbe 2026-03-11 09:55:04,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae98e6c660ead8a389b92e 2026-03-11 09:55:04,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:55:04,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae98e6c660ead8a389b92e HTTP/1.1" 200 None 2026-03-11 09:55:04,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:55:04,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-11 09:55:04,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:55:04,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae98e6c660ead8a389b92e HTTP/1.1" 200 None 2026-03-11 09:55:04,222 - lava_callback - ERROR - Error processing callback for node 69ae98e6c660ead8a389b92e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:57:19,491 - lava_callback - INFO - Received callback for node 69ae9976c660ead8a389b957 INFO: 172.21.0.1:50300 - "POST /node/69ae9976c660ead8a389b957 HTTP/1.0" 202 Accepted 2026-03-11 09:57:19,500 - lava_callback - INFO - Starting async job submit for node 69ae9976c660ead8a389b957 2026-03-11 09:57:19,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:19,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9976c660ead8a389b957 HTTP/1.1" 200 None 2026-03-11 09:57:19,526 - lava_callback - DEBUG - Processing node 69ae9976c660ead8a389b957: baseline-arm64-baylibre 2026-03-11 09:57:19,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9976c660ead8a389b957 2026-03-11 09:57:19,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:19,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9976c660ead8a389b957 HTTP/1.1" 200 None 2026-03-11 09:57:19,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:19,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 09:57:19,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:19,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9976c660ead8a389b957 HTTP/1.1" 200 None 2026-03-11 09:57:19,614 - lava_callback - ERROR - Error processing callback for node 69ae9976c660ead8a389b957: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:57:30,368 - lava_callback - INFO - Received callback for node 69b13c6ba870a1dc3343c5c4 INFO: 172.21.0.1:54292 - "POST /node/69b13c6ba870a1dc3343c5c4 HTTP/1.0" 202 Accepted 2026-03-11 09:57:30,377 - lava_callback - INFO - Starting async job submit for node 69b13c6ba870a1dc3343c5c4 2026-03-11 09:57:30,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:30,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ba870a1dc3343c5c4 HTTP/1.1" 200 None 2026-03-11 09:57:30,416 - lava_callback - DEBUG - Processing node 69b13c6ba870a1dc3343c5c4: baseline-arm64 2026-03-11 09:57:30,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:30,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:30,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ba870a1dc3343c5c4/log.txt.gz 2026-03-11 09:57:30,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:31,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:31,058 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ba870a1dc3343c5c4/lava-logs.yaml 2026-03-11 09:57:31,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:31,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:31,205 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ba870a1dc3343c5c4/lava_callback.json.gz 2026-03-11 09:57:31,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:31,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ba870a1dc3343c5c4 HTTP/1.1" 200 None 2026-03-11 09:57:31,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:31,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:57:31,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:31,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c6ba870a1dc3343c5c4 HTTP/1.1" 200 None 2026-03-11 09:57:31,288 - lava_callback - INFO - Completed processing callback for node 69b13c6ba870a1dc3343c5c4 INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:57:49,970 - lava_callback - INFO - Received callback for node 69b13c88a870a1dc3343c617 INFO: 172.21.0.1:55124 - "POST /node/69b13c88a870a1dc3343c617 HTTP/1.0" 202 Accepted 2026-03-11 09:57:49,979 - lava_callback - INFO - Starting async job submit for node 69b13c88a870a1dc3343c617 2026-03-11 09:57:49,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:50,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c88a870a1dc3343c617 HTTP/1.1" 200 None 2026-03-11 09:57:50,022 - lava_callback - DEBUG - Processing node 69b13c88a870a1dc3343c617: baseline-nfs-arm64 2026-03-11 09:57:50,024 - lava_callback - WARNING - Failed to upload log 2026-03-11 09:57:50,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:50,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:50,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c88a870a1dc3343c617/lava-logs.yaml 2026-03-11 09:57:50,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:50,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:50,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c88a870a1dc3343c617/lava_callback.json.gz 2026-03-11 09:57:50,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:50,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c88a870a1dc3343c617 HTTP/1.1" 200 None 2026-03-11 09:57:50,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:50,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:57:50,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:50,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c88a870a1dc3343c617 HTTP/1.1" 200 None 2026-03-11 09:57:50,408 - lava_callback - INFO - Completed processing callback for node 69b13c88a870a1dc3343c617 2026-03-11 09:57:54,674 - lava_callback - INFO - Received callback for node 69b13c78a870a1dc3343c5ef INFO: 172.21.0.1:55130 - "POST /node/69b13c78a870a1dc3343c5ef HTTP/1.0" 202 Accepted 2026-03-11 09:57:54,681 - lava_callback - INFO - Starting async job submit for node 69b13c78a870a1dc3343c5ef 2026-03-11 09:57:54,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:54,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c78a870a1dc3343c5ef HTTP/1.1" 200 None 2026-03-11 09:57:54,741 - lava_callback - DEBUG - Processing node 69b13c78a870a1dc3343c5ef: baseline-arm64 2026-03-11 09:57:55,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:55,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:55,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:55,201 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c78a870a1dc3343c5ef/log.txt.gz 2026-03-11 09:57:55,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 09:57:55,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:55,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:55,538 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c78a870a1dc3343c5ef/lava-logs.yaml 2026-03-11 09:57:55,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:57:55,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:57:55,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c78a870a1dc3343c5ef/lava_callback.json.gz 2026-03-11 09:57:55,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:56,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c78a870a1dc3343c5ef HTTP/1.1" 200 None 2026-03-11 09:57:56,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:56,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:57:56,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:57:56,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c78a870a1dc3343c5ef HTTP/1.1" 200 None 2026-03-11 09:57:56,088 - lava_callback - INFO - Completed processing callback for node 69b13c78a870a1dc3343c5ef INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33914 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:58:10,405 - lava_callback - INFO - Received callback for node 69b138dda870a1dc3343c532 INFO: 172.21.0.1:41054 - "POST /node/69b138dda870a1dc3343c532 HTTP/1.0" 202 Accepted 2026-03-11 09:58:10,416 - lava_callback - INFO - Starting async job submit for node 69b138dda870a1dc3343c532 2026-03-11 09:58:10,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:10,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b138dda870a1dc3343c532 HTTP/1.1" 200 None 2026-03-11 09:58:10,494 - lava_callback - DEBUG - Processing node 69b138dda870a1dc3343c532: baseline-arm 2026-03-11 09:58:11,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:11,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:11,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69b138dda870a1dc3343c532/log.txt.gz 2026-03-11 09:58:11,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:12,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:12,149 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69b138dda870a1dc3343c532/lava-logs.yaml 2026-03-11 09:58:12,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:12,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:12,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69b138dda870a1dc3343c532/lava_callback.json.gz DEBUG: Setup failed for 69b138dda870a1dc3343c532. Transitting job node result: incomplete -> fail 2026-03-11 09:58:12,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:12,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b138dda870a1dc3343c532 HTTP/1.1" 200 None 2026-03-11 09:58:12,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:12,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 09:58:12,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:12,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b138dda870a1dc3343c532 HTTP/1.1" 200 None 2026-03-11 09:58:12,624 - lava_callback - INFO - Completed processing callback for node 69b138dda870a1dc3343c532 INFO: 172.21.0.1:41058 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 09:58:16,375 - lava_callback - INFO - Received callback for node 69b13c6ca870a1dc3343c5ca INFO: 172.21.0.1:41072 - "POST /node/69b13c6ca870a1dc3343c5ca HTTP/1.0" 202 Accepted 2026-03-11 09:58:16,383 - lava_callback - INFO - Starting async job submit for node 69b13c6ca870a1dc3343c5ca 2026-03-11 09:58:16,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:16,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ca870a1dc3343c5ca HTTP/1.1" 200 None 2026-03-11 09:58:16,423 - lava_callback - DEBUG - Processing node 69b13c6ca870a1dc3343c5ca: baseline-arm64 INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:58:16,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:16,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:16,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5ca/log.txt.gz 2026-03-11 09:58:17,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:17,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:17,373 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5ca/lava-logs.yaml 2026-03-11 09:58:17,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:17,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:17,545 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5ca/lava_callback.json.gz 2026-03-11 09:58:17,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:17,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ca870a1dc3343c5ca HTTP/1.1" 200 None 2026-03-11 09:58:17,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:17,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:58:17,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:17,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c6ca870a1dc3343c5ca HTTP/1.1" 200 None 2026-03-11 09:58:17,673 - lava_callback - INFO - Completed processing callback for node 69b13c6ca870a1dc3343c5ca 2026-03-11 09:58:25,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:25,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:58:41,062 - lava_callback - INFO - Received callback for node 69b13c6ca870a1dc3343c5c7 INFO: 172.21.0.1:36060 - "POST /node/69b13c6ca870a1dc3343c5c7 HTTP/1.0" 202 Accepted 2026-03-11 09:58:41,068 - lava_callback - INFO - Starting async job submit for node 69b13c6ca870a1dc3343c5c7 2026-03-11 09:58:41,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:41,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ca870a1dc3343c5c7 HTTP/1.1" 200 None 2026-03-11 09:58:41,107 - lava_callback - DEBUG - Processing node 69b13c6ca870a1dc3343c5c7: baseline-arm64 2026-03-11 09:58:41,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:41,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:41,468 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5c7/log.txt.gz 2026-03-11 09:58:41,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:41,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:41,825 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5c7/lava-logs.yaml 2026-03-11 09:58:41,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:58:42,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:58:42,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6ca870a1dc3343c5c7/lava_callback.json.gz 2026-03-11 09:58:42,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:42,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6ca870a1dc3343c5c7 HTTP/1.1" 200 None 2026-03-11 09:58:42,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:42,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:58:42,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:42,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c6ca870a1dc3343c5c7 HTTP/1.1" 200 None 2026-03-11 09:58:42,140 - lava_callback - INFO - Completed processing callback for node 69b13c6ca870a1dc3343c5c7 INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:58:55,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:58:55,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:13,240 - lava_callback - INFO - Received callback for node 69b13cb5a870a1dc3343c6bf INFO: 172.21.0.1:49888 - "POST /node/69b13cb5a870a1dc3343c6bf HTTP/1.0" 202 Accepted 2026-03-11 09:59:13,248 - lava_callback - INFO - Starting async job submit for node 69b13cb5a870a1dc3343c6bf 2026-03-11 09:59:13,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:13,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb5a870a1dc3343c6bf HTTP/1.1" 200 None 2026-03-11 09:59:13,291 - lava_callback - DEBUG - Processing node 69b13cb5a870a1dc3343c6bf: baseline-arm64-foundriesio 2026-03-11 09:59:13,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:13,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:13,675 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6bf/log.txt.gz 2026-03-11 09:59:13,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:14,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:14,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6bf/lava-logs.yaml 2026-03-11 09:59:14,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:14,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:14,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6bf/lava_callback.json.gz 2026-03-11 09:59:14,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:14,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb5a870a1dc3343c6bf HTTP/1.1" 200 None 2026-03-11 09:59:14,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:14,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:14,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:14,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cb5a870a1dc3343c6bf HTTP/1.1" 200 None 2026-03-11 09:59:14,283 - lava_callback - INFO - Completed processing callback for node 69b13cb5a870a1dc3343c6bf 2026-03-11 09:59:14,595 - lava_callback - INFO - Received callback for node 69b13c6fa870a1dc3343c5d0 INFO: 172.21.0.1:49894 - "POST /node/69b13c6fa870a1dc3343c5d0 HTTP/1.0" 202 Accepted 2026-03-11 09:59:14,632 - lava_callback - INFO - Starting async job submit for node 69b13c6fa870a1dc3343c5d0 2026-03-11 09:59:14,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:14,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6fa870a1dc3343c5d0 HTTP/1.1" 200 None 2026-03-11 09:59:14,678 - lava_callback - DEBUG - Processing node 69b13c6fa870a1dc3343c5d0: baseline-arm64 2026-03-11 09:59:14,810 - lava_callback - WARNING - Failed to upload log 2026-03-11 09:59:14,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:15,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:15,076 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6fa870a1dc3343c5d0/lava-logs.yaml 2026-03-11 09:59:15,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49900 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 09:59:15,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:15,211 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6fa870a1dc3343c5d0/lava_callback.json.gz 2026-03-11 09:59:15,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:15,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6fa870a1dc3343c5d0 HTTP/1.1" 200 None 2026-03-11 09:59:15,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:15,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:15,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:15,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c6fa870a1dc3343c5d0 HTTP/1.1" 200 None 2026-03-11 09:59:15,379 - lava_callback - INFO - Completed processing callback for node 69b13c6fa870a1dc3343c5d0 2026-03-11 09:59:15,951 - lava_callback - INFO - Received callback for node 69b13c70a870a1dc3343c5dd INFO: 172.21.0.1:49902 - "POST /node/69b13c70a870a1dc3343c5dd HTTP/1.0" 202 Accepted 2026-03-11 09:59:15,958 - lava_callback - INFO - Starting async job submit for node 69b13c70a870a1dc3343c5dd 2026-03-11 09:59:15,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:16,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c70a870a1dc3343c5dd HTTP/1.1" 200 None 2026-03-11 09:59:16,003 - lava_callback - DEBUG - Processing node 69b13c70a870a1dc3343c5dd: baseline-arm64 2026-03-11 09:59:16,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:16,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:16,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c70a870a1dc3343c5dd/log.txt.gz 2026-03-11 09:59:16,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:16,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:16,568 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c70a870a1dc3343c5dd/lava-logs.yaml 2026-03-11 09:59:16,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:16,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:16,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c70a870a1dc3343c5dd/lava_callback.json.gz 2026-03-11 09:59:16,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:16,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c70a870a1dc3343c5dd HTTP/1.1" 200 None 2026-03-11 09:59:16,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:16,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:16,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:16,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c70a870a1dc3343c5dd HTTP/1.1" 200 None 2026-03-11 09:59:16,836 - lava_callback - INFO - Completed processing callback for node 69b13c70a870a1dc3343c5dd 2026-03-11 09:59:18,699 - lava_callback - INFO - Received callback for node 69b13c74a870a1dc3343c5e6 INFO: 172.21.0.1:49912 - "POST /node/69b13c74a870a1dc3343c5e6 HTTP/1.0" 202 Accepted 2026-03-11 09:59:18,705 - lava_callback - INFO - Starting async job submit for node 69b13c74a870a1dc3343c5e6 2026-03-11 09:59:18,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:18,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c74a870a1dc3343c5e6 HTTP/1.1" 200 None 2026-03-11 09:59:18,741 - lava_callback - DEBUG - Processing node 69b13c74a870a1dc3343c5e6: baseline-arm64 2026-03-11 09:59:19,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:19,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:19,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c74a870a1dc3343c5e6/log.txt.gz 2026-03-11 09:59:19,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:19,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:19,664 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c74a870a1dc3343c5e6/lava-logs.yaml 2026-03-11 09:59:19,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:19,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:19,827 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c74a870a1dc3343c5e6/lava_callback.json.gz 2026-03-11 09:59:19,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:19,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c74a870a1dc3343c5e6 HTTP/1.1" 200 None 2026-03-11 09:59:19,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:19,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:19,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:19,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c74a870a1dc3343c5e6 HTTP/1.1" 200 None 2026-03-11 09:59:19,905 - lava_callback - INFO - Completed processing callback for node 69b13c74a870a1dc3343c5e6 2026-03-11 09:59:21,631 - lava_callback - INFO - Received callback for node 69b13c99a870a1dc3343c654 INFO: 172.21.0.1:56696 - "POST /node/69b13c99a870a1dc3343c654 HTTP/1.0" 202 Accepted 2026-03-11 09:59:21,640 - lava_callback - INFO - Starting async job submit for node 69b13c99a870a1dc3343c654 2026-03-11 09:59:21,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:21,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c99a870a1dc3343c654 HTTP/1.1" 200 None 2026-03-11 09:59:21,678 - lava_callback - DEBUG - Processing node 69b13c99a870a1dc3343c654: baseline-arm64-broonie 2026-03-11 09:59:21,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:22,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:22,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c99a870a1dc3343c654/log.txt.gz 2026-03-11 09:59:22,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:22,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:22,341 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c99a870a1dc3343c654/lava-logs.yaml 2026-03-11 09:59:22,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:22,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:22,477 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c99a870a1dc3343c654/lava_callback.json.gz 2026-03-11 09:59:22,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:22,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c99a870a1dc3343c654 HTTP/1.1" 200 None 2026-03-11 09:59:22,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:22,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:22,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:22,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c99a870a1dc3343c654 HTTP/1.1" 200 None 2026-03-11 09:59:22,557 - lava_callback - INFO - Completed processing callback for node 69b13c99a870a1dc3343c654 2026-03-11 09:59:24,086 - lava_callback - INFO - Received callback for node 69b13c75a870a1dc3343c5e9 INFO: 172.21.0.1:56710 - "POST /node/69b13c75a870a1dc3343c5e9 HTTP/1.0" 202 Accepted 2026-03-11 09:59:24,092 - lava_callback - INFO - Starting async job submit for node 69b13c75a870a1dc3343c5e9 2026-03-11 09:59:24,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:24,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c75a870a1dc3343c5e9 HTTP/1.1" 200 None 2026-03-11 09:59:24,128 - lava_callback - DEBUG - Processing node 69b13c75a870a1dc3343c5e9: baseline-arm64 2026-03-11 09:59:24,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:24,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:24,601 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c75a870a1dc3343c5e9/log.txt.gz 2026-03-11 09:59:24,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:25,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:25,036 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c75a870a1dc3343c5e9/lava-logs.yaml 2026-03-11 09:59:25,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:25,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:25,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c75a870a1dc3343c5e9/lava_callback.json.gz 2026-03-11 09:59:25,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:25,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c75a870a1dc3343c5e9 HTTP/1.1" 200 None 2026-03-11 09:59:25,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:25,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:25,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:25,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c75a870a1dc3343c5e9 HTTP/1.1" 200 None 2026-03-11 09:59:25,272 - lava_callback - INFO - Completed processing callback for node 69b13c75a870a1dc3343c5e9 2026-03-11 09:59:25,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:25,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:56712 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:31,065 - lava_callback - INFO - Received callback for node 69b13ceba870a1dc3343c6e8 INFO: 172.21.0.1:44682 - "POST /node/69b13ceba870a1dc3343c6e8 HTTP/1.0" 202 Accepted 2026-03-11 09:59:31,070 - lava_callback - INFO - Starting async job submit for node 69b13ceba870a1dc3343c6e8 2026-03-11 09:59:31,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:31,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ceba870a1dc3343c6e8 HTTP/1.1" 200 None 2026-03-11 09:59:31,088 - lava_callback - DEBUG - Processing node 69b13ceba870a1dc3343c6e8: baseline-nfs-arm64 2026-03-11 09:59:31,089 - lava_callback - WARNING - Failed to upload log 2026-03-11 09:59:31,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:31,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:31,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13ceba870a1dc3343c6e8/lava-logs.yaml 2026-03-11 09:59:31,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:31,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:31,332 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13ceba870a1dc3343c6e8/lava_callback.json.gz 2026-03-11 09:59:31,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:31,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ceba870a1dc3343c6e8 HTTP/1.1" 200 None 2026-03-11 09:59:31,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:31,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:31,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:31,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ceba870a1dc3343c6e8 HTTP/1.1" 200 None 2026-03-11 09:59:31,413 - lava_callback - INFO - Completed processing callback for node 69b13ceba870a1dc3343c6e8 INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:40,754 - lava_callback - INFO - Received callback for node 69b13cb3a870a1dc3343c6b8 INFO: 172.21.0.1:34522 - "POST /node/69b13cb3a870a1dc3343c6b8 HTTP/1.0" 202 Accepted 2026-03-11 09:59:40,760 - lava_callback - INFO - Starting async job submit for node 69b13cb3a870a1dc3343c6b8 2026-03-11 09:59:40,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:40,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb3a870a1dc3343c6b8 HTTP/1.1" 200 None 2026-03-11 09:59:40,796 - lava_callback - DEBUG - Processing node 69b13cb3a870a1dc3343c6b8: baseline-arm64-pengutronix 2026-03-11 09:59:40,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:41,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:41,135 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb3a870a1dc3343c6b8/log.txt.gz 2026-03-11 09:59:41,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:41,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:41,467 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb3a870a1dc3343c6b8/lava-logs.yaml 2026-03-11 09:59:41,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:41,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:41,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb3a870a1dc3343c6b8/lava_callback.json.gz 2026-03-11 09:59:41,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:41,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb3a870a1dc3343c6b8 HTTP/1.1" 200 None 2026-03-11 09:59:41,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:41,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:41,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:41,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cb3a870a1dc3343c6b8 HTTP/1.1" 200 None 2026-03-11 09:59:41,719 - lava_callback - INFO - Completed processing callback for node 69b13cb3a870a1dc3343c6b8 2026-03-11 09:59:45,702 - lava_callback - INFO - Received callback for node 69b13c7da870a1dc3343c5fb INFO: 172.21.0.1:34532 - "POST /node/69b13c7da870a1dc3343c5fb HTTP/1.0" 202 Accepted 2026-03-11 09:59:45,708 - lava_callback - INFO - Starting async job submit for node 69b13c7da870a1dc3343c5fb 2026-03-11 09:59:45,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:45,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7da870a1dc3343c5fb HTTP/1.1" 200 None 2026-03-11 09:59:45,744 - lava_callback - DEBUG - Processing node 69b13c7da870a1dc3343c5fb: baseline-arm64 2026-03-11 09:59:45,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:46,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:46,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7da870a1dc3343c5fb/log.txt.gz 2026-03-11 09:59:46,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:46,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:46,445 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7da870a1dc3343c5fb/lava-logs.yaml 2026-03-11 09:59:46,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34548 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:46,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:46,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7da870a1dc3343c5fb/lava_callback.json.gz 2026-03-11 09:59:46,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:46,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7da870a1dc3343c5fb HTTP/1.1" 200 None 2026-03-11 09:59:46,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:46,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:46,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:46,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c7da870a1dc3343c5fb HTTP/1.1" 200 None 2026-03-11 09:59:46,664 - lava_callback - INFO - Completed processing callback for node 69b13c7da870a1dc3343c5fb 2026-03-11 09:59:51,570 - lava_callback - INFO - Received callback for node 69b13c86a870a1dc3343c611 INFO: 172.21.0.1:38684 - "POST /node/69b13c86a870a1dc3343c611 HTTP/1.0" 202 Accepted 2026-03-11 09:59:51,577 - lava_callback - INFO - Starting async job submit for node 69b13c86a870a1dc3343c611 2026-03-11 09:59:51,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:51,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c86a870a1dc3343c611 HTTP/1.1" 200 None 2026-03-11 09:59:51,630 - lava_callback - DEBUG - Processing node 69b13c86a870a1dc3343c611: baseline-nfs-arm64 2026-03-11 09:59:52,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:52,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:52,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c86a870a1dc3343c611/log.txt.gz 2026-03-11 09:59:52,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:52,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:52,645 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c86a870a1dc3343c611/lava-logs.yaml 2026-03-11 09:59:52,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:52,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:52,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c86a870a1dc3343c611/lava_callback.json.gz 2026-03-11 09:59:52,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:52,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c86a870a1dc3343c611 HTTP/1.1" 200 None 2026-03-11 09:59:52,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:52,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:52,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:52,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c86a870a1dc3343c611 HTTP/1.1" 200 None 2026-03-11 09:59:52,889 - lava_callback - INFO - Completed processing callback for node 69b13c86a870a1dc3343c611 2026-03-11 09:59:54,906 - lava_callback - INFO - Received callback for node 69b13c7ea870a1dc3343c5fe INFO: 172.21.0.1:38686 - "POST /node/69b13c7ea870a1dc3343c5fe HTTP/1.0" 202 Accepted 2026-03-11 09:59:54,912 - lava_callback - INFO - Starting async job submit for node 69b13c7ea870a1dc3343c5fe 2026-03-11 09:59:54,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:54,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7ea870a1dc3343c5fe HTTP/1.1" 200 None 2026-03-11 09:59:54,952 - lava_callback - DEBUG - Processing node 69b13c7ea870a1dc3343c5fe: baseline-arm64 2026-03-11 09:59:55,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:55,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:55,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-11 09:59:55,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:55,384 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ea870a1dc3343c5fe/log.txt.gz 2026-03-11 09:59:55,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:55,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:55,798 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ea870a1dc3343c5fe/lava-logs.yaml 2026-03-11 09:59:55,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:55,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:55,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ea870a1dc3343c5fe/lava_callback.json.gz 2026-03-11 09:59:55,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:55,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7ea870a1dc3343c5fe HTTP/1.1" 200 None 2026-03-11 09:59:55,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:55,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:55,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:56,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c7ea870a1dc3343c5fe HTTP/1.1" 200 None 2026-03-11 09:59:56,020 - lava_callback - INFO - Completed processing callback for node 69b13c7ea870a1dc3343c5fe INFO: 172.21.0.1:38692 - "GET / HTTP/1.0" 200 OK 2026-03-11 09:59:56,669 - lava_callback - INFO - Received callback for node 69b13c87a870a1dc3343c614 INFO: 172.21.0.1:38702 - "POST /node/69b13c87a870a1dc3343c614 HTTP/1.0" 202 Accepted 2026-03-11 09:59:56,676 - lava_callback - INFO - Starting async job submit for node 69b13c87a870a1dc3343c614 2026-03-11 09:59:56,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:56,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c87a870a1dc3343c614 HTTP/1.1" 200 None 2026-03-11 09:59:56,715 - lava_callback - DEBUG - Processing node 69b13c87a870a1dc3343c614: baseline-nfs-arm64 2026-03-11 09:59:57,199 - lava_callback - INFO - Received callback for node 69b13c73a870a1dc3343c5e3 INFO: 172.21.0.1:38708 - "POST /node/69b13c73a870a1dc3343c5e3 HTTP/1.0" 202 Accepted 2026-03-11 09:59:57,205 - lava_callback - INFO - Starting async job submit for node 69b13c73a870a1dc3343c5e3 2026-03-11 09:59:57,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:57,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:57,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c73a870a1dc3343c5e3 HTTP/1.1" 200 None 2026-03-11 09:59:57,244 - lava_callback - DEBUG - Processing node 69b13c73a870a1dc3343c5e3: baseline-arm64 2026-03-11 09:59:57,299 - lava_callback - INFO - Received callback for node 69b13cb1a870a1dc3343c6b2 2026-03-11 09:59:57,315 - lava_callback - INFO - Starting async job submit for node 69b13cb1a870a1dc3343c6b2 INFO: 172.21.0.1:38716 - "POST /node/69b13cb1a870a1dc3343c6b2 HTTP/1.0" 202 Accepted 2026-03-11 09:59:57,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:57,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:57,446 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c87a870a1dc3343c614/log.txt.gz 2026-03-11 09:59:57,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb1a870a1dc3343c6b2 HTTP/1.1" 200 None 2026-03-11 09:59:57,495 - lava_callback - DEBUG - Processing node 69b13cb1a870a1dc3343c6b2: baseline-arm64-pengutronix 2026-03-11 09:59:57,510 - lava_callback - INFO - Received callback for node 69b13900a870a1dc3343c547 2026-03-11 09:59:57,538 - lava_callback - INFO - Starting async job submit for node 69b13900a870a1dc3343c547 INFO: 172.21.0.1:38732 - "POST /node/69b13900a870a1dc3343c547 HTTP/1.0" 202 Accepted 2026-03-11 09:59:57,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:58,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13900a870a1dc3343c547 HTTP/1.1" 200 None 2026-03-11 09:59:58,138 - lava_callback - DEBUG - Processing node 69b13900a870a1dc3343c547: ltp-smoke 2026-03-11 09:59:58,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:58,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:58,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb1a870a1dc3343c6b2/log.txt.gz 2026-03-11 09:59:58,535 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c73a870a1dc3343c5e3/log.txt.gz 2026-03-11 09:59:58,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:58,801 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c87a870a1dc3343c614/lava-logs.yaml 2026-03-11 09:59:58,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:58,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:59,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb1a870a1dc3343c6b2/lava-logs.yaml 2026-03-11 09:59:59,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:59,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,202 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69b13900a870a1dc3343c547/log.txt.gz 2026-03-11 09:59:59,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c73a870a1dc3343c5e3/lava-logs.yaml 2026-03-11 09:59:59,319 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c87a870a1dc3343c614/lava_callback.json.gz 2026-03-11 09:59:59,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,422 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb1a870a1dc3343c6b2/lava_callback.json.gz 2026-03-11 09:59:59,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:59,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c87a870a1dc3343c614 HTTP/1.1" 200 None 2026-03-11 09:59:59,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb1a870a1dc3343c6b2 HTTP/1.1" 200 None 2026-03-11 09:59:59,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:59,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 09:59:59,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:59,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c87a870a1dc3343c614 HTTP/1.1" 200 None 2026-03-11 09:59:59,667 - lava_callback - INFO - Completed processing callback for node 69b13c87a870a1dc3343c614 2026-03-11 09:59:59,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cb1a870a1dc3343c6b2 HTTP/1.1" 200 None 2026-03-11 09:59:59,730 - lava_callback - INFO - Completed processing callback for node 69b13cb1a870a1dc3343c6b2 2026-03-11 09:59:59,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c73a870a1dc3343c5e3/lava_callback.json.gz 2026-03-11 09:59:59,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c73a870a1dc3343c5e3 HTTP/1.1" 200 None 2026-03-11 09:59:59,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 09:59:59,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 09:59:59,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c73a870a1dc3343c5e3 HTTP/1.1" 200 None 2026-03-11 09:59:59,902 - lava_callback - INFO - Completed processing callback for node 69b13c73a870a1dc3343c5e3 2026-03-11 09:59:59,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 09:59:59,951 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69b13900a870a1dc3343c547/lava-logs.yaml 2026-03-11 09:59:59,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:00,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:00,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69b13900a870a1dc3343c547/lava_callback.json.gz 2026-03-11 10:00:00,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:00,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13900a870a1dc3343c547 HTTP/1.1" 200 None 2026-03-11 10:00:00,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:00,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12599a870a1dc3343ba8b HTTP/1.1" 200 None 2026-03-11 10:00:00,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:00,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13900a870a1dc3343c547 HTTP/1.1" 200 None 2026-03-11 10:00:00,524 - lava_callback - INFO - Completed processing callback for node 69b13900a870a1dc3343c547 2026-03-11 10:00:00,828 - lava_callback - INFO - Received callback for node 69b13ca7a870a1dc3343c67d INFO: 172.21.0.1:51016 - "POST /node/69b13ca7a870a1dc3343c67d HTTP/1.0" 202 Accepted 2026-03-11 10:00:00,834 - lava_callback - INFO - Starting async job submit for node 69b13ca7a870a1dc3343c67d 2026-03-11 10:00:00,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:00,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca7a870a1dc3343c67d HTTP/1.1" 200 None 2026-03-11 10:00:00,888 - lava_callback - DEBUG - Processing node 69b13ca7a870a1dc3343c67d: baseline-arm64-broonie 2026-03-11 10:00:01,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:01,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:01,235 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca7a870a1dc3343c67d/log.txt.gz 2026-03-11 10:00:01,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:01,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:01,581 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca7a870a1dc3343c67d/lava-logs.yaml 2026-03-11 10:00:01,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:01,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:01,740 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca7a870a1dc3343c67d/lava_callback.json.gz 2026-03-11 10:00:01,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:01,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca7a870a1dc3343c67d HTTP/1.1" 200 None 2026-03-11 10:00:01,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:01,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:01,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:01,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca7a870a1dc3343c67d HTTP/1.1" 200 None 2026-03-11 10:00:01,835 - lava_callback - INFO - Completed processing callback for node 69b13ca7a870a1dc3343c67d 2026-03-11 10:00:02,297 - lava_callback - INFO - Received callback for node 69b13ca3a870a1dc3343c671 INFO: 172.21.0.1:51026 - "POST /node/69b13ca3a870a1dc3343c671 HTTP/1.0" 202 Accepted 2026-03-11 10:00:02,303 - lava_callback - INFO - Starting async job submit for node 69b13ca3a870a1dc3343c671 2026-03-11 10:00:02,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:02,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca3a870a1dc3343c671 HTTP/1.1" 200 None 2026-03-11 10:00:02,349 - lava_callback - DEBUG - Processing node 69b13ca3a870a1dc3343c671: baseline-arm64-broonie 2026-03-11 10:00:02,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:02,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:02,749 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca3a870a1dc3343c671/log.txt.gz 2026-03-11 10:00:02,857 - lava_callback - INFO - Received callback for node 69b13cada870a1dc3343c6a9 INFO: 172.21.0.1:51042 - "POST /node/69b13cada870a1dc3343c6a9 HTTP/1.0" 202 Accepted 2026-03-11 10:00:02,881 - lava_callback - INFO - Starting async job submit for node 69b13cada870a1dc3343c6a9 2026-03-11 10:00:02,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:02,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:02,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cada870a1dc3343c6a9 HTTP/1.1" 200 None 2026-03-11 10:00:02,956 - lava_callback - DEBUG - Processing node 69b13cada870a1dc3343c6a9: baseline-arm64-clabbe 2026-03-11 10:00:03,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:03,215 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca3a870a1dc3343c671/lava-logs.yaml 2026-03-11 10:00:03,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:03,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:03,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:03,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:03,440 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca3a870a1dc3343c671/lava_callback.json.gz 2026-03-11 10:00:03,460 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b13cada870a1dc3343c6a9/log.txt.gz 2026-03-11 10:00:03,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:03,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca3a870a1dc3343c671 HTTP/1.1" 200 None 2026-03-11 10:00:03,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:03,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:03,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:03,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:03,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca3a870a1dc3343c671 HTTP/1.1" 200 None 2026-03-11 10:00:03,664 - lava_callback - INFO - Completed processing callback for node 69b13ca3a870a1dc3343c671 2026-03-11 10:00:03,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:03,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b13cada870a1dc3343c6a9/lava-logs.yaml 2026-03-11 10:00:03,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:04,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:04,006 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69b13cada870a1dc3343c6a9/lava_callback.json.gz 2026-03-11 10:00:04,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:04,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cada870a1dc3343c6a9 HTTP/1.1" 200 None 2026-03-11 10:00:04,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:04,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:04,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:04,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cada870a1dc3343c6a9 HTTP/1.1" 200 None 2026-03-11 10:00:04,096 - lava_callback - INFO - Completed processing callback for node 69b13cada870a1dc3343c6a9 2026-03-11 10:00:05,498 - lava_callback - INFO - Received callback for node 69b13c7ca870a1dc3343c5f8 INFO: 172.21.0.1:51058 - "POST /node/69b13c7ca870a1dc3343c5f8 HTTP/1.0" 202 Accepted 2026-03-11 10:00:05,504 - lava_callback - INFO - Starting async job submit for node 69b13c7ca870a1dc3343c5f8 2026-03-11 10:00:05,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:05,529 - lava_callback - INFO - Received callback for node 69b13cb2a870a1dc3343c6b5 INFO: 172.21.0.1:51064 - "POST /node/69b13cb2a870a1dc3343c6b5 HTTP/1.0" 202 Accepted 2026-03-11 10:00:05,535 - lava_callback - INFO - Starting async job submit for node 69b13cb2a870a1dc3343c6b5 2026-03-11 10:00:05,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:05,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb2a870a1dc3343c6b5 HTTP/1.1" 200 None 2026-03-11 10:00:05,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7ca870a1dc3343c5f8 HTTP/1.1" 200 None 2026-03-11 10:00:05,573 - lava_callback - DEBUG - Processing node 69b13cb2a870a1dc3343c6b5: baseline-arm64-pengutronix 2026-03-11 10:00:05,580 - lava_callback - DEBUG - Processing node 69b13c7ca870a1dc3343c5f8: baseline-arm64 2026-03-11 10:00:06,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:06,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:06,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:06,313 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ca870a1dc3343c5f8/log.txt.gz 2026-03-11 10:00:06,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:06,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb2a870a1dc3343c6b5/log.txt.gz INFO: 172.21.0.1:51072 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:06,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:06,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:06,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:06,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb2a870a1dc3343c6b5/lava-logs.yaml 2026-03-11 10:00:06,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:06,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:06,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ca870a1dc3343c5f8/lava-logs.yaml 2026-03-11 10:00:06,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:07,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:07,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69b13cb2a870a1dc3343c6b5/lava_callback.json.gz 2026-03-11 10:00:07,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb2a870a1dc3343c6b5 HTTP/1.1" 200 None 2026-03-11 10:00:07,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:07,088 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7ca870a1dc3343c5f8/lava_callback.json.gz 2026-03-11 10:00:07,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:07,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7ca870a1dc3343c5f8 HTTP/1.1" 200 None 2026-03-11 10:00:07,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cb2a870a1dc3343c6b5 HTTP/1.1" 200 None 2026-03-11 10:00:07,146 - lava_callback - INFO - Completed processing callback for node 69b13cb2a870a1dc3343c6b5 2026-03-11 10:00:07,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:07,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:07,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c7ca870a1dc3343c5f8 HTTP/1.1" 200 None 2026-03-11 10:00:07,221 - lava_callback - INFO - Completed processing callback for node 69b13c7ca870a1dc3343c5f8 INFO: 172.21.0.1:40900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:18,264 - lava_callback - INFO - Received callback for node 69b13ca1a870a1dc3343c668 INFO: 172.21.0.1:40916 - "POST /node/69b13ca1a870a1dc3343c668 HTTP/1.0" 202 Accepted 2026-03-11 10:00:18,269 - lava_callback - INFO - Starting async job submit for node 69b13ca1a870a1dc3343c668 2026-03-11 10:00:18,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:18,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca1a870a1dc3343c668 HTTP/1.1" 200 None 2026-03-11 10:00:18,331 - lava_callback - DEBUG - Processing node 69b13ca1a870a1dc3343c668: baseline-arm64-broonie 2026-03-11 10:00:18,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:18,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:18,713 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca1a870a1dc3343c668/log.txt.gz 2026-03-11 10:00:18,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:19,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:19,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca1a870a1dc3343c668/lava-logs.yaml 2026-03-11 10:00:19,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:19,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:19,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca1a870a1dc3343c668/lava_callback.json.gz 2026-03-11 10:00:19,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:19,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca1a870a1dc3343c668 HTTP/1.1" 200 None 2026-03-11 10:00:19,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:19,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:19,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:19,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca1a870a1dc3343c668 HTTP/1.1" 200 None 2026-03-11 10:00:19,332 - lava_callback - INFO - Completed processing callback for node 69b13ca1a870a1dc3343c668 2026-03-11 10:00:21,808 - lava_callback - INFO - Received callback for node 69b13c84a870a1dc3343c60b INFO: 172.21.0.1:58728 - "POST /node/69b13c84a870a1dc3343c60b HTTP/1.0" 202 Accepted 2026-03-11 10:00:21,815 - lava_callback - INFO - Starting async job submit for node 69b13c84a870a1dc3343c60b 2026-03-11 10:00:21,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:21,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c84a870a1dc3343c60b HTTP/1.1" 200 None 2026-03-11 10:00:21,853 - lava_callback - DEBUG - Processing node 69b13c84a870a1dc3343c60b: baseline-nfs-arm64 2026-03-11 10:00:22,096 - lava_callback - INFO - Received callback for node 69b13c8ca870a1dc3343c624 INFO: 172.21.0.1:58732 - "POST /node/69b13c8ca870a1dc3343c624 HTTP/1.0" 202 Accepted 2026-03-11 10:00:22,118 - lava_callback - INFO - Starting async job submit for node 69b13c8ca870a1dc3343c624 2026-03-11 10:00:22,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:22,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:22,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ca870a1dc3343c624 HTTP/1.1" 200 None 2026-03-11 10:00:22,243 - lava_callback - DEBUG - Processing node 69b13c8ca870a1dc3343c624: baseline-nfs-arm64 2026-03-11 10:00:22,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:22,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c84a870a1dc3343c60b/log.txt.gz 2026-03-11 10:00:22,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:22,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:22,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:22,909 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ca870a1dc3343c624/log.txt.gz 2026-03-11 10:00:23,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:23,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c84a870a1dc3343c60b/lava-logs.yaml 2026-03-11 10:00:23,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:23,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:23,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:23,335 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c84a870a1dc3343c60b/lava_callback.json.gz 2026-03-11 10:00:23,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:23,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,362 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ca870a1dc3343c624/lava-logs.yaml 2026-03-11 10:00:23,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:23,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c84a870a1dc3343c60b HTTP/1.1" 200 None 2026-03-11 10:00:23,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:23,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c84a870a1dc3343c60b HTTP/1.1" 200 None 2026-03-11 10:00:23,428 - lava_callback - INFO - Completed processing callback for node 69b13c84a870a1dc3343c60b 2026-03-11 10:00:23,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:23,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ca870a1dc3343c624/lava_callback.json.gz 2026-03-11 10:00:23,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ca870a1dc3343c624 HTTP/1.1" 200 None 2026-03-11 10:00:23,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:23,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:23,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c8ca870a1dc3343c624 HTTP/1.1" 200 None 2026-03-11 10:00:23,712 - lava_callback - INFO - Completed processing callback for node 69b13c8ca870a1dc3343c624 2026-03-11 10:00:25,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:25,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-11 10:00:25,629 - lava_callback - INFO - Received callback for node 69b13c77a870a1dc3343c5ec INFO: 172.21.0.1:58738 - "POST /node/69b13c77a870a1dc3343c5ec HTTP/1.0" 202 Accepted 2026-03-11 10:00:25,636 - lava_callback - INFO - Starting async job submit for node 69b13c77a870a1dc3343c5ec 2026-03-11 10:00:25,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:25,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c77a870a1dc3343c5ec HTTP/1.1" 200 None 2026-03-11 10:00:25,679 - lava_callback - DEBUG - Processing node 69b13c77a870a1dc3343c5ec: baseline-arm64 2026-03-11 10:00:26,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:26,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:26,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c77a870a1dc3343c5ec/log.txt.gz INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:26,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:26,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:26,708 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c77a870a1dc3343c5ec/lava-logs.yaml 2026-03-11 10:00:26,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:26,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:26,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c77a870a1dc3343c5ec/lava_callback.json.gz 2026-03-11 10:00:26,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:26,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c77a870a1dc3343c5ec HTTP/1.1" 200 None 2026-03-11 10:00:26,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:26,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:26,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:27,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c77a870a1dc3343c5ec HTTP/1.1" 200 None 2026-03-11 10:00:27,056 - lava_callback - INFO - Completed processing callback for node 69b13c77a870a1dc3343c5ec INFO: 172.21.0.1:38694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:36,647 - lava_callback - INFO - Received callback for node 69b13c7aa870a1dc3343c5f5 INFO: 172.21.0.1:38712 - "POST /node/69b13c7aa870a1dc3343c5f5 HTTP/1.0" 202 Accepted 2026-03-11 10:00:36,653 - lava_callback - INFO - Starting async job submit for node 69b13c7aa870a1dc3343c5f5 2026-03-11 10:00:36,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:36,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7aa870a1dc3343c5f5 HTTP/1.1" 200 None 2026-03-11 10:00:36,688 - lava_callback - DEBUG - Processing node 69b13c7aa870a1dc3343c5f5: baseline-arm64 2026-03-11 10:00:36,724 - lava_callback - INFO - Received callback for node 69b13c9ba870a1dc3343c657 INFO: 172.21.0.1:38728 - "POST /node/69b13c9ba870a1dc3343c657 HTTP/1.0" 202 Accepted 2026-03-11 10:00:36,750 - lava_callback - INFO - Starting async job submit for node 69b13c9ba870a1dc3343c657 2026-03-11 10:00:36,823 - lava_callback - INFO - Received callback for node 69b13c8fa870a1dc3343c644 2026-03-11 10:00:36,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:38740 - "POST /node/69b13c8fa870a1dc3343c644 HTTP/1.0" 202 Accepted 2026-03-11 10:00:36,863 - lava_callback - INFO - Starting async job submit for node 69b13c8fa870a1dc3343c644 2026-03-11 10:00:36,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:36,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9ba870a1dc3343c657 HTTP/1.1" 200 None 2026-03-11 10:00:36,940 - lava_callback - DEBUG - Processing node 69b13c9ba870a1dc3343c657: baseline-arm64-broonie 2026-03-11 10:00:37,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:37,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8fa870a1dc3343c644 HTTP/1.1" 200 None 2026-03-11 10:00:37,564 - lava_callback - DEBUG - Processing node 69b13c8fa870a1dc3343c644: baseline-nfs-arm64 2026-03-11 10:00:37,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:37,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:38,016 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ba870a1dc3343c657/log.txt.gz 2026-03-11 10:00:38,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:38,257 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7aa870a1dc3343c5f5/log.txt.gz 2026-03-11 10:00:38,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:38,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:38,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:38,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8fa870a1dc3343c644/log.txt.gz 2026-03-11 10:00:38,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:38,783 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ba870a1dc3343c657/lava-logs.yaml 2026-03-11 10:00:38,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:38,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:38,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:39,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:39,107 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ba870a1dc3343c657/lava_callback.json.gz 2026-03-11 10:00:39,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:39,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,139 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7aa870a1dc3343c5f5/lava-logs.yaml 2026-03-11 10:00:39,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:39,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9ba870a1dc3343c657 HTTP/1.1" 200 None 2026-03-11 10:00:39,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:39,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c9ba870a1dc3343c657 HTTP/1.1" 200 None 2026-03-11 10:00:39,204 - lava_callback - INFO - Completed processing callback for node 69b13c9ba870a1dc3343c657 2026-03-11 10:00:39,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:39,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8fa870a1dc3343c644/lava-logs.yaml 2026-03-11 10:00:39,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:39,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:39,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c7aa870a1dc3343c5f5/lava_callback.json.gz 2026-03-11 10:00:39,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c7aa870a1dc3343c5f5 HTTP/1.1" 200 None 2026-03-11 10:00:39,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:39,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c7aa870a1dc3343c5f5 HTTP/1.1" 200 None 2026-03-11 10:00:39,529 - lava_callback - INFO - Completed processing callback for node 69b13c7aa870a1dc3343c5f5 2026-03-11 10:00:39,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:39,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8fa870a1dc3343c644/lava_callback.json.gz 2026-03-11 10:00:39,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8fa870a1dc3343c644 HTTP/1.1" 200 None 2026-03-11 10:00:39,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:39,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:39,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c8fa870a1dc3343c644 HTTP/1.1" 200 None 2026-03-11 10:00:39,726 - lava_callback - INFO - Completed processing callback for node 69b13c8fa870a1dc3343c644 INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:55,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:55,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:45060 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:00:58,079 - lava_callback - INFO - Received callback for node 69b13c8ea870a1dc3343c641 INFO: 172.21.0.1:45076 - "POST /node/69b13c8ea870a1dc3343c641 HTTP/1.0" 202 Accepted 2026-03-11 10:00:58,085 - lava_callback - INFO - Starting async job submit for node 69b13c8ea870a1dc3343c641 2026-03-11 10:00:58,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:58,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ea870a1dc3343c641 HTTP/1.1" 200 None 2026-03-11 10:00:58,130 - lava_callback - DEBUG - Processing node 69b13c8ea870a1dc3343c641: baseline-nfs-arm64 2026-03-11 10:00:58,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:58,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:58,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ea870a1dc3343c641/log.txt.gz 2026-03-11 10:00:58,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:59,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:59,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ea870a1dc3343c641/lava-logs.yaml 2026-03-11 10:00:59,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:00:59,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:00:59,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ea870a1dc3343c641/lava_callback.json.gz 2026-03-11 10:00:59,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:59,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ea870a1dc3343c641 HTTP/1.1" 200 None 2026-03-11 10:00:59,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:59,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:00:59,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:00:59,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c8ea870a1dc3343c641 HTTP/1.1" 200 None 2026-03-11 10:00:59,273 - lava_callback - INFO - Completed processing callback for node 69b13c8ea870a1dc3343c641 INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51132 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:01:21,985 - lava_callback - INFO - Received callback for node 69b13c9da870a1dc3343c65d INFO: 172.21.0.1:32976 - "POST /node/69b13c9da870a1dc3343c65d HTTP/1.0" 202 Accepted 2026-03-11 10:01:21,991 - lava_callback - INFO - Starting async job submit for node 69b13c9da870a1dc3343c65d 2026-03-11 10:01:22,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:22,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9da870a1dc3343c65d HTTP/1.1" 200 None 2026-03-11 10:01:22,028 - lava_callback - DEBUG - Processing node 69b13c9da870a1dc3343c65d: baseline-arm64-broonie 2026-03-11 10:01:22,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:22,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:22,445 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9da870a1dc3343c65d/log.txt.gz 2026-03-11 10:01:22,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:22,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:22,831 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9da870a1dc3343c65d/lava-logs.yaml 2026-03-11 10:01:22,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:22,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:22,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9da870a1dc3343c65d/lava_callback.json.gz 2026-03-11 10:01:22,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:23,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9da870a1dc3343c65d HTTP/1.1" 200 None 2026-03-11 10:01:23,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:23,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:01:23,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:23,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c9da870a1dc3343c65d HTTP/1.1" 200 None 2026-03-11 10:01:23,062 - lava_callback - INFO - Completed processing callback for node 69b13c9da870a1dc3343c65d 2026-03-11 10:01:23,421 - lava_callback - INFO - Received callback for node 69b13c9fa870a1dc3343c662 INFO: 172.21.0.1:32988 - "POST /node/69b13c9fa870a1dc3343c662 HTTP/1.0" 202 Accepted 2026-03-11 10:01:23,429 - lava_callback - INFO - Starting async job submit for node 69b13c9fa870a1dc3343c662 2026-03-11 10:01:23,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:23,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9fa870a1dc3343c662 HTTP/1.1" 200 None 2026-03-11 10:01:23,469 - lava_callback - DEBUG - Processing node 69b13c9fa870a1dc3343c662: baseline-arm64-broonie 2026-03-11 10:01:23,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:23,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:23,890 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9fa870a1dc3343c662/log.txt.gz 2026-03-11 10:01:24,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:24,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:24,308 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9fa870a1dc3343c662/lava-logs.yaml 2026-03-11 10:01:24,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:24,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:24,475 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9fa870a1dc3343c662/lava_callback.json.gz 2026-03-11 10:01:24,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:24,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9fa870a1dc3343c662 HTTP/1.1" 200 None 2026-03-11 10:01:24,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:24,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:01:24,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:24,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c9fa870a1dc3343c662 HTTP/1.1" 200 None 2026-03-11 10:01:24,555 - lava_callback - INFO - Completed processing callback for node 69b13c9fa870a1dc3343c662 2026-03-11 10:01:24,858 - lava_callback - INFO - Received callback for node 69b13ca5a870a1dc3343c67a INFO: 172.21.0.1:32996 - "POST /node/69b13ca5a870a1dc3343c67a HTTP/1.0" 202 Accepted 2026-03-11 10:01:24,864 - lava_callback - INFO - Starting async job submit for node 69b13ca5a870a1dc3343c67a 2026-03-11 10:01:24,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:24,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca5a870a1dc3343c67a HTTP/1.1" 200 None 2026-03-11 10:01:24,911 - lava_callback - DEBUG - Processing node 69b13ca5a870a1dc3343c67a: baseline-arm64-broonie 2026-03-11 10:01:25,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:25,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:25,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca5a870a1dc3343c67a/log.txt.gz 2026-03-11 10:01:25,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:25,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:25,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 10:01:25,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:25,675 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca5a870a1dc3343c67a/lava-logs.yaml 2026-03-11 10:01:25,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:01:25,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:01:25,823 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca5a870a1dc3343c67a/lava_callback.json.gz 2026-03-11 10:01:25,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:25,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca5a870a1dc3343c67a HTTP/1.1" 200 None 2026-03-11 10:01:25,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:25,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:01:25,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:25,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca5a870a1dc3343c67a HTTP/1.1" 200 None 2026-03-11 10:01:25,903 - lava_callback - INFO - Completed processing callback for node 69b13ca5a870a1dc3343c67a INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:01:55,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:01:55,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45788 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:02:18,649 - lava_callback - INFO - Received callback for node 69b13d7da870a1dc3343c7cc INFO: 172.21.0.1:45792 - "POST /node/69b13d7da870a1dc3343c7cc HTTP/1.0" 202 Accepted 2026-03-11 10:02:18,656 - lava_callback - INFO - Starting async job submit for node 69b13d7da870a1dc3343c7cc 2026-03-11 10:02:18,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:02:18,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13d7da870a1dc3343c7cc HTTP/1.1" 200 None 2026-03-11 10:02:18,700 - lava_callback - DEBUG - Processing node 69b13d7da870a1dc3343c7cc: baseline-arm64 2026-03-11 10:02:18,839 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:02:18,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:02:19,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:02:19,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13d7da870a1dc3343c7cc/lava-logs.yaml 2026-03-11 10:02:19,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:02:19,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:02:19,233 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13d7da870a1dc3343c7cc/lava_callback.json.gz 2026-03-11 10:02:19,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:02:19,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13d7da870a1dc3343c7cc HTTP/1.1" 200 None 2026-03-11 10:02:19,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:02:19,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:02:19,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:02:19,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13d7da870a1dc3343c7cc HTTP/1.1" 200 None 2026-03-11 10:02:19,383 - lava_callback - INFO - Completed processing callback for node 69b13d7da870a1dc3343c7cc 2026-03-11 10:02:25,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:02:25,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:03:04,128 - lava_callback - INFO - Received callback for node 69ae9ad2c660ead8a389b9d2 INFO: 172.21.0.1:37638 - "POST /node/69ae9ad2c660ead8a389b9d2 HTTP/1.0" 202 Accepted 2026-03-11 10:03:04,133 - lava_callback - INFO - Starting async job submit for node 69ae9ad2c660ead8a389b9d2 2026-03-11 10:03:04,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:04,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9ad2c660ead8a389b9d2 HTTP/1.1" 200 None 2026-03-11 10:03:04,156 - lava_callback - DEBUG - Processing node 69ae9ad2c660ead8a389b9d2: baseline-arm64-clabbe 2026-03-11 10:03:04,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9ad2c660ead8a389b9d2 2026-03-11 10:03:04,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:04,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9ad2c660ead8a389b9d2 HTTP/1.1" 200 None 2026-03-11 10:03:04,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:04,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 10:03:04,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:04,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9ad2c660ead8a389b9d2 HTTP/1.1" 200 None 2026-03-11 10:03:04,215 - lava_callback - ERROR - Error processing callback for node 69ae9ad2c660ead8a389b9d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:03:04,383 - lava_callback - INFO - Received callback for node 69b13c8ba870a1dc3343c621 INFO: 172.21.0.1:37640 - "POST /node/69b13c8ba870a1dc3343c621 HTTP/1.0" 202 Accepted 2026-03-11 10:03:04,390 - lava_callback - INFO - Starting async job submit for node 69b13c8ba870a1dc3343c621 2026-03-11 10:03:04,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:04,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ba870a1dc3343c621 HTTP/1.1" 200 None 2026-03-11 10:03:04,433 - lava_callback - DEBUG - Processing node 69b13c8ba870a1dc3343c621: baseline-nfs-arm64 2026-03-11 10:03:05,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:05,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:05,359 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ba870a1dc3343c621/log.txt.gz 2026-03-11 10:03:05,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:06,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:06,064 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ba870a1dc3343c621/lava-logs.yaml 2026-03-11 10:03:06,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:06,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:06,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8ba870a1dc3343c621/lava_callback.json.gz 2026-03-11 10:03:06,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:06,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8ba870a1dc3343c621 HTTP/1.1" 200 None 2026-03-11 10:03:06,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:06,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:03:06,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:06,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c8ba870a1dc3343c621 HTTP/1.1" 200 None 2026-03-11 10:03:06,368 - lava_callback - INFO - Completed processing callback for node 69b13c8ba870a1dc3343c621 INFO: 172.21.0.1:37656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51510 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:03:21,765 - lava_callback - INFO - Received callback for node 69b13c9ca870a1dc3343c65a INFO: 172.21.0.1:56134 - "POST /node/69b13c9ca870a1dc3343c65a HTTP/1.0" 202 Accepted 2026-03-11 10:03:21,771 - lava_callback - INFO - Starting async job submit for node 69b13c9ca870a1dc3343c65a 2026-03-11 10:03:21,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:21,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9ca870a1dc3343c65a HTTP/1.1" 200 None 2026-03-11 10:03:21,804 - lava_callback - DEBUG - Processing node 69b13c9ca870a1dc3343c65a: baseline-arm64-broonie 2026-03-11 10:03:22,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:22,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:22,244 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ca870a1dc3343c65a/log.txt.gz 2026-03-11 10:03:22,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:22,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:22,655 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ca870a1dc3343c65a/lava-logs.yaml 2026-03-11 10:03:22,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:22,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:22,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13c9ca870a1dc3343c65a/lava_callback.json.gz 2026-03-11 10:03:22,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:22,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c9ca870a1dc3343c65a HTTP/1.1" 200 None 2026-03-11 10:03:22,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:22,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:03:22,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:22,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c9ca870a1dc3343c65a HTTP/1.1" 200 None 2026-03-11 10:03:22,964 - lava_callback - INFO - Completed processing callback for node 69b13c9ca870a1dc3343c65a 2026-03-11 10:03:25,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:25,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:03:38,906 - lava_callback - INFO - Received callback for node 69b13dcaa870a1dc3343c7de INFO: 172.21.0.1:39480 - "POST /node/69b13dcaa870a1dc3343c7de HTTP/1.0" 202 Accepted 2026-03-11 10:03:38,914 - lava_callback - INFO - Starting async job submit for node 69b13dcaa870a1dc3343c7de 2026-03-11 10:03:38,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:38,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13dcaa870a1dc3343c7de HTTP/1.1" 200 None 2026-03-11 10:03:38,966 - lava_callback - DEBUG - Processing node 69b13dcaa870a1dc3343c7de: baseline-arm64 2026-03-11 10:03:39,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:39,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:39,216 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13dcaa870a1dc3343c7de/log.txt.gz 2026-03-11 10:03:39,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:39,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:39,466 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13dcaa870a1dc3343c7de/lava-logs.yaml 2026-03-11 10:03:39,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:03:39,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:03:39,582 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13dcaa870a1dc3343c7de/lava_callback.json.gz 2026-03-11 10:03:39,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:39,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13dcaa870a1dc3343c7de HTTP/1.1" 200 None 2026-03-11 10:03:39,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:39,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:03:39,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:39,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13dcaa870a1dc3343c7de HTTP/1.1" 200 None 2026-03-11 10:03:39,745 - lava_callback - INFO - Completed processing callback for node 69b13dcaa870a1dc3343c7de INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:03:55,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:03:55,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 10:04:15,966 - lava_callback - INFO - Received callback for node 69b13cb5a870a1dc3343c6c2 INFO: 172.21.0.1:35082 - "POST /node/69b13cb5a870a1dc3343c6c2 HTTP/1.0" 202 Accepted 2026-03-11 10:04:15,973 - lava_callback - INFO - Starting async job submit for node 69b13cb5a870a1dc3343c6c2 2026-03-11 10:04:16,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:16,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb5a870a1dc3343c6c2 HTTP/1.1" 200 None 2026-03-11 10:04:16,016 - lava_callback - DEBUG - Processing node 69b13cb5a870a1dc3343c6c2: baseline-arm64-foundriesio 2026-03-11 10:04:16,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35092 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:04:16,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:16,579 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6c2/log.txt.gz 2026-03-11 10:04:16,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:17,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:17,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6c2/lava-logs.yaml 2026-03-11 10:04:17,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:17,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:17,247 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69b13cb5a870a1dc3343c6c2/lava_callback.json.gz 2026-03-11 10:04:17,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:17,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13cb5a870a1dc3343c6c2 HTTP/1.1" 200 None 2026-03-11 10:04:17,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:17,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:04:17,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:17,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13cb5a870a1dc3343c6c2 HTTP/1.1" 200 None 2026-03-11 10:04:17,338 - lava_callback - INFO - Completed processing callback for node 69b13cb5a870a1dc3343c6c2 2026-03-11 10:04:24,183 - lava_callback - INFO - Received callback for node 69ae9b1fc660ead8a389ba05 INFO: 172.21.0.1:47304 - "POST /node/69ae9b1fc660ead8a389ba05 HTTP/1.0" 202 Accepted 2026-03-11 10:04:24,189 - lava_callback - INFO - Starting async job submit for node 69ae9b1fc660ead8a389ba05 2026-03-11 10:04:24,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:24,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9b1fc660ead8a389ba05 HTTP/1.1" 200 None 2026-03-11 10:04:24,228 - lava_callback - DEBUG - Processing node 69ae9b1fc660ead8a389ba05: baseline-arm64-clabbe 2026-03-11 10:04:24,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9b1fc660ead8a389ba05 2026-03-11 10:04:24,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:24,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9b1fc660ead8a389ba05 HTTP/1.1" 200 None 2026-03-11 10:04:24,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:24,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-11 10:04:24,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:24,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9b1fc660ead8a389ba05 HTTP/1.1" 200 None 2026-03-11 10:04:24,318 - lava_callback - ERROR - Error processing callback for node 69ae9b1fc660ead8a389ba05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:04:25,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:25,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47312 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:04:31,422 - lava_callback - INFO - Received callback for node 69b13e1da870a1dc3343c800 INFO: 172.21.0.1:33138 - "POST /node/69b13e1da870a1dc3343c800 HTTP/1.0" 202 Accepted 2026-03-11 10:04:31,428 - lava_callback - INFO - Starting async job submit for node 69b13e1da870a1dc3343c800 2026-03-11 10:04:31,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:31,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13e1da870a1dc3343c800 HTTP/1.1" 200 None 2026-03-11 10:04:31,446 - lava_callback - DEBUG - Processing node 69b13e1da870a1dc3343c800: baseline-nfs-arm64 2026-03-11 10:04:31,447 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:04:31,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:31,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:31,564 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13e1da870a1dc3343c800/lava-logs.yaml 2026-03-11 10:04:31,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:31,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:31,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13e1da870a1dc3343c800/lava_callback.json.gz 2026-03-11 10:04:31,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:31,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13e1da870a1dc3343c800 HTTP/1.1" 200 None 2026-03-11 10:04:31,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:31,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:04:31,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:31,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13e1da870a1dc3343c800 HTTP/1.1" 200 None 2026-03-11 10:04:31,771 - lava_callback - INFO - Completed processing callback for node 69b13e1da870a1dc3343c800 2026-03-11 10:04:31,930 - lava_callback - INFO - Received callback for node 69b13c71a870a1dc3343c5e0 INFO: 172.21.0.1:33152 - "POST /node/69b13c71a870a1dc3343c5e0 HTTP/1.0" 202 Accepted 2026-03-11 10:04:31,937 - lava_callback - INFO - Starting async job submit for node 69b13c71a870a1dc3343c5e0 2026-03-11 10:04:31,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:31,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c71a870a1dc3343c5e0 HTTP/1.1" 200 None 2026-03-11 10:04:31,974 - lava_callback - DEBUG - Processing node 69b13c71a870a1dc3343c5e0: baseline-arm64 2026-03-11 10:04:32,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:32,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:32,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c71a870a1dc3343c5e0/log.txt.gz 2026-03-11 10:04:32,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:32,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:32,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c71a870a1dc3343c5e0/lava-logs.yaml 2026-03-11 10:04:32,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:33,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:33,044 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c71a870a1dc3343c5e0/lava_callback.json.gz 2026-03-11 10:04:33,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:33,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c71a870a1dc3343c5e0 HTTP/1.1" 200 None 2026-03-11 10:04:33,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:33,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:04:33,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:33,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c71a870a1dc3343c5e0 HTTP/1.1" 200 None 2026-03-11 10:04:33,123 - lava_callback - INFO - Completed processing callback for node 69b13c71a870a1dc3343c5e0 INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:04:37,225 - lava_callback - INFO - Received callback for node 69b13ca0a870a1dc3343c665 INFO: 172.21.0.1:33172 - "POST /node/69b13ca0a870a1dc3343c665 HTTP/1.0" 202 Accepted 2026-03-11 10:04:37,234 - lava_callback - INFO - Starting async job submit for node 69b13ca0a870a1dc3343c665 2026-03-11 10:04:37,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:37,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca0a870a1dc3343c665 HTTP/1.1" 200 None 2026-03-11 10:04:37,272 - lava_callback - DEBUG - Processing node 69b13ca0a870a1dc3343c665: baseline-arm64-broonie 2026-03-11 10:04:37,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:37,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:37,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca0a870a1dc3343c665/log.txt.gz 2026-03-11 10:04:37,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:37,979 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:37,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca0a870a1dc3343c665/lava-logs.yaml 2026-03-11 10:04:37,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:04:38,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:04:38,129 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13ca0a870a1dc3343c665/lava_callback.json.gz 2026-03-11 10:04:38,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:38,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ca0a870a1dc3343c665 HTTP/1.1" 200 None 2026-03-11 10:04:38,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:38,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:04:38,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:38,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ca0a870a1dc3343c665 HTTP/1.1" 200 None 2026-03-11 10:04:38,208 - lava_callback - INFO - Completed processing callback for node 69b13ca0a870a1dc3343c665 INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:04:55,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:04:55,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44586 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:05:20,136 - lava_callback - INFO - Received callback for node 69ae9b59c660ead8a389ba0d INFO: 172.21.0.1:55694 - "POST /node/69ae9b59c660ead8a389ba0d HTTP/1.0" 202 Accepted 2026-03-11 10:05:20,141 - lava_callback - INFO - Starting async job submit for node 69ae9b59c660ead8a389ba0d 2026-03-11 10:05:20,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:05:20,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9b59c660ead8a389ba0d HTTP/1.1" 200 None 2026-03-11 10:05:20,158 - lava_callback - DEBUG - Processing node 69ae9b59c660ead8a389ba0d: baseline-arm-baylibre 2026-03-11 10:05:20,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9b59c660ead8a389ba0d 2026-03-11 10:05:20,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:05:20,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9b59c660ead8a389ba0d HTTP/1.1" 200 None 2026-03-11 10:05:20,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:05:20,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:05:20,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:05:20,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9b59c660ead8a389ba0d HTTP/1.1" 200 None 2026-03-11 10:05:20,219 - lava_callback - ERROR - Error processing callback for node 69ae9b59c660ead8a389ba0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:06:07,745 - lava_callback - INFO - Received callback for node 69b13c80a870a1dc3343c602 INFO: 172.21.0.1:40660 - "POST /node/69b13c80a870a1dc3343c602 HTTP/1.0" 202 Accepted 2026-03-11 10:06:07,752 - lava_callback - INFO - Starting async job submit for node 69b13c80a870a1dc3343c602 2026-03-11 10:06:07,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:07,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c80a870a1dc3343c602 HTTP/1.1" 200 None 2026-03-11 10:06:07,803 - lava_callback - DEBUG - Processing node 69b13c80a870a1dc3343c602: baseline-arm64 2026-03-11 10:06:08,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:08,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:08,339 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c80a870a1dc3343c602/log.txt.gz 2026-03-11 10:06:08,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:08,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:08,798 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c80a870a1dc3343c602/lava-logs.yaml 2026-03-11 10:06:08,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:09,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:09,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c80a870a1dc3343c602/lava_callback.json.gz DEBUG: Setup failed for 69b13c80a870a1dc3343c602. Transitting job node result: incomplete -> fail 2026-03-11 10:06:09,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:09,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c80a870a1dc3343c602 HTTP/1.1" 200 None 2026-03-11 10:06:09,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:09,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:06:09,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:09,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c80a870a1dc3343c602 HTTP/1.1" 200 None 2026-03-11 10:06:09,234 - lava_callback - INFO - Completed processing callback for node 69b13c80a870a1dc3343c602 INFO: 172.21.0.1:37264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:06:25,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:25,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-11 10:06:26,503 - lava_callback - INFO - Received callback for node 69b13e63a870a1dc3343c827 INFO: 172.21.0.1:40752 - "POST /node/69b13e63a870a1dc3343c827 HTTP/1.0" 202 Accepted 2026-03-11 10:06:26,510 - lava_callback - INFO - Starting async job submit for node 69b13e63a870a1dc3343c827 INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:06:26,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:26,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13e63a870a1dc3343c827 HTTP/1.1" 200 None 2026-03-11 10:06:26,567 - lava_callback - DEBUG - Processing node 69b13e63a870a1dc3343c827: baseline-arm64 2026-03-11 10:06:26,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:27,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:27,121 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13e63a870a1dc3343c827/log.txt.gz 2026-03-11 10:06:27,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:27,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:27,615 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13e63a870a1dc3343c827/lava-logs.yaml 2026-03-11 10:06:27,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:27,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:27,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13e63a870a1dc3343c827/lava_callback.json.gz 2026-03-11 10:06:27,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:27,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13e63a870a1dc3343c827 HTTP/1.1" 200 None 2026-03-11 10:06:27,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:27,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:06:27,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:27,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13e63a870a1dc3343c827 HTTP/1.1" 200 None 2026-03-11 10:06:27,905 - lava_callback - INFO - Completed processing callback for node 69b13e63a870a1dc3343c827 INFO: 172.21.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:06:37,164 - lava_callback - INFO - Received callback for node 69b13c82a870a1dc3343c608 INFO: 172.21.0.1:45906 - "POST /node/69b13c82a870a1dc3343c608 HTTP/1.0" 202 Accepted 2026-03-11 10:06:37,170 - lava_callback - INFO - Starting async job submit for node 69b13c82a870a1dc3343c608 2026-03-11 10:06:37,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:37,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c82a870a1dc3343c608 HTTP/1.1" 200 None 2026-03-11 10:06:37,209 - lava_callback - DEBUG - Processing node 69b13c82a870a1dc3343c608: baseline-nfs-arm64 2026-03-11 10:06:37,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:37,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:37,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c82a870a1dc3343c608/log.txt.gz 2026-03-11 10:06:37,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:38,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:38,181 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c82a870a1dc3343c608/lava-logs.yaml 2026-03-11 10:06:38,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:06:38,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:06:38,371 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c82a870a1dc3343c608/lava_callback.json.gz 2026-03-11 10:06:38,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:38,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c82a870a1dc3343c608 HTTP/1.1" 200 None 2026-03-11 10:06:38,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:38,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:06:38,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:38,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c82a870a1dc3343c608 HTTP/1.1" 200 None 2026-03-11 10:06:38,478 - lava_callback - INFO - Completed processing callback for node 69b13c82a870a1dc3343c608 INFO: 172.21.0.1:55958 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:06:55,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:06:55,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:08:37,799 - lava_callback - INFO - Received callback for node 69b13ef5a870a1dc3343c859 INFO: 172.21.0.1:34118 - "POST /node/69b13ef5a870a1dc3343c859 HTTP/1.0" 202 Accepted 2026-03-11 10:08:37,805 - lava_callback - INFO - Starting async job submit for node 69b13ef5a870a1dc3343c859 2026-03-11 10:08:37,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:37,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ef5a870a1dc3343c859 HTTP/1.1" 200 None 2026-03-11 10:08:37,849 - lava_callback - DEBUG - Processing node 69b13ef5a870a1dc3343c859: baseline-arm64 2026-03-11 10:08:37,977 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:08:38,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:08:38,261 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:08:38,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13ef5a870a1dc3343c859/lava-logs.yaml 2026-03-11 10:08:38,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:08:38,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:08:38,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13ef5a870a1dc3343c859/lava_callback.json.gz 2026-03-11 10:08:38,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:38,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ef5a870a1dc3343c859 HTTP/1.1" 200 None 2026-03-11 10:08:38,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:38,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:08:38,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:38,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ef5a870a1dc3343c859 HTTP/1.1" 200 None 2026-03-11 10:08:38,614 - lava_callback - INFO - Completed processing callback for node 69b13ef5a870a1dc3343c859 2026-03-11 10:08:40,075 - lava_callback - INFO - Received callback for node 69ae9c16c660ead8a389ba6d INFO: 172.21.0.1:49816 - "POST /node/69ae9c16c660ead8a389ba6d HTTP/1.0" 202 Accepted 2026-03-11 10:08:40,081 - lava_callback - INFO - Starting async job submit for node 69ae9c16c660ead8a389ba6d 2026-03-11 10:08:40,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:40,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c16c660ead8a389ba6d HTTP/1.1" 200 None 2026-03-11 10:08:40,097 - lava_callback - DEBUG - Processing node 69ae9c16c660ead8a389ba6d: baseline-arm-baylibre 2026-03-11 10:08:40,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9c16c660ead8a389ba6d 2026-03-11 10:08:40,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:40,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c16c660ead8a389ba6d HTTP/1.1" 200 None 2026-03-11 10:08:40,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:40,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:08:40,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:40,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9c16c660ead8a389ba6d HTTP/1.1" 200 None 2026-03-11 10:08:40,160 - lava_callback - ERROR - Error processing callback for node 69ae9c16c660ead8a389ba6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49818 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:08:47,242 - lava_callback - INFO - Received callback for node 69b13c79a870a1dc3343c5f2 INFO: 172.21.0.1:49822 - "POST /node/69b13c79a870a1dc3343c5f2 HTTP/1.0" 202 Accepted 2026-03-11 10:08:47,248 - lava_callback - INFO - Starting async job submit for node 69b13c79a870a1dc3343c5f2 2026-03-11 10:08:47,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:47,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c79a870a1dc3343c5f2 HTTP/1.1" 200 None 2026-03-11 10:08:47,284 - lava_callback - DEBUG - Processing node 69b13c79a870a1dc3343c5f2: baseline-arm64 2026-03-11 10:08:47,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:08:47,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:08:47,652 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c79a870a1dc3343c5f2/log.txt.gz 2026-03-11 10:08:47,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:08:47,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:08:47,971 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c79a870a1dc3343c5f2/lava-logs.yaml 2026-03-11 10:08:47,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:08:48,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:08:48,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c79a870a1dc3343c5f2/lava_callback.json.gz 2026-03-11 10:08:48,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:48,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c79a870a1dc3343c5f2 HTTP/1.1" 200 None 2026-03-11 10:08:48,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:48,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:08:48,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:48,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c79a870a1dc3343c5f2 HTTP/1.1" 200 None 2026-03-11 10:08:48,214 - lava_callback - INFO - Completed processing callback for node 69b13c79a870a1dc3343c5f2 2026-03-11 10:08:55,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:08:55,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:09:20,080 - lava_callback - INFO - Received callback for node 69ae9c3ec660ead8a389baa5 INFO: 172.21.0.1:55878 - "POST /node/69ae9c3ec660ead8a389baa5 HTTP/1.0" 202 Accepted 2026-03-11 10:09:20,085 - lava_callback - INFO - Starting async job submit for node 69ae9c3ec660ead8a389baa5 2026-03-11 10:09:20,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:20,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c3ec660ead8a389baa5 HTTP/1.1" 200 None 2026-03-11 10:09:20,101 - lava_callback - DEBUG - Processing node 69ae9c3ec660ead8a389baa5: baseline-arm-baylibre 2026-03-11 10:09:20,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9c3ec660ead8a389baa5 2026-03-11 10:09:20,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:20,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c3ec660ead8a389baa5 HTTP/1.1" 200 None 2026-03-11 10:09:20,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:20,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:09:20,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:20,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9c3ec660ead8a389baa5 HTTP/1.1" 200 None 2026-03-11 10:09:20,170 - lava_callback - ERROR - Error processing callback for node 69ae9c3ec660ead8a389baa5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:09:25,564 - lava_callback - INFO - Received callback for node 69b13ac5a870a1dc3343c57b INFO: 172.21.0.1:55884 - "POST /node/69b13ac5a870a1dc3343c57b HTTP/1.0" 202 Accepted 2026-03-11 10:09:25,614 - lava_callback - INFO - Starting async job submit for node 69b13ac5a870a1dc3343c57b 2026-03-11 10:09:25,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:25,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ac5a870a1dc3343c57b HTTP/1.1" 200 None 2026-03-11 10:09:25,659 - lava_callback - DEBUG - Processing node 69b13ac5a870a1dc3343c57b: baseline-arm-pengutronix 2026-03-11 10:09:25,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:09:26,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:09:26,043 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b13ac5a870a1dc3343c57b/log.txt.gz 2026-03-11 10:09:26,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:09:26,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:09:26,299 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b13ac5a870a1dc3343c57b/lava-logs.yaml 2026-03-11 10:09:26,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:09:26,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:09:26,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b13ac5a870a1dc3343c57b/lava_callback.json.gz DEBUG: Setup failed for 69b13ac5a870a1dc3343c57b. Transitting job node result: incomplete -> fail 2026-03-11 10:09:26,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:26,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13ac5a870a1dc3343c57b HTTP/1.1" 200 None INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:09:26,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:26,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 10:09:26,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:26,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13ac5a870a1dc3343c57b HTTP/1.1" 200 None 2026-03-11 10:09:26,616 - lava_callback - INFO - Completed processing callback for node 69b13ac5a870a1dc3343c57b INFO: 172.21.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:09:55,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:09:55,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:10:00,128 - lava_callback - INFO - Received callback for node 69ae9c67c660ead8a389baca INFO: 172.21.0.1:51658 - "POST /node/69ae9c67c660ead8a389baca HTTP/1.0" 202 Accepted 2026-03-11 10:10:00,134 - lava_callback - INFO - Starting async job submit for node 69ae9c67c660ead8a389baca 2026-03-11 10:10:00,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:00,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c67c660ead8a389baca HTTP/1.1" 200 None 2026-03-11 10:10:00,151 - lava_callback - DEBUG - Processing node 69ae9c67c660ead8a389baca: baseline-arm-baylibre 2026-03-11 10:10:00,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9c67c660ead8a389baca 2026-03-11 10:10:00,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:00,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c67c660ead8a389baca HTTP/1.1" 200 None 2026-03-11 10:10:00,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:00,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:10:00,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:00,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9c67c660ead8a389baca HTTP/1.1" 200 None 2026-03-11 10:10:00,207 - lava_callback - ERROR - Error processing callback for node 69ae9c67c660ead8a389baca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:10:05,223 - lava_callback - INFO - Received callback for node 69b13c8aa870a1dc3343c61a INFO: 172.21.0.1:51672 - "POST /node/69b13c8aa870a1dc3343c61a HTTP/1.0" 202 Accepted 2026-03-11 10:10:05,229 - lava_callback - INFO - Starting async job submit for node 69b13c8aa870a1dc3343c61a 2026-03-11 10:10:05,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:05,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8aa870a1dc3343c61a HTTP/1.1" 200 None 2026-03-11 10:10:05,279 - lava_callback - DEBUG - Processing node 69b13c8aa870a1dc3343c61a: baseline-nfs-arm64 2026-03-11 10:10:05,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:10:05,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:10:05,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8aa870a1dc3343c61a/log.txt.gz 2026-03-11 10:10:05,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:10:06,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:10:06,182 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8aa870a1dc3343c61a/lava-logs.yaml 2026-03-11 10:10:06,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:10:06,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:10:06,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c8aa870a1dc3343c61a/lava_callback.json.gz 2026-03-11 10:10:06,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:06,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c8aa870a1dc3343c61a HTTP/1.1" 200 None 2026-03-11 10:10:06,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:06,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:10:06,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:06,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c8aa870a1dc3343c61a HTTP/1.1" 200 None 2026-03-11 10:10:06,430 - lava_callback - INFO - Completed processing callback for node 69b13c8aa870a1dc3343c61a INFO: 172.21.0.1:51676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:10:25,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:25,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38796 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:10:40,158 - lava_callback - INFO - Received callback for node 69ae9c8dc660ead8a389baee INFO: 172.21.0.1:43680 - "POST /node/69ae9c8dc660ead8a389baee HTTP/1.0" 202 Accepted 2026-03-11 10:10:40,163 - lava_callback - INFO - Starting async job submit for node 69ae9c8dc660ead8a389baee 2026-03-11 10:10:40,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:40,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c8dc660ead8a389baee HTTP/1.1" 200 None 2026-03-11 10:10:40,179 - lava_callback - DEBUG - Processing node 69ae9c8dc660ead8a389baee: baseline-arm-baylibre 2026-03-11 10:10:40,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9c8dc660ead8a389baee 2026-03-11 10:10:40,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:40,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9c8dc660ead8a389baee HTTP/1.1" 200 None 2026-03-11 10:10:40,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:40,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:10:40,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:10:40,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9c8dc660ead8a389baee HTTP/1.1" 200 None 2026-03-11 10:10:40,259 - lava_callback - ERROR - Error processing callback for node 69ae9c8dc660ead8a389baee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:11:17,800 - lava_callback - INFO - Received callback for node 69b13f50a870a1dc3343c878 INFO: 172.21.0.1:55392 - "POST /node/69b13f50a870a1dc3343c878 HTTP/1.0" 202 Accepted 2026-03-11 10:11:17,806 - lava_callback - INFO - Starting async job submit for node 69b13f50a870a1dc3343c878 2026-03-11 10:11:17,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:17,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13f50a870a1dc3343c878 HTTP/1.1" 200 None 2026-03-11 10:11:17,838 - lava_callback - DEBUG - Processing node 69b13f50a870a1dc3343c878: baseline-arm64-broonie 2026-03-11 10:11:18,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:11:18,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:11:18,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13f50a870a1dc3343c878/log.txt.gz 2026-03-11 10:11:18,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:11:18,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:11:18,775 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13f50a870a1dc3343c878/lava-logs.yaml 2026-03-11 10:11:18,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:11:18,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:11:18,959 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b13f50a870a1dc3343c878/lava_callback.json.gz 2026-03-11 10:11:18,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:18,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13f50a870a1dc3343c878 HTTP/1.1" 200 None 2026-03-11 10:11:18,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:19,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:11:19,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:19,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13f50a870a1dc3343c878 HTTP/1.1" 200 None 2026-03-11 10:11:19,066 - lava_callback - INFO - Completed processing callback for node 69b13f50a870a1dc3343c878 2026-03-11 10:11:20,225 - lava_callback - INFO - Received callback for node 69ae9cb6c660ead8a389bb39 INFO: 172.21.0.1:36832 - "POST /node/69ae9cb6c660ead8a389bb39 HTTP/1.0" 202 Accepted 2026-03-11 10:11:20,232 - lava_callback - INFO - Starting async job submit for node 69ae9cb6c660ead8a389bb39 2026-03-11 10:11:20,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:20,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9cb6c660ead8a389bb39 HTTP/1.1" 200 None 2026-03-11 10:11:20,248 - lava_callback - DEBUG - Processing node 69ae9cb6c660ead8a389bb39: baseline-arm-baylibre 2026-03-11 10:11:20,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9cb6c660ead8a389bb39 2026-03-11 10:11:20,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:20,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9cb6c660ead8a389bb39 HTTP/1.1" 200 None 2026-03-11 10:11:20,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:20,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-11 10:11:20,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:20,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9cb6c660ead8a389bb39 HTTP/1.1" 200 None 2026-03-11 10:11:20,303 - lava_callback - ERROR - Error processing callback for node 69ae9cb6c660ead8a389bb39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:11:25,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:25,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36842 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:11:30,891 - lava_callback - INFO - Received callback for node 69b13f8ca870a1dc3343c88e INFO: 172.21.0.1:36590 - "POST /node/69b13f8ca870a1dc3343c88e HTTP/1.0" 202 Accepted 2026-03-11 10:11:30,898 - lava_callback - INFO - Starting async job submit for node 69b13f8ca870a1dc3343c88e 2026-03-11 10:11:30,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:30,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13f8ca870a1dc3343c88e HTTP/1.1" 200 None 2026-03-11 10:11:30,943 - lava_callback - DEBUG - Processing node 69b13f8ca870a1dc3343c88e: baseline-arm64 2026-03-11 10:11:31,184 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:11:31,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:11:31,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:11:31,489 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13f8ca870a1dc3343c88e/lava-logs.yaml 2026-03-11 10:11:31,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:11:31,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:11:31,675 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13f8ca870a1dc3343c88e/lava_callback.json.gz 2026-03-11 10:11:31,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:31,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13f8ca870a1dc3343c88e HTTP/1.1" 200 None 2026-03-11 10:11:31,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:31,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:11:31,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:31,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13f8ca870a1dc3343c88e HTTP/1.1" 200 None 2026-03-11 10:11:31,855 - lava_callback - INFO - Completed processing callback for node 69b13f8ca870a1dc3343c88e INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:11:55,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:11:55,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:12:11,787 - lava_callback - INFO - Received callback for node 69b13fe0a870a1dc3343c8aa INFO: 172.21.0.1:48142 - "POST /node/69b13fe0a870a1dc3343c8aa HTTP/1.0" 202 Accepted 2026-03-11 10:12:11,793 - lava_callback - INFO - Starting async job submit for node 69b13fe0a870a1dc3343c8aa 2026-03-11 10:12:11,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:12:11,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13fe0a870a1dc3343c8aa HTTP/1.1" 200 None 2026-03-11 10:12:11,810 - lava_callback - DEBUG - Processing node 69b13fe0a870a1dc3343c8aa: baseline-nfs-arm64 2026-03-11 10:12:11,812 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:12:11,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:12:12,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:12:12,045 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13fe0a870a1dc3343c8aa/lava-logs.yaml 2026-03-11 10:12:12,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:12:12,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:12:12,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13fe0a870a1dc3343c8aa/lava_callback.json.gz 2026-03-11 10:12:12,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:12:12,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13fe0a870a1dc3343c8aa HTTP/1.1" 200 None 2026-03-11 10:12:12,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:12:12,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:12:12,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:12:12,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13fe0a870a1dc3343c8aa HTTP/1.1" 200 None 2026-03-11 10:12:12,230 - lava_callback - INFO - Completed processing callback for node 69b13fe0a870a1dc3343c8aa INFO: 172.21.0.1:48152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:12:25,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:12:25,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:15:03,198 - lava_callback - INFO - Received callback for node 69b14072a870a1dc3343c8c8 INFO: 172.21.0.1:36664 - "POST /node/69b14072a870a1dc3343c8c8 HTTP/1.0" 202 Accepted 2026-03-11 10:15:03,207 - lava_callback - INFO - Starting async job submit for node 69b14072a870a1dc3343c8c8 2026-03-11 10:15:03,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:15:03,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14072a870a1dc3343c8c8 HTTP/1.1" 200 None 2026-03-11 10:15:03,254 - lava_callback - DEBUG - Processing node 69b14072a870a1dc3343c8c8: baseline-arm64 2026-03-11 10:15:03,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:15:03,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:15:03,572 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14072a870a1dc3343c8c8/log.txt.gz 2026-03-11 10:15:03,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:15:03,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:15:03,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14072a870a1dc3343c8c8/lava-logs.yaml 2026-03-11 10:15:03,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:15:03,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:15:03,961 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14072a870a1dc3343c8c8/lava_callback.json.gz 2026-03-11 10:15:03,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:15:04,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14072a870a1dc3343c8c8 HTTP/1.1" 200 None 2026-03-11 10:15:04,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:15:04,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:15:04,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:15:04,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b14072a870a1dc3343c8c8 HTTP/1.1" 200 None 2026-03-11 10:15:04,115 - lava_callback - INFO - Completed processing callback for node 69b14072a870a1dc3343c8c8 INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:15:25,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:15:25,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40880 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:16:20,601 - lava_callback - INFO - Received callback for node 69ae9deec660ead8a389bbbb INFO: 172.21.0.1:53966 - "POST /node/69ae9deec660ead8a389bbbb HTTP/1.0" 202 Accepted 2026-03-11 10:16:20,607 - lava_callback - INFO - Starting async job submit for node 69ae9deec660ead8a389bbbb 2026-03-11 10:16:20,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:16:20,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9deec660ead8a389bbbb HTTP/1.1" 200 None 2026-03-11 10:16:20,633 - lava_callback - DEBUG - Processing node 69ae9deec660ead8a389bbbb: baseline-arm64-baylibre 2026-03-11 10:16:20,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9deec660ead8a389bbbb 2026-03-11 10:16:20,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:16:20,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9deec660ead8a389bbbb HTTP/1.1" 200 None 2026-03-11 10:16:20,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:16:20,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-11 10:16:20,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:16:20,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9deec660ead8a389bbbb HTTP/1.1" 200 None 2026-03-11 10:16:20,689 - lava_callback - ERROR - Error processing callback for node 69ae9deec660ead8a389bbbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:17:21,189 - lava_callback - INFO - Received callback for node 69b140e1a870a1dc3343c8df INFO: 172.21.0.1:59030 - "POST /node/69b140e1a870a1dc3343c8df HTTP/1.0" 202 Accepted 2026-03-11 10:17:21,195 - lava_callback - INFO - Starting async job submit for node 69b140e1a870a1dc3343c8df 2026-03-11 10:17:21,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:21,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b140e1a870a1dc3343c8df HTTP/1.1" 200 None 2026-03-11 10:17:21,241 - lava_callback - DEBUG - Processing node 69b140e1a870a1dc3343c8df: baseline-arm64 2026-03-11 10:17:21,430 - lava_callback - WARNING - Failed to upload log 2026-03-11 10:17:21,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:17:21,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:17:21,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b140e1a870a1dc3343c8df/lava-logs.yaml 2026-03-11 10:17:21,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:17:21,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:17:21,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b140e1a870a1dc3343c8df/lava_callback.json.gz 2026-03-11 10:17:21,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:21,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b140e1a870a1dc3343c8df HTTP/1.1" 200 None 2026-03-11 10:17:21,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:21,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:17:21,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:21,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b140e1a870a1dc3343c8df HTTP/1.1" 200 None 2026-03-11 10:17:22,073 - lava_callback - INFO - Completed processing callback for node 69b140e1a870a1dc3343c8df 2026-03-11 10:17:25,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:25,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53652 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:17:40,576 - lava_callback - INFO - Received callback for node 69ae9e39c660ead8a389bbd7 INFO: 172.21.0.1:58566 - "POST /node/69ae9e39c660ead8a389bbd7 HTTP/1.0" 202 Accepted 2026-03-11 10:17:40,581 - lava_callback - INFO - Starting async job submit for node 69ae9e39c660ead8a389bbd7 2026-03-11 10:17:40,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:40,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9e39c660ead8a389bbd7 HTTP/1.1" 200 None 2026-03-11 10:17:40,598 - lava_callback - DEBUG - Processing node 69ae9e39c660ead8a389bbd7: baseline-arm64-baylibre 2026-03-11 10:17:40,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9e39c660ead8a389bbd7 2026-03-11 10:17:40,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:40,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9e39c660ead8a389bbd7 HTTP/1.1" 200 None 2026-03-11 10:17:40,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:40,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-11 10:17:40,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:17:40,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9e39c660ead8a389bbd7 HTTP/1.1" 200 None 2026-03-11 10:17:40,697 - lava_callback - ERROR - Error processing callback for node 69ae9e39c660ead8a389bbd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:18:16,890 - lava_callback - INFO - Received callback for node 69b13c85a870a1dc3343c60e INFO: 172.21.0.1:33734 - "POST /node/69b13c85a870a1dc3343c60e HTTP/1.0" 202 Accepted 2026-03-11 10:18:16,899 - lava_callback - INFO - Starting async job submit for node 69b13c85a870a1dc3343c60e 2026-03-11 10:18:16,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:16,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c85a870a1dc3343c60e HTTP/1.1" 200 None 2026-03-11 10:18:16,979 - lava_callback - DEBUG - Processing node 69b13c85a870a1dc3343c60e: baseline-nfs-arm64 2026-03-11 10:18:18,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:18,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:18,243 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c85a870a1dc3343c60e/log.txt.gz 2026-03-11 10:18:18,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:19,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:19,105 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c85a870a1dc3343c60e/lava-logs.yaml 2026-03-11 10:18:19,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:19,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:19,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c85a870a1dc3343c60e/lava_callback.json.gz DEBUG: Setup failed for 69b13c85a870a1dc3343c60e. Transitting job node result: incomplete -> fail 2026-03-11 10:18:19,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:19,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c85a870a1dc3343c60e HTTP/1.1" 200 None 2026-03-11 10:18:19,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:19,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:18:19,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:19,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c85a870a1dc3343c60e HTTP/1.1" 200 None 2026-03-11 10:18:19,561 - lava_callback - INFO - Completed processing callback for node 69b13c85a870a1dc3343c60e 2026-03-11 10:18:25,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:25,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:18:36,836 - lava_callback - INFO - Received callback for node 69b139b3a870a1dc3343c552 INFO: 172.21.0.1:50044 - "POST /node/69b139b3a870a1dc3343c552 HTTP/1.0" 202 Accepted 2026-03-11 10:18:36,841 - lava_callback - INFO - Starting async job submit for node 69b139b3a870a1dc3343c552 2026-03-11 10:18:36,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:36,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b139b3a870a1dc3343c552 HTTP/1.1" 200 None 2026-03-11 10:18:36,876 - lava_callback - DEBUG - Processing node 69b139b3a870a1dc3343c552: baseline-arm64-broonie 2026-03-11 10:18:36,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:37,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:37,120 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b139b3a870a1dc3343c552/log.txt.gz 2026-03-11 10:18:37,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:37,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:37,330 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b139b3a870a1dc3343c552/lava-logs.yaml 2026-03-11 10:18:37,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:18:37,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:18:37,444 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b139b3a870a1dc3343c552/lava_callback.json.gz 2026-03-11 10:18:37,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:37,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b139b3a870a1dc3343c552 HTTP/1.1" 200 None 2026-03-11 10:18:37,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:37,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-11 10:18:37,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:37,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b139b3a870a1dc3343c552 HTTP/1.1" 200 None 2026-03-11 10:18:37,580 - lava_callback - INFO - Completed processing callback for node 69b139b3a870a1dc3343c552 INFO: 172.21.0.1:51456 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:18:55,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:18:55,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:20:28,808 - lava_callback - INFO - Received callback for node 69b1402aa870a1dc3343c8b9 INFO: 172.21.0.1:38946 - "POST /node/69b1402aa870a1dc3343c8b9 HTTP/1.0" 202 Accepted 2026-03-11 10:20:28,815 - lava_callback - INFO - Starting async job submit for node 69b1402aa870a1dc3343c8b9 2026-03-11 10:20:28,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:20:28,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1402aa870a1dc3343c8b9 HTTP/1.1" 200 None 2026-03-11 10:20:28,870 - lava_callback - DEBUG - Processing node 69b1402aa870a1dc3343c8b9: baseline-arm64 2026-03-11 10:20:29,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:20:29,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:20:29,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1402aa870a1dc3343c8b9/log.txt.gz 2026-03-11 10:20:29,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:20:29,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:20:29,828 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1402aa870a1dc3343c8b9/lava-logs.yaml 2026-03-11 10:20:29,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:20:30,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:20:30,014 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1402aa870a1dc3343c8b9/lava_callback.json.gz DEBUG: Setup failed for 69b1402aa870a1dc3343c8b9. Transitting job node result: incomplete -> fail 2026-03-11 10:20:30,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:20:30,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1402aa870a1dc3343c8b9 HTTP/1.1" 200 None 2026-03-11 10:20:30,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:20:30,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:20:30,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:20:30,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1402aa870a1dc3343c8b9 HTTP/1.1" 200 None 2026-03-11 10:20:30,272 - lava_callback - INFO - Completed processing callback for node 69b1402aa870a1dc3343c8b9 INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55512 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:20:55,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:20:55,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56916 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:24:01,085 - lava_callback - INFO - Received callback for node 69ae9fb1c660ead8a389bc6a INFO: 172.21.0.1:49212 - "POST /node/69ae9fb1c660ead8a389bc6a HTTP/1.0" 202 Accepted 2026-03-11 10:24:01,091 - lava_callback - INFO - Starting async job submit for node 69ae9fb1c660ead8a389bc6a 2026-03-11 10:24:01,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:24:01,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9fb1c660ead8a389bc6a HTTP/1.1" 200 None 2026-03-11 10:24:01,116 - lava_callback - DEBUG - Processing node 69ae9fb1c660ead8a389bc6a: baseline-arm64-baylibre 2026-03-11 10:24:01,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ae9fb1c660ead8a389bc6a 2026-03-11 10:24:01,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:24:01,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae9fb1c660ead8a389bc6a HTTP/1.1" 200 None 2026-03-11 10:24:01,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:24:01,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-11 10:24:01,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:24:01,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ae9fb1c660ead8a389bc6a HTTP/1.1" 200 None 2026-03-11 10:24:01,190 - lava_callback - ERROR - Error processing callback for node 69ae9fb1c660ead8a389bc6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:26:21,111 - lava_callback - INFO - Received callback for node 69aea045c660ead8a389bc95 INFO: 172.21.0.1:43492 - "POST /node/69aea045c660ead8a389bc95 HTTP/1.0" 202 Accepted 2026-03-11 10:26:21,116 - lava_callback - INFO - Starting async job submit for node 69aea045c660ead8a389bc95 2026-03-11 10:26:21,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:21,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea045c660ead8a389bc95 HTTP/1.1" 200 None 2026-03-11 10:26:21,132 - lava_callback - DEBUG - Processing node 69aea045c660ead8a389bc95: baseline-arm64-baylibre 2026-03-11 10:26:21,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea045c660ead8a389bc95 2026-03-11 10:26:21,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:21,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea045c660ead8a389bc95 HTTP/1.1" 200 None 2026-03-11 10:26:21,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:21,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-11 10:26:21,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:21,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea045c660ead8a389bc95 HTTP/1.1" 200 None 2026-03-11 10:26:21,198 - lava_callback - ERROR - Error processing callback for node 69aea045c660ead8a389bc95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 10:26:23,732 - lava_callback - INFO - Received callback for node 69b1420aa870a1dc3343c915 INFO: 172.21.0.1:43494 - "POST /node/69b1420aa870a1dc3343c915 HTTP/1.0" 202 Accepted 2026-03-11 10:26:23,739 - lava_callback - INFO - Starting async job submit for node 69b1420aa870a1dc3343c915 2026-03-11 10:26:23,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:23,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1420aa870a1dc3343c915 HTTP/1.1" 200 None 2026-03-11 10:26:23,788 - lava_callback - DEBUG - Processing node 69b1420aa870a1dc3343c915: baseline-arm64 2026-03-11 10:26:24,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:26:24,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:26:24,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1420aa870a1dc3343c915/log.txt.gz 2026-03-11 10:26:24,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:26:24,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:26:24,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1420aa870a1dc3343c915/lava-logs.yaml 2026-03-11 10:26:24,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:26:24,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:26:24,934 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b1420aa870a1dc3343c915/lava_callback.json.gz DEBUG: Setup failed for 69b1420aa870a1dc3343c915. Transitting job node result: incomplete -> fail 2026-03-11 10:26:25,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:25,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b1420aa870a1dc3343c915 HTTP/1.1" 200 None 2026-03-11 10:26:25,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:25,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:26:25,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:25,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b1420aa870a1dc3343c915 HTTP/1.1" 200 None 2026-03-11 10:26:25,140 - lava_callback - INFO - Completed processing callback for node 69b1420aa870a1dc3343c915 2026-03-11 10:26:25,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:26:25,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:33:55,472 - lava_callback - INFO - Received callback for node 69b14358a870a1dc3343c92c INFO: 172.21.0.1:42082 - "POST /node/69b14358a870a1dc3343c92c HTTP/1.0" 202 Accepted 2026-03-11 10:33:55,479 - lava_callback - INFO - Starting async job submit for node 69b14358a870a1dc3343c92c 2026-03-11 10:33:55,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:33:55,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14358a870a1dc3343c92c HTTP/1.1" 200 None 2026-03-11 10:33:55,530 - lava_callback - DEBUG - Processing node 69b14358a870a1dc3343c92c: baseline-arm64 2026-03-11 10:33:55,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:33:56,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:33:56,078 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14358a870a1dc3343c92c/log.txt.gz 2026-03-11 10:33:56,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:33:56,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:33:56,531 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14358a870a1dc3343c92c/lava-logs.yaml INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:33:56,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:33:56,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:33:56,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b14358a870a1dc3343c92c/lava_callback.json.gz DEBUG: Setup failed for 69b14358a870a1dc3343c92c. Transitting job node result: incomplete -> fail 2026-03-11 10:33:56,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:33:56,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14358a870a1dc3343c92c HTTP/1.1" 200 None 2026-03-11 10:33:56,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:33:56,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:33:56,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:33:56,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b14358a870a1dc3343c92c HTTP/1.1" 200 None 2026-03-11 10:33:57,006 - lava_callback - INFO - Completed processing callback for node 69b14358a870a1dc3343c92c INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:34:25,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:34:25,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43618 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:35:06,832 - lava_callback - INFO - Received callback for node 69b140c7a870a1dc3343c8dc INFO: 172.21.0.1:43630 - "POST /node/69b140c7a870a1dc3343c8dc HTTP/1.0" 202 Accepted 2026-03-11 10:35:06,881 - lava_callback - INFO - Starting async job submit for node 69b140c7a870a1dc3343c8dc 2026-03-11 10:35:06,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:35:06,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b140c7a870a1dc3343c8dc HTTP/1.1" 200 None 2026-03-11 10:35:06,922 - lava_callback - DEBUG - Processing node 69b140c7a870a1dc3343c8dc: baseline-arm-pengutronix 2026-03-11 10:35:07,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:35:07,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:35:07,187 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b140c7a870a1dc3343c8dc/log.txt.gz 2026-03-11 10:35:07,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:35:07,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:35:07,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b140c7a870a1dc3343c8dc/lava-logs.yaml 2026-03-11 10:35:07,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:35:07,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:35:07,571 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69b140c7a870a1dc3343c8dc/lava_callback.json.gz DEBUG: Setup failed for 69b140c7a870a1dc3343c8dc. Transitting job node result: incomplete -> fail 2026-03-11 10:35:07,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:35:07,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b140c7a870a1dc3343c8dc HTTP/1.1" 200 None 2026-03-11 10:35:07,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:35:07,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-11 10:35:07,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:35:07,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b140c7a870a1dc3343c8dc HTTP/1.1" 200 None 2026-03-11 10:35:07,721 - lava_callback - INFO - Completed processing callback for node 69b140c7a870a1dc3343c8dc INFO: 172.21.0.1:36396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36408 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:35:25,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:35:25,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55712 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 10:38:15,397 - lava_callback - INFO - Received callback for node 69b14174a870a1dc3343c8f9 INFO: 172.21.0.1:55718 - "POST /node/69b14174a870a1dc3343c8f9 HTTP/1.0" 202 Accepted 2026-03-11 10:38:15,405 - lava_callback - INFO - Starting async job submit for node 69b14174a870a1dc3343c8f9 2026-03-11 10:38:15,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:38:15,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14174a870a1dc3343c8f9 HTTP/1.1" 200 None 2026-03-11 10:38:15,485 - lava_callback - DEBUG - Processing node 69b14174a870a1dc3343c8f9: baseline-nfs-arm64 INFO: 172.21.0.1:55722 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:38:16,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:38:16,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:38:16,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14174a870a1dc3343c8f9/log.txt.gz 2026-03-11 10:38:17,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:38:17,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:38:17,711 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14174a870a1dc3343c8f9/lava-logs.yaml 2026-03-11 10:38:17,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:38:17,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:38:17,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14174a870a1dc3343c8f9/lava_callback.json.gz DEBUG: Setup failed for 69b14174a870a1dc3343c8f9. Transitting job node result: incomplete -> fail 2026-03-11 10:38:18,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:38:18,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14174a870a1dc3343c8f9 HTTP/1.1" 200 None 2026-03-11 10:38:18,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:38:18,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:38:18,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:38:18,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b14174a870a1dc3343c8f9 HTTP/1.1" 200 None 2026-03-11 10:38:18,181 - lava_callback - INFO - Completed processing callback for node 69b14174a870a1dc3343c8f9 2026-03-11 10:38:25,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:38:25,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40938 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:48:02,339 - lava_callback - INFO - Received callback for node 69aea553c660ead8a389bddc INFO: 172.21.0.1:49660 - "POST /node/69aea553c660ead8a389bddc HTTP/1.0" 202 Accepted 2026-03-11 10:48:02,345 - lava_callback - INFO - Starting async job submit for node 69aea553c660ead8a389bddc 2026-03-11 10:48:02,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:02,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea553c660ead8a389bddc HTTP/1.1" 200 None 2026-03-11 10:48:02,398 - lava_callback - DEBUG - Processing node 69aea553c660ead8a389bddc: baseline-arm-baylibre 2026-03-11 10:48:02,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea553c660ead8a389bddc 2026-03-11 10:48:02,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:02,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea553c660ead8a389bddc HTTP/1.1" 200 None 2026-03-11 10:48:02,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:02,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:48:02,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:02,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea553c660ead8a389bddc HTTP/1.1" 200 None 2026-03-11 10:48:02,505 - lava_callback - ERROR - Error processing callback for node 69aea553c660ead8a389bddc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36944 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:48:42,219 - lava_callback - INFO - Received callback for node 69aea57bc660ead8a389bde7 INFO: 172.21.0.1:50290 - "POST /node/69aea57bc660ead8a389bde7 HTTP/1.0" 202 Accepted 2026-03-11 10:48:42,224 - lava_callback - INFO - Starting async job submit for node 69aea57bc660ead8a389bde7 2026-03-11 10:48:42,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:42,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea57bc660ead8a389bde7 HTTP/1.1" 200 None 2026-03-11 10:48:42,246 - lava_callback - DEBUG - Processing node 69aea57bc660ead8a389bde7: baseline-arm-baylibre 2026-03-11 10:48:42,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea57bc660ead8a389bde7 2026-03-11 10:48:42,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:42,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea57bc660ead8a389bde7 HTTP/1.1" 200 None 2026-03-11 10:48:42,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:42,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:48:42,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:48:42,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea57bc660ead8a389bde7 HTTP/1.1" 200 None 2026-03-11 10:48:42,343 - lava_callback - ERROR - Error processing callback for node 69aea57bc660ead8a389bde7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:49:22,454 - lava_callback - INFO - Received callback for node 69aea5a5c660ead8a389bdf4 INFO: 172.21.0.1:45174 - "POST /node/69aea5a5c660ead8a389bdf4 HTTP/1.0" 202 Accepted 2026-03-11 10:49:22,460 - lava_callback - INFO - Starting async job submit for node 69aea5a5c660ead8a389bdf4 2026-03-11 10:49:22,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:49:22,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea5a5c660ead8a389bdf4 HTTP/1.1" 200 None 2026-03-11 10:49:22,476 - lava_callback - DEBUG - Processing node 69aea5a5c660ead8a389bdf4: baseline-arm-baylibre 2026-03-11 10:49:22,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea5a5c660ead8a389bdf4 2026-03-11 10:49:22,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:49:22,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea5a5c660ead8a389bdf4 HTTP/1.1" 200 None 2026-03-11 10:49:22,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:49:22,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:49:22,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:49:22,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea5a5c660ead8a389bdf4 HTTP/1.1" 200 None 2026-03-11 10:49:22,547 - lava_callback - ERROR - Error processing callback for node 69aea5a5c660ead8a389bdf4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:50:22,341 - lava_callback - INFO - Received callback for node 69aea5e2c660ead8a389be03 INFO: 172.21.0.1:34982 - "POST /node/69aea5e2c660ead8a389be03 HTTP/1.0" 202 Accepted 2026-03-11 10:50:22,347 - lava_callback - INFO - Starting async job submit for node 69aea5e2c660ead8a389be03 2026-03-11 10:50:22,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:50:22,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea5e2c660ead8a389be03 HTTP/1.1" 200 None 2026-03-11 10:50:22,363 - lava_callback - DEBUG - Processing node 69aea5e2c660ead8a389be03: baseline-arm-baylibre 2026-03-11 10:50:22,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea5e2c660ead8a389be03 2026-03-11 10:50:22,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:50:22,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea5e2c660ead8a389be03 HTTP/1.1" 200 None 2026-03-11 10:50:22,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:50:22,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:50:22,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:50:22,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea5e2c660ead8a389be03 HTTP/1.1" 200 None 2026-03-11 10:50:22,430 - lava_callback - ERROR - Error processing callback for node 69aea5e2c660ead8a389be03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51250 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:51:02,486 - lava_callback - INFO - Received callback for node 69aea60ac660ead8a389be0f INFO: 172.21.0.1:35756 - "POST /node/69aea60ac660ead8a389be0f HTTP/1.0" 202 Accepted 2026-03-11 10:51:02,491 - lava_callback - INFO - Starting async job submit for node 69aea60ac660ead8a389be0f 2026-03-11 10:51:02,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:02,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea60ac660ead8a389be0f HTTP/1.1" 200 None 2026-03-11 10:51:02,511 - lava_callback - DEBUG - Processing node 69aea60ac660ead8a389be0f: baseline-arm-baylibre 2026-03-11 10:51:02,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea60ac660ead8a389be0f 2026-03-11 10:51:02,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:02,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea60ac660ead8a389be0f HTTP/1.1" 200 None 2026-03-11 10:51:02,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:02,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:51:02,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:02,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea60ac660ead8a389be0f HTTP/1.1" 200 None 2026-03-11 10:51:02,567 - lava_callback - ERROR - Error processing callback for node 69aea60ac660ead8a389be0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:51:42,433 - lava_callback - INFO - Received callback for node 69aea631c660ead8a389be1b INFO: 172.21.0.1:41524 - "POST /node/69aea631c660ead8a389be1b HTTP/1.0" 202 Accepted 2026-03-11 10:51:42,440 - lava_callback - INFO - Starting async job submit for node 69aea631c660ead8a389be1b 2026-03-11 10:51:42,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:42,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea631c660ead8a389be1b HTTP/1.1" 200 None 2026-03-11 10:51:42,457 - lava_callback - DEBUG - Processing node 69aea631c660ead8a389be1b: baseline-arm-baylibre 2026-03-11 10:51:42,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea631c660ead8a389be1b 2026-03-11 10:51:42,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:42,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea631c660ead8a389be1b HTTP/1.1" 200 None 2026-03-11 10:51:42,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:42,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:51:42,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:51:42,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea631c660ead8a389be1b HTTP/1.1" 200 None 2026-03-11 10:51:42,528 - lava_callback - ERROR - Error processing callback for node 69aea631c660ead8a389be1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51834 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:52:18,073 - lava_callback - INFO - Received callback for node 69b141c9a870a1dc3343c906 INFO: 172.21.0.1:51840 - "POST /node/69b141c9a870a1dc3343c906 HTTP/1.0" 202 Accepted 2026-03-11 10:52:18,078 - lava_callback - INFO - Starting async job submit for node 69b141c9a870a1dc3343c906 2026-03-11 10:52:18,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:52:18,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b141c9a870a1dc3343c906 HTTP/1.1" 200 None 2026-03-11 10:52:18,113 - lava_callback - DEBUG - Processing node 69b141c9a870a1dc3343c906: baseline-arm64-broonie 2026-03-11 10:52:18,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:52:18,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:52:18,346 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b141c9a870a1dc3343c906/log.txt.gz 2026-03-11 10:52:18,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:52:18,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:52:18,570 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b141c9a870a1dc3343c906/lava-logs.yaml 2026-03-11 10:52:18,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:52:18,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:52:18,717 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69b141c9a870a1dc3343c906/lava_callback.json.gz 2026-03-11 10:52:18,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:52:18,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b141c9a870a1dc3343c906 HTTP/1.1" 200 None 2026-03-11 10:52:18,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:52:18,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b0b5149d19175818251feb HTTP/1.1" 200 None 2026-03-11 10:52:18,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:52:18,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b141c9a870a1dc3343c906 HTTP/1.1" 200 None 2026-03-11 10:52:18,847 - lava_callback - INFO - Completed processing callback for node 69b141c9a870a1dc3343c906 2026-03-11 10:52:25,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:52:25,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:53:46,481 - lava_callback - INFO - Received callback for node 69aea6adc660ead8a389be4a INFO: 172.21.0.1:44508 - "POST /node/69aea6adc660ead8a389be4a HTTP/1.0" 202 Accepted 2026-03-11 10:53:46,487 - lava_callback - INFO - Starting async job submit for node 69aea6adc660ead8a389be4a 2026-03-11 10:53:46,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:53:46,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6adc660ead8a389be4a HTTP/1.1" 200 None 2026-03-11 10:53:46,503 - lava_callback - DEBUG - Processing node 69aea6adc660ead8a389be4a: baseline-arm-clabbe 2026-03-11 10:53:46,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea6adc660ead8a389be4a 2026-03-11 10:53:46,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:53:46,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6adc660ead8a389be4a HTTP/1.1" 200 None 2026-03-11 10:53:46,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:53:46,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:53:46,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:53:46,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea6adc660ead8a389be4a HTTP/1.1" 200 None 2026-03-11 10:53:46,581 - lava_callback - ERROR - Error processing callback for node 69aea6adc660ead8a389be4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:54:26,436 - lava_callback - INFO - Received callback for node 69aea6d7c660ead8a389be5f INFO: 172.21.0.1:47506 - "POST /node/69aea6d7c660ead8a389be5f HTTP/1.0" 202 Accepted 2026-03-11 10:54:26,442 - lava_callback - INFO - Starting async job submit for node 69aea6d7c660ead8a389be5f 2026-03-11 10:54:26,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:54:26,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6d7c660ead8a389be5f HTTP/1.1" 200 None 2026-03-11 10:54:26,458 - lava_callback - DEBUG - Processing node 69aea6d7c660ead8a389be5f: baseline-arm-clabbe 2026-03-11 10:54:26,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea6d7c660ead8a389be5f 2026-03-11 10:54:26,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:54:26,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6d7c660ead8a389be5f HTTP/1.1" 200 None 2026-03-11 10:54:26,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:54:26,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:54:26,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47516 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:54:26,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea6d7c660ead8a389be5f HTTP/1.1" 200 None 2026-03-11 10:54:26,534 - lava_callback - ERROR - Error processing callback for node 69aea6d7c660ead8a389be5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:55:06,489 - lava_callback - INFO - Received callback for node 69aea6ffc660ead8a389be71 INFO: 172.21.0.1:44402 - "POST /node/69aea6ffc660ead8a389be71 HTTP/1.0" 202 Accepted 2026-03-11 10:55:06,494 - lava_callback - INFO - Starting async job submit for node 69aea6ffc660ead8a389be71 2026-03-11 10:55:06,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:55:06,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6ffc660ead8a389be71 HTTP/1.1" 200 None 2026-03-11 10:55:06,530 - lava_callback - DEBUG - Processing node 69aea6ffc660ead8a389be71: baseline-arm-clabbe 2026-03-11 10:55:06,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea6ffc660ead8a389be71 2026-03-11 10:55:06,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:55:06,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea6ffc660ead8a389be71 HTTP/1.1" 200 None 2026-03-11 10:55:06,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:55:06,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:55:06,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:55:06,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea6ffc660ead8a389be71 HTTP/1.1" 200 None 2026-03-11 10:55:06,592 - lava_callback - ERROR - Error processing callback for node 69aea6ffc660ead8a389be71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60804 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:57:06,594 - lava_callback - INFO - Received callback for node 69aea771c660ead8a389be8b INFO: 172.21.0.1:60814 - "POST /node/69aea771c660ead8a389be8b HTTP/1.0" 202 Accepted 2026-03-11 10:57:06,600 - lava_callback - INFO - Starting async job submit for node 69aea771c660ead8a389be8b 2026-03-11 10:57:06,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:06,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea771c660ead8a389be8b HTTP/1.1" 200 None 2026-03-11 10:57:06,641 - lava_callback - DEBUG - Processing node 69aea771c660ead8a389be8b: baseline-arm-clabbe 2026-03-11 10:57:06,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea771c660ead8a389be8b 2026-03-11 10:57:06,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:06,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea771c660ead8a389be8b HTTP/1.1" 200 None 2026-03-11 10:57:06,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:06,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:57:06,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:06,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea771c660ead8a389be8b HTTP/1.1" 200 None 2026-03-11 10:57:06,749 - lava_callback - ERROR - Error processing callback for node 69aea771c660ead8a389be8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44696 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:57:46,662 - lava_callback - INFO - Received callback for node 69aea799c660ead8a389be9a INFO: 172.21.0.1:44708 - "POST /node/69aea799c660ead8a389be9a HTTP/1.0" 202 Accepted 2026-03-11 10:57:46,667 - lava_callback - INFO - Starting async job submit for node 69aea799c660ead8a389be9a 2026-03-11 10:57:46,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:46,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea799c660ead8a389be9a HTTP/1.1" 200 None 2026-03-11 10:57:46,705 - lava_callback - DEBUG - Processing node 69aea799c660ead8a389be9a: baseline-arm-clabbe 2026-03-11 10:57:46,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aea799c660ead8a389be9a 2026-03-11 10:57:46,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:46,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aea799c660ead8a389be9a HTTP/1.1" 200 None 2026-03-11 10:57:46,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:46,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada13b8fc97e5ba07d4d75 HTTP/1.1" 200 None 2026-03-11 10:57:46,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:57:46,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aea799c660ead8a389be9a HTTP/1.1" 200 None 2026-03-11 10:57:46,775 - lava_callback - ERROR - Error processing callback for node 69aea799c660ead8a389be9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43418 - "GET / HTTP/1.0" 200 OK 2026-03-11 10:58:17,104 - lava_callback - INFO - Received callback for node 69b14623a870a1dc3343c950 INFO: 172.21.0.1:43432 - "POST /node/69b14623a870a1dc3343c950 HTTP/1.0" 202 Accepted 2026-03-11 10:58:17,112 - lava_callback - INFO - Starting async job submit for node 69b14623a870a1dc3343c950 2026-03-11 10:58:17,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:58:17,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14623a870a1dc3343c950 HTTP/1.1" 200 None 2026-03-11 10:58:17,189 - lava_callback - DEBUG - Processing node 69b14623a870a1dc3343c950: baseline-nfs-arm64 2026-03-11 10:58:18,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:58:18,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:58:18,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14623a870a1dc3343c950/log.txt.gz 2026-03-11 10:58:19,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:58:19,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:58:19,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14623a870a1dc3343c950/lava-logs.yaml 2026-03-11 10:58:19,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 10:58:19,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 10:58:19,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14623a870a1dc3343c950/lava_callback.json.gz DEBUG: Setup failed for 69b14623a870a1dc3343c950. Transitting job node result: incomplete -> fail 2026-03-11 10:58:19,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:58:19,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14623a870a1dc3343c950 HTTP/1.1" 200 None 2026-03-11 10:58:19,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:58:19,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 10:58:19,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:58:19,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b14623a870a1dc3343c950 HTTP/1.1" 200 None 2026-03-11 10:58:19,862 - lava_callback - INFO - Completed processing callback for node 69b14623a870a1dc3343c950 2026-03-11 10:58:25,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 10:58:26,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:08:43,703 - lava_callback - INFO - Received callback for node 69aeaa28c660ead8a389bf2f INFO: 172.21.0.1:52578 - "POST /node/69aeaa28c660ead8a389bf2f HTTP/1.0" 202 Accepted 2026-03-11 11:08:43,709 - lava_callback - INFO - Starting async job submit for node 69aeaa28c660ead8a389bf2f 2026-03-11 11:08:43,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:08:43,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaa28c660ead8a389bf2f HTTP/1.1" 200 None 2026-03-11 11:08:43,740 - lava_callback - DEBUG - Processing node 69aeaa28c660ead8a389bf2f: baseline-arm64-baylibre 2026-03-11 11:08:43,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeaa28c660ead8a389bf2f 2026-03-11 11:08:43,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:08:43,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaa28c660ead8a389bf2f HTTP/1.1" 200 None 2026-03-11 11:08:43,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:08:43,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:08:43,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:08:43,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeaa28c660ead8a389bf2f HTTP/1.1" 200 None 2026-03-11 11:08:43,829 - lava_callback - ERROR - Error processing callback for node 69aeaa28c660ead8a389bf2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:10:47,171 - lava_callback - INFO - Received callback for node 69aeaaa6c660ead8a389bf3a INFO: 172.21.0.1:59138 - "POST /node/69aeaaa6c660ead8a389bf3a HTTP/1.0" 202 Accepted 2026-03-11 11:10:47,177 - lava_callback - INFO - Starting async job submit for node 69aeaaa6c660ead8a389bf3a 2026-03-11 11:10:47,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:10:47,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaaa6c660ead8a389bf3a HTTP/1.1" 200 None 2026-03-11 11:10:47,199 - lava_callback - DEBUG - Processing node 69aeaaa6c660ead8a389bf3a: baseline-arm64-clabbe 2026-03-11 11:10:47,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeaaa6c660ead8a389bf3a 2026-03-11 11:10:47,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:10:47,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaaa6c660ead8a389bf3a HTTP/1.1" 200 None 2026-03-11 11:10:47,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:10:47,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:10:47,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:10:47,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeaaa6c660ead8a389bf3a HTTP/1.1" 200 None 2026-03-11 11:10:47,284 - lava_callback - ERROR - Error processing callback for node 69aeaaa6c660ead8a389bf3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:12:07,204 - lava_callback - INFO - Received callback for node 69aeaaf6c660ead8a389bf47 INFO: 172.21.0.1:49334 - "POST /node/69aeaaf6c660ead8a389bf47 HTTP/1.0" 202 Accepted 2026-03-11 11:12:07,210 - lava_callback - INFO - Starting async job submit for node 69aeaaf6c660ead8a389bf47 2026-03-11 11:12:07,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:12:07,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaaf6c660ead8a389bf47 HTTP/1.1" 200 None 2026-03-11 11:12:07,236 - lava_callback - DEBUG - Processing node 69aeaaf6c660ead8a389bf47: baseline-arm64-clabbe 2026-03-11 11:12:07,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeaaf6c660ead8a389bf47 2026-03-11 11:12:07,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:12:07,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeaaf6c660ead8a389bf47 HTTP/1.1" 200 None 2026-03-11 11:12:07,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:12:07,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:12:07,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:12:07,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeaaf6c660ead8a389bf47 HTTP/1.1" 200 None 2026-03-11 11:12:07,304 - lava_callback - ERROR - Error processing callback for node 69aeaaf6c660ead8a389bf47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:13:27,233 - lava_callback - INFO - Received callback for node 69aeab46c660ead8a389bf54 INFO: 172.21.0.1:44894 - "POST /node/69aeab46c660ead8a389bf54 HTTP/1.0" 202 Accepted 2026-03-11 11:13:27,238 - lava_callback - INFO - Starting async job submit for node 69aeab46c660ead8a389bf54 2026-03-11 11:13:27,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:13:27,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeab46c660ead8a389bf54 HTTP/1.1" 200 None 2026-03-11 11:13:27,259 - lava_callback - DEBUG - Processing node 69aeab46c660ead8a389bf54: baseline-arm64-clabbe 2026-03-11 11:13:27,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeab46c660ead8a389bf54 2026-03-11 11:13:27,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:13:27,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeab46c660ead8a389bf54 HTTP/1.1" 200 None 2026-03-11 11:13:27,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:13:27,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:13:27,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:13:27,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeab46c660ead8a389bf54 HTTP/1.1" 200 None 2026-03-11 11:13:27,339 - lava_callback - ERROR - Error processing callback for node 69aeab46c660ead8a389bf54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58834 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:14:47,307 - lava_callback - INFO - Received callback for node 69aeab96c660ead8a389bf5b INFO: 172.21.0.1:58850 - "POST /node/69aeab96c660ead8a389bf5b HTTP/1.0" 202 Accepted 2026-03-11 11:14:47,315 - lava_callback - INFO - Starting async job submit for node 69aeab96c660ead8a389bf5b 2026-03-11 11:14:47,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:14:47,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeab96c660ead8a389bf5b HTTP/1.1" 200 None 2026-03-11 11:14:47,338 - lava_callback - DEBUG - Processing node 69aeab96c660ead8a389bf5b: baseline-arm64-clabbe 2026-03-11 11:14:47,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeab96c660ead8a389bf5b 2026-03-11 11:14:47,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:14:47,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeab96c660ead8a389bf5b HTTP/1.1" 200 None 2026-03-11 11:14:47,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:14:47,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:14:47,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:14:47,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeab96c660ead8a389bf5b HTTP/1.1" 200 None 2026-03-11 11:14:47,439 - lava_callback - ERROR - Error processing callback for node 69aeab96c660ead8a389bf5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:16:07,374 - lava_callback - INFO - Received callback for node 69aeabe6c660ead8a389bf6b INFO: 172.21.0.1:32978 - "POST /node/69aeabe6c660ead8a389bf6b HTTP/1.0" 202 Accepted 2026-03-11 11:16:07,379 - lava_callback - INFO - Starting async job submit for node 69aeabe6c660ead8a389bf6b 2026-03-11 11:16:07,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:16:07,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeabe6c660ead8a389bf6b HTTP/1.1" 200 None 2026-03-11 11:16:07,397 - lava_callback - DEBUG - Processing node 69aeabe6c660ead8a389bf6b: baseline-arm64-clabbe 2026-03-11 11:16:07,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeabe6c660ead8a389bf6b 2026-03-11 11:16:07,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:16:07,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeabe6c660ead8a389bf6b HTTP/1.1" 200 None 2026-03-11 11:16:07,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:16:07,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ada1488fc97e5ba07d4d8d HTTP/1.1" 200 None 2026-03-11 11:16:07,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:16:07,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeabe6c660ead8a389bf6b HTTP/1.1" 200 None 2026-03-11 11:16:07,467 - lava_callback - ERROR - Error processing callback for node 69aeabe6c660ead8a389bf6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52148 - "GET / HTTP/1.0" 200 OK 2026-03-11 11:18:16,971 - lava_callback - INFO - Received callback for node 69b14ad5a870a1dc3343c987 INFO: 172.21.0.1:52162 - "POST /node/69b14ad5a870a1dc3343c987 HTTP/1.0" 202 Accepted 2026-03-11 11:18:16,979 - lava_callback - INFO - Starting async job submit for node 69b14ad5a870a1dc3343c987 2026-03-11 11:18:17,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:18:17,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14ad5a870a1dc3343c987 HTTP/1.1" 200 None 2026-03-11 11:18:17,047 - lava_callback - DEBUG - Processing node 69b14ad5a870a1dc3343c987: baseline-nfs-arm64 2026-03-11 11:18:18,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 11:18:18,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 11:18:18,340 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14ad5a870a1dc3343c987/log.txt.gz 2026-03-11 11:18:18,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 11:18:19,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 11:18:19,218 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14ad5a870a1dc3343c987/lava-logs.yaml 2026-03-11 11:18:19,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 11:18:19,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 11:18:19,438 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b14ad5a870a1dc3343c987/lava_callback.json.gz DEBUG: Setup failed for 69b14ad5a870a1dc3343c987. Transitting job node result: incomplete -> fail 2026-03-11 11:18:19,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:18:19,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b14ad5a870a1dc3343c987 HTTP/1.1" 200 None 2026-03-11 11:18:19,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:18:19,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 11:18:19,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:18:19,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b14ad5a870a1dc3343c987 HTTP/1.1" 200 None 2026-03-11 11:18:19,721 - lava_callback - INFO - Completed processing callback for node 69b14ad5a870a1dc3343c987 2026-03-11 11:18:26,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 11:18:26,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:34:20,256 - lava_callback - INFO - Received callback for node 69b13c6da870a1dc3343c5cd INFO: 172.21.0.1:58378 - "POST /node/69b13c6da870a1dc3343c5cd HTTP/1.0" 202 Accepted 2026-03-11 12:34:20,263 - lava_callback - INFO - Starting async job submit for node 69b13c6da870a1dc3343c5cd 2026-03-11 12:34:20,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:34:20,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6da870a1dc3343c5cd HTTP/1.1" 200 None 2026-03-11 12:34:20,357 - lava_callback - DEBUG - Processing node 69b13c6da870a1dc3343c5cd: baseline-arm64 2026-03-11 12:34:20,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:34:20,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:34:20,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6da870a1dc3343c5cd/log.txt.gz 2026-03-11 12:34:20,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:34:21,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:34:21,115 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6da870a1dc3343c5cd/lava-logs.yaml 2026-03-11 12:34:21,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:34:21,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:34:21,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69b13c6da870a1dc3343c5cd/lava_callback.json.gz 2026-03-11 12:34:21,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:34:21,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c6da870a1dc3343c5cd HTTP/1.1" 200 None 2026-03-11 12:34:21,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:34:21,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 12:34:21,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:34:21,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c6da870a1dc3343c5cd HTTP/1.1" 200 None 2026-03-11 12:34:21,351 - lava_callback - INFO - Completed processing callback for node 69b13c6da870a1dc3343c5cd 2026-03-11 12:34:26,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:34:26,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:35:27,923 - lava_callback - INFO - Received callback for node 69b13c81a870a1dc3343c605 INFO: 172.21.0.1:48130 - "POST /node/69b13c81a870a1dc3343c605 HTTP/1.0" 202 Accepted 2026-03-11 12:35:27,929 - lava_callback - INFO - Starting async job submit for node 69b13c81a870a1dc3343c605 2026-03-11 12:35:27,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:35:27,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c81a870a1dc3343c605 HTTP/1.1" 200 None 2026-03-11 12:35:27,973 - lava_callback - DEBUG - Processing node 69b13c81a870a1dc3343c605: baseline-nfs-arm64 2026-03-11 12:35:28,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:35:28,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:35:28,427 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c81a870a1dc3343c605/log.txt.gz 2026-03-11 12:35:28,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:35:28,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:35:28,859 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c81a870a1dc3343c605/lava-logs.yaml 2026-03-11 12:35:28,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-11 12:35:29,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-11 12:35:29,024 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69b13c81a870a1dc3343c605/lava_callback.json.gz 2026-03-11 12:35:29,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:35:29,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b13c81a870a1dc3343c605 HTTP/1.1" 200 None 2026-03-11 12:35:29,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:35:29,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-11 12:35:29,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:35:29,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b13c81a870a1dc3343c605 HTTP/1.1" 200 None 2026-03-11 12:35:29,803 - lava_callback - INFO - Completed processing callback for node 69b13c81a870a1dc3343c605 INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58766 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:35:56,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:35:56,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34698 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:46:48,846 - lava_callback - INFO - Received callback for node 69aec12ffeb96b28aa34ac37 INFO: 172.21.0.1:34702 - "POST /node/69aec12ffeb96b28aa34ac37 HTTP/1.0" 202 Accepted 2026-03-11 12:46:48,852 - lava_callback - INFO - Starting async job submit for node 69aec12ffeb96b28aa34ac37 2026-03-11 12:46:48,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:46:48,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec12ffeb96b28aa34ac37 HTTP/1.1" 200 None 2026-03-11 12:46:48,874 - lava_callback - DEBUG - Processing node 69aec12ffeb96b28aa34ac37: baseline-arm-baylibre 2026-03-11 12:46:48,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec12ffeb96b28aa34ac37 2026-03-11 12:46:48,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:46:48,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec12ffeb96b28aa34ac37 HTTP/1.1" 200 None 2026-03-11 12:46:48,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:46:48,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:46:48,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:46:48,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec12ffeb96b28aa34ac37 HTTP/1.1" 200 None 2026-03-11 12:46:48,939 - lava_callback - ERROR - Error processing callback for node 69aec12ffeb96b28aa34ac37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39110 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:47:28,759 - lava_callback - INFO - Received callback for node 69aec15afeb96b28aa34ac52 INFO: 172.21.0.1:39112 - "POST /node/69aec15afeb96b28aa34ac52 HTTP/1.0" 202 Accepted 2026-03-11 12:47:28,765 - lava_callback - INFO - Starting async job submit for node 69aec15afeb96b28aa34ac52 2026-03-11 12:47:28,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:28,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec15afeb96b28aa34ac52 HTTP/1.1" 200 None 2026-03-11 12:47:28,780 - lava_callback - DEBUG - Processing node 69aec15afeb96b28aa34ac52: baseline-arm-baylibre 2026-03-11 12:47:28,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec15afeb96b28aa34ac52 2026-03-11 12:47:28,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:28,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec15afeb96b28aa34ac52 HTTP/1.1" 200 None 2026-03-11 12:47:28,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:28,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:47:28,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:28,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec15afeb96b28aa34ac52 HTTP/1.1" 200 None 2026-03-11 12:47:28,840 - lava_callback - ERROR - Error processing callback for node 69aec15afeb96b28aa34ac52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48100 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:47:48,788 - lava_callback - INFO - Received callback for node 69aec164feb96b28aa34ac73 INFO: 172.21.0.1:48108 - "POST /node/69aec164feb96b28aa34ac73 HTTP/1.0" 202 Accepted 2026-03-11 12:47:48,793 - lava_callback - INFO - Starting async job submit for node 69aec164feb96b28aa34ac73 2026-03-11 12:47:48,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:48,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec164feb96b28aa34ac73 HTTP/1.1" 200 None 2026-03-11 12:47:48,818 - lava_callback - DEBUG - Processing node 69aec164feb96b28aa34ac73: baseline-arm-baylibre 2026-03-11 12:47:48,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec164feb96b28aa34ac73 2026-03-11 12:47:48,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:48,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec164feb96b28aa34ac73 HTTP/1.1" 200 None 2026-03-11 12:47:48,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:48,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:48,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:48,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec164feb96b28aa34ac73 HTTP/1.1" 200 None 2026-03-11 12:47:48,900 - lava_callback - ERROR - Error processing callback for node 69aec164feb96b28aa34ac73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:47:49,432 - lava_callback - INFO - Received callback for node 69aec166feb96b28aa34aca1 INFO: 172.21.0.1:48122 - "POST /node/69aec166feb96b28aa34aca1 HTTP/1.0" 202 Accepted 2026-03-11 12:47:49,438 - lava_callback - INFO - Starting async job submit for node 69aec166feb96b28aa34aca1 2026-03-11 12:47:49,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:49,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec166feb96b28aa34aca1 HTTP/1.1" 200 None 2026-03-11 12:47:49,453 - lava_callback - DEBUG - Processing node 69aec166feb96b28aa34aca1: baseline-arm-baylibre 2026-03-11 12:47:49,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec166feb96b28aa34aca1 2026-03-11 12:47:49,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:49,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec166feb96b28aa34aca1 HTTP/1.1" 200 None 2026-03-11 12:47:49,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:49,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:49,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:49,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec166feb96b28aa34aca1 HTTP/1.1" 200 None 2026-03-11 12:47:49,531 - lava_callback - ERROR - Error processing callback for node 69aec166feb96b28aa34aca1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:47:50,226 - lava_callback - INFO - Received callback for node 69aec167feb96b28aa34aca4 INFO: 172.21.0.1:57650 - "POST /node/69aec167feb96b28aa34aca4 HTTP/1.0" 202 Accepted 2026-03-11 12:47:50,231 - lava_callback - INFO - Starting async job submit for node 69aec167feb96b28aa34aca4 2026-03-11 12:47:50,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec167feb96b28aa34aca4 HTTP/1.1" 200 None 2026-03-11 12:47:50,247 - lava_callback - DEBUG - Processing node 69aec167feb96b28aa34aca4: baseline-arm-baylibre 2026-03-11 12:47:50,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec167feb96b28aa34aca4 2026-03-11 12:47:50,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec167feb96b28aa34aca4 HTTP/1.1" 200 None 2026-03-11 12:47:50,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:50,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec167feb96b28aa34aca4 HTTP/1.1" 200 None 2026-03-11 12:47:50,305 - lava_callback - ERROR - Error processing callback for node 69aec167feb96b28aa34aca4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:47:50,896 - lava_callback - INFO - Received callback for node 69aec16afeb96b28aa34acaf INFO: 172.21.0.1:57654 - "POST /node/69aec16afeb96b28aa34acaf HTTP/1.0" 202 Accepted 2026-03-11 12:47:50,902 - lava_callback - INFO - Starting async job submit for node 69aec16afeb96b28aa34acaf 2026-03-11 12:47:50,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec16afeb96b28aa34acaf HTTP/1.1" 200 None 2026-03-11 12:47:50,918 - lava_callback - DEBUG - Processing node 69aec16afeb96b28aa34acaf: baseline-arm-baylibre 2026-03-11 12:47:50,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec16afeb96b28aa34acaf 2026-03-11 12:47:50,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec16afeb96b28aa34acaf HTTP/1.1" 200 None 2026-03-11 12:47:50,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:50,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:50,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec16afeb96b28aa34acaf HTTP/1.1" 200 None 2026-03-11 12:47:50,978 - lava_callback - ERROR - Error processing callback for node 69aec16afeb96b28aa34acaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:47:51,354 - lava_callback - INFO - Received callback for node 69aec173feb96b28aa34acc6 INFO: 172.21.0.1:57668 - "POST /node/69aec173feb96b28aa34acc6 HTTP/1.0" 202 Accepted 2026-03-11 12:47:51,360 - lava_callback - INFO - Starting async job submit for node 69aec173feb96b28aa34acc6 2026-03-11 12:47:51,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec173feb96b28aa34acc6 HTTP/1.1" 200 None 2026-03-11 12:47:51,379 - lava_callback - DEBUG - Processing node 69aec173feb96b28aa34acc6: baseline-arm-clabbe 2026-03-11 12:47:51,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec173feb96b28aa34acc6 2026-03-11 12:47:51,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec173feb96b28aa34acc6 HTTP/1.1" 200 None 2026-03-11 12:47:51,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:51,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec173feb96b28aa34acc6 HTTP/1.1" 200 None 2026-03-11 12:47:51,446 - lava_callback - ERROR - Error processing callback for node 69aec173feb96b28aa34acc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:47:51,544 - lava_callback - INFO - Received callback for node 69aec16cfeb96b28aa34acb2 INFO: 172.21.0.1:57676 - "POST /node/69aec16cfeb96b28aa34acb2 HTTP/1.0" 202 Accepted 2026-03-11 12:47:51,563 - lava_callback - INFO - Starting async job submit for node 69aec16cfeb96b28aa34acb2 2026-03-11 12:47:51,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec16cfeb96b28aa34acb2 HTTP/1.1" 200 None 2026-03-11 12:47:51,584 - lava_callback - DEBUG - Processing node 69aec16cfeb96b28aa34acb2: baseline-arm-baylibre 2026-03-11 12:47:51,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec16cfeb96b28aa34acb2 2026-03-11 12:47:51,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec16cfeb96b28aa34acb2 HTTP/1.1" 200 None 2026-03-11 12:47:51,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:47:51,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:47:51,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec16cfeb96b28aa34acb2 HTTP/1.1" 200 None 2026-03-11 12:47:51,640 - lava_callback - ERROR - Error processing callback for node 69aec16cfeb96b28aa34acb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:48:08,781 - lava_callback - INFO - Received callback for node 69aec184feb96b28aa34ad40 INFO: 172.21.0.1:56178 - "POST /node/69aec184feb96b28aa34ad40 HTTP/1.0" 202 Accepted 2026-03-11 12:48:08,786 - lava_callback - INFO - Starting async job submit for node 69aec184feb96b28aa34ad40 2026-03-11 12:48:08,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:08,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec184feb96b28aa34ad40 HTTP/1.1" 200 None 2026-03-11 12:48:08,804 - lava_callback - DEBUG - Processing node 69aec184feb96b28aa34ad40: baseline-arm-baylibre 2026-03-11 12:48:08,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec184feb96b28aa34ad40 2026-03-11 12:48:08,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:08,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec184feb96b28aa34ad40 HTTP/1.1" 200 None 2026-03-11 12:48:08,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:08,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:48:08,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:08,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec184feb96b28aa34ad40 HTTP/1.1" 200 None 2026-03-11 12:48:08,862 - lava_callback - ERROR - Error processing callback for node 69aec184feb96b28aa34ad40: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:48:11,290 - lava_callback - INFO - Received callback for node 69aec178feb96b28aa34acd3 INFO: 172.21.0.1:41812 - "POST /node/69aec178feb96b28aa34acd3 HTTP/1.0" 202 Accepted 2026-03-11 12:48:11,296 - lava_callback - INFO - Starting async job submit for node 69aec178feb96b28aa34acd3 2026-03-11 12:48:11,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec178feb96b28aa34acd3 HTTP/1.1" 200 None 2026-03-11 12:48:11,312 - lava_callback - DEBUG - Processing node 69aec178feb96b28aa34acd3: baseline-arm-clabbe 2026-03-11 12:48:11,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec178feb96b28aa34acd3 2026-03-11 12:48:11,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec178feb96b28aa34acd3 HTTP/1.1" 200 None 2026-03-11 12:48:11,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:48:11,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec178feb96b28aa34acd3 HTTP/1.1" 200 None 2026-03-11 12:48:11,366 - lava_callback - ERROR - Error processing callback for node 69aec178feb96b28aa34acd3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:48:11,945 - lava_callback - INFO - Received callback for node 69aec178feb96b28aa34acd6 INFO: 172.21.0.1:41828 - "POST /node/69aec178feb96b28aa34acd6 HTTP/1.0" 202 Accepted 2026-03-11 12:48:11,950 - lava_callback - INFO - Starting async job submit for node 69aec178feb96b28aa34acd6 2026-03-11 12:48:11,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec178feb96b28aa34acd6 HTTP/1.1" 200 None 2026-03-11 12:48:11,967 - lava_callback - DEBUG - Processing node 69aec178feb96b28aa34acd6: baseline-arm-clabbe 2026-03-11 12:48:11,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec178feb96b28aa34acd6 2026-03-11 12:48:11,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec178feb96b28aa34acd6 HTTP/1.1" 200 None 2026-03-11 12:48:11,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:11,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:48:11,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:12,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec178feb96b28aa34acd6 HTTP/1.1" 200 None 2026-03-11 12:48:12,024 - lava_callback - ERROR - Error processing callback for node 69aec178feb96b28aa34acd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:48:12,593 - lava_callback - INFO - Received callback for node 69aec179feb96b28aa34acd9 INFO: 172.21.0.1:41836 - "POST /node/69aec179feb96b28aa34acd9 HTTP/1.0" 202 Accepted 2026-03-11 12:48:12,599 - lava_callback - INFO - Starting async job submit for node 69aec179feb96b28aa34acd9 2026-03-11 12:48:12,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:12,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec179feb96b28aa34acd9 HTTP/1.1" 200 None 2026-03-11 12:48:12,615 - lava_callback - DEBUG - Processing node 69aec179feb96b28aa34acd9: baseline-arm-clabbe 2026-03-11 12:48:12,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec179feb96b28aa34acd9 2026-03-11 12:48:12,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:12,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec179feb96b28aa34acd9 HTTP/1.1" 200 None 2026-03-11 12:48:12,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:12,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:48:12,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:12,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec179feb96b28aa34acd9 HTTP/1.1" 200 None 2026-03-11 12:48:12,669 - lava_callback - ERROR - Error processing callback for node 69aec179feb96b28aa34acd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 12:48:13,249 - lava_callback - INFO - Received callback for node 69aec17cfeb96b28aa34ad14 INFO: 172.21.0.1:41840 - "POST /node/69aec17cfeb96b28aa34ad14 HTTP/1.0" 202 Accepted 2026-03-11 12:48:13,254 - lava_callback - INFO - Starting async job submit for node 69aec17cfeb96b28aa34ad14 2026-03-11 12:48:13,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:13,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec17cfeb96b28aa34ad14 HTTP/1.1" 200 None 2026-03-11 12:48:13,270 - lava_callback - DEBUG - Processing node 69aec17cfeb96b28aa34ad14: baseline-arm-clabbe 2026-03-11 12:48:13,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec17cfeb96b28aa34ad14 2026-03-11 12:48:13,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:13,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec17cfeb96b28aa34ad14 HTTP/1.1" 200 None 2026-03-11 12:48:13,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:13,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-11 12:48:13,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:48:13,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec17cfeb96b28aa34ad14 HTTP/1.1" 200 None 2026-03-11 12:48:13,328 - lava_callback - ERROR - Error processing callback for node 69aec17cfeb96b28aa34ad14: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52492 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:49:49,470 - lava_callback - INFO - Received callback for node 69aec1ebfeb96b28aa34adfd INFO: 172.21.0.1:52494 - "POST /node/69aec1ebfeb96b28aa34adfd HTTP/1.0" 202 Accepted 2026-03-11 12:49:49,475 - lava_callback - INFO - Starting async job submit for node 69aec1ebfeb96b28aa34adfd 2026-03-11 12:49:49,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:49:49,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec1ebfeb96b28aa34adfd HTTP/1.1" 200 None 2026-03-11 12:49:49,492 - lava_callback - DEBUG - Processing node 69aec1ebfeb96b28aa34adfd: baseline-arm-baylibre 2026-03-11 12:49:49,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec1ebfeb96b28aa34adfd 2026-03-11 12:49:49,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:49:49,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec1ebfeb96b28aa34adfd HTTP/1.1" 200 None 2026-03-11 12:49:49,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:49:49,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:49:49,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:49:49,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec1ebfeb96b28aa34adfd HTTP/1.1" 200 None 2026-03-11 12:49:49,548 - lava_callback - ERROR - Error processing callback for node 69aec1ebfeb96b28aa34adfd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:55:29,188 - lava_callback - INFO - Received callback for node 69aec32dfeb96b28aa34afdf INFO: 172.21.0.1:39056 - "POST /node/69aec32dfeb96b28aa34afdf HTTP/1.0" 202 Accepted 2026-03-11 12:55:29,194 - lava_callback - INFO - Starting async job submit for node 69aec32dfeb96b28aa34afdf 2026-03-11 12:55:29,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:55:29,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec32dfeb96b28aa34afdf HTTP/1.1" 200 None 2026-03-11 12:55:29,211 - lava_callback - DEBUG - Processing node 69aec32dfeb96b28aa34afdf: baseline-arm-baylibre 2026-03-11 12:55:29,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec32dfeb96b28aa34afdf 2026-03-11 12:55:29,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:55:29,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec32dfeb96b28aa34afdf HTTP/1.1" 200 None 2026-03-11 12:55:29,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:55:29,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:55:29,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:55:29,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec32dfeb96b28aa34afdf HTTP/1.1" 200 None 2026-03-11 12:55:29,277 - lava_callback - ERROR - Error processing callback for node 69aec32dfeb96b28aa34afdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35070 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:58:51,796 - lava_callback - INFO - Received callback for node 69aec3f5feb96b28aa34b0be INFO: 172.21.0.1:48314 - "POST /node/69aec3f5feb96b28aa34b0be HTTP/1.0" 202 Accepted 2026-03-11 12:58:51,801 - lava_callback - INFO - Starting async job submit for node 69aec3f5feb96b28aa34b0be 2026-03-11 12:58:51,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:58:51,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec3f5feb96b28aa34b0be HTTP/1.1" 200 None 2026-03-11 12:58:51,822 - lava_callback - DEBUG - Processing node 69aec3f5feb96b28aa34b0be: baseline-arm-clabbe 2026-03-11 12:58:51,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec3f5feb96b28aa34b0be 2026-03-11 12:58:51,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:58:51,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec3f5feb96b28aa34b0be HTTP/1.1" 200 None 2026-03-11 12:58:51,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:58:51,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:58:51,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:58:51,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec3f5feb96b28aa34b0be HTTP/1.1" 200 None 2026-03-11 12:58:51,875 - lava_callback - ERROR - Error processing callback for node 69aec3f5feb96b28aa34b0be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60230 - "GET / HTTP/1.0" 200 OK 2026-03-11 12:59:31,802 - lava_callback - INFO - Received callback for node 69aec41efeb96b28aa34b10f INFO: 172.21.0.1:43904 - "POST /node/69aec41efeb96b28aa34b10f HTTP/1.0" 202 Accepted 2026-03-11 12:59:31,808 - lava_callback - INFO - Starting async job submit for node 69aec41efeb96b28aa34b10f 2026-03-11 12:59:31,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:59:31,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec41efeb96b28aa34b10f HTTP/1.1" 200 None 2026-03-11 12:59:31,825 - lava_callback - DEBUG - Processing node 69aec41efeb96b28aa34b10f: baseline-arm-clabbe 2026-03-11 12:59:31,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec41efeb96b28aa34b10f 2026-03-11 12:59:31,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:59:31,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec41efeb96b28aa34b10f HTTP/1.1" 200 None 2026-03-11 12:59:31,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:59:31,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 12:59:31,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 12:59:31,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec41efeb96b28aa34b10f HTTP/1.1" 200 None 2026-03-11 12:59:31,893 - lava_callback - ERROR - Error processing callback for node 69aec41efeb96b28aa34b10f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:00:12,049 - lava_callback - INFO - Received callback for node 69aec446feb96b28aa34b135 INFO: 172.21.0.1:36508 - "POST /node/69aec446feb96b28aa34b135 HTTP/1.0" 202 Accepted 2026-03-11 13:00:12,055 - lava_callback - INFO - Starting async job submit for node 69aec446feb96b28aa34b135 2026-03-11 13:00:12,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:00:12,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec446feb96b28aa34b135 HTTP/1.1" 200 None 2026-03-11 13:00:12,071 - lava_callback - DEBUG - Processing node 69aec446feb96b28aa34b135: baseline-arm-clabbe 2026-03-11 13:00:12,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec446feb96b28aa34b135 2026-03-11 13:00:12,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:00:12,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec446feb96b28aa34b135 HTTP/1.1" 200 None 2026-03-11 13:00:12,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:00:12,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 13:00:12,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:00:12,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec446feb96b28aa34b135 HTTP/1.1" 200 None 2026-03-11 13:00:12,143 - lava_callback - ERROR - Error processing callback for node 69aec446feb96b28aa34b135: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:01:49,638 - lava_callback - INFO - Received callback for node 69aec4b5feb96b28aa34b1d0 INFO: 172.21.0.1:52660 - "POST /node/69aec4b5feb96b28aa34b1d0 HTTP/1.0" 202 Accepted 2026-03-11 13:01:49,644 - lava_callback - INFO - Starting async job submit for node 69aec4b5feb96b28aa34b1d0 2026-03-11 13:01:49,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:01:49,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec4b5feb96b28aa34b1d0 HTTP/1.1" 200 None 2026-03-11 13:01:49,659 - lava_callback - DEBUG - Processing node 69aec4b5feb96b28aa34b1d0: baseline-arm-baylibre 2026-03-11 13:01:49,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec4b5feb96b28aa34b1d0 2026-03-11 13:01:49,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:01:49,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec4b5feb96b28aa34b1d0 HTTP/1.1" 200 None 2026-03-11 13:01:49,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:01:49,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:01:49,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:01:49,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec4b5feb96b28aa34b1d0 HTTP/1.1" 200 None 2026-03-11 13:01:49,724 - lava_callback - ERROR - Error processing callback for node 69aec4b5feb96b28aa34b1d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:02:31,978 - lava_callback - INFO - Received callback for node 69aec4e1feb96b28aa34b1ef INFO: 172.21.0.1:33590 - "POST /node/69aec4e1feb96b28aa34b1ef HTTP/1.0" 202 Accepted 2026-03-11 13:02:31,983 - lava_callback - INFO - Starting async job submit for node 69aec4e1feb96b28aa34b1ef 2026-03-11 13:02:31,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:02:32,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec4e1feb96b28aa34b1ef HTTP/1.1" 200 None 2026-03-11 13:02:32,018 - lava_callback - DEBUG - Processing node 69aec4e1feb96b28aa34b1ef: baseline-arm-clabbe 2026-03-11 13:02:32,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec4e1feb96b28aa34b1ef 2026-03-11 13:02:32,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:02:32,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec4e1feb96b28aa34b1ef HTTP/1.1" 200 None 2026-03-11 13:02:32,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:02:32,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 13:02:32,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:02:32,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec4e1feb96b28aa34b1ef HTTP/1.1" 200 None 2026-03-11 13:02:32,072 - lava_callback - ERROR - Error processing callback for node 69aec4e1feb96b28aa34b1ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44134 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:03:09,611 - lava_callback - INFO - Received callback for node 69aec503feb96b28aa34b215 INFO: 172.21.0.1:44148 - "POST /node/69aec503feb96b28aa34b215 HTTP/1.0" 202 Accepted 2026-03-11 13:03:09,616 - lava_callback - INFO - Starting async job submit for node 69aec503feb96b28aa34b215 2026-03-11 13:03:09,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:03:09,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec503feb96b28aa34b215 HTTP/1.1" 200 None 2026-03-11 13:03:09,633 - lava_callback - DEBUG - Processing node 69aec503feb96b28aa34b215: baseline-arm-baylibre 2026-03-11 13:03:09,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec503feb96b28aa34b215 2026-03-11 13:03:09,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:03:09,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec503feb96b28aa34b215 HTTP/1.1" 200 None 2026-03-11 13:03:09,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:03:09,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:03:09,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:03:09,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec503feb96b28aa34b215 HTTP/1.1" 200 None 2026-03-11 13:03:09,684 - lava_callback - ERROR - Error processing callback for node 69aec503feb96b28aa34b215: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:04:32,044 - lava_callback - INFO - Received callback for node 69aec555feb96b28aa34b291 INFO: 172.21.0.1:40300 - "POST /node/69aec555feb96b28aa34b291 HTTP/1.0" 202 Accepted 2026-03-11 13:04:32,049 - lava_callback - INFO - Starting async job submit for node 69aec555feb96b28aa34b291 2026-03-11 13:04:32,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:04:32,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec555feb96b28aa34b291 HTTP/1.1" 200 None 2026-03-11 13:04:32,081 - lava_callback - DEBUG - Processing node 69aec555feb96b28aa34b291: baseline-arm-clabbe 2026-03-11 13:04:32,081 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec555feb96b28aa34b291 2026-03-11 13:04:32,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:04:32,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec555feb96b28aa34b291 HTTP/1.1" 200 None 2026-03-11 13:04:32,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:04:32,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11668ef4424e487b2ea2 HTTP/1.1" 200 None 2026-03-11 13:04:32,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:04:32,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec555feb96b28aa34b291 HTTP/1.1" 200 None 2026-03-11 13:04:32,138 - lava_callback - ERROR - Error processing callback for node 69aec555feb96b28aa34b291: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:05:49,782 - lava_callback - INFO - Received callback for node 69aec59efeb96b28aa34b30d INFO: 172.21.0.1:36930 - "POST /node/69aec59efeb96b28aa34b30d HTTP/1.0" 202 Accepted 2026-03-11 13:05:49,788 - lava_callback - INFO - Starting async job submit for node 69aec59efeb96b28aa34b30d 2026-03-11 13:05:49,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:05:49,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec59efeb96b28aa34b30d HTTP/1.1" 200 None 2026-03-11 13:05:49,804 - lava_callback - DEBUG - Processing node 69aec59efeb96b28aa34b30d: baseline-arm-baylibre 2026-03-11 13:05:49,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec59efeb96b28aa34b30d 2026-03-11 13:05:49,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:05:49,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec59efeb96b28aa34b30d HTTP/1.1" 200 None 2026-03-11 13:05:49,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:05:49,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:05:49,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:05:49,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec59efeb96b28aa34b30d HTTP/1.1" 200 None 2026-03-11 13:05:49,856 - lava_callback - ERROR - Error processing callback for node 69aec59efeb96b28aa34b30d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:07:09,873 - lava_callback - INFO - Received callback for node 69aec5eefeb96b28aa34b352 INFO: 172.21.0.1:52542 - "POST /node/69aec5eefeb96b28aa34b352 HTTP/1.0" 202 Accepted 2026-03-11 13:07:09,878 - lava_callback - INFO - Starting async job submit for node 69aec5eefeb96b28aa34b352 2026-03-11 13:07:09,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:07:09,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec5eefeb96b28aa34b352 HTTP/1.1" 200 None 2026-03-11 13:07:09,924 - lava_callback - DEBUG - Processing node 69aec5eefeb96b28aa34b352: baseline-arm-baylibre 2026-03-11 13:07:09,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec5eefeb96b28aa34b352 2026-03-11 13:07:09,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:07:09,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec5eefeb96b28aa34b352 HTTP/1.1" 200 None 2026-03-11 13:07:09,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:07:09,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:07:09,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:07:10,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec5eefeb96b28aa34b352 HTTP/1.1" 200 None 2026-03-11 13:07:10,008 - lava_callback - ERROR - Error processing callback for node 69aec5eefeb96b28aa34b352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:09:10,023 - lava_callback - INFO - Received callback for node 69aec662feb96b28aa34b3f2 INFO: 172.21.0.1:47756 - "POST /node/69aec662feb96b28aa34b3f2 HTTP/1.0" 202 Accepted 2026-03-11 13:09:10,028 - lava_callback - INFO - Starting async job submit for node 69aec662feb96b28aa34b3f2 2026-03-11 13:09:10,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:09:10,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec662feb96b28aa34b3f2 HTTP/1.1" 200 None 2026-03-11 13:09:10,044 - lava_callback - DEBUG - Processing node 69aec662feb96b28aa34b3f2: baseline-arm-baylibre 2026-03-11 13:09:10,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec662feb96b28aa34b3f2 2026-03-11 13:09:10,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:09:10,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec662feb96b28aa34b3f2 HTTP/1.1" 200 None 2026-03-11 13:09:10,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:09:10,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:09:10,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:09:10,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec662feb96b28aa34b3f2 HTTP/1.1" 200 None 2026-03-11 13:09:10,132 - lava_callback - ERROR - Error processing callback for node 69aec662feb96b28aa34b3f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:12:52,433 - lava_callback - INFO - Received callback for node 69aec74dfeb96b28aa34b52b INFO: 172.21.0.1:41410 - "POST /node/69aec74dfeb96b28aa34b52b HTTP/1.0" 202 Accepted 2026-03-11 13:12:52,438 - lava_callback - INFO - Starting async job submit for node 69aec74dfeb96b28aa34b52b 2026-03-11 13:12:52,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:12:52,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec74dfeb96b28aa34b52b HTTP/1.1" 200 None 2026-03-11 13:12:52,456 - lava_callback - DEBUG - Processing node 69aec74dfeb96b28aa34b52b: baseline-arm-clabbe 2026-03-11 13:12:52,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec74dfeb96b28aa34b52b 2026-03-11 13:12:52,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:12:52,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec74dfeb96b28aa34b52b HTTP/1.1" 200 None 2026-03-11 13:12:52,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:12:52,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:12:52,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:12:52,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec74dfeb96b28aa34b52b HTTP/1.1" 200 None 2026-03-11 13:12:52,523 - lava_callback - ERROR - Error processing callback for node 69aec74dfeb96b28aa34b52b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:13:32,422 - lava_callback - INFO - Received callback for node 69aec778feb96b28aa34b54b INFO: 172.21.0.1:55016 - "POST /node/69aec778feb96b28aa34b54b HTTP/1.0" 202 Accepted 2026-03-11 13:13:32,427 - lava_callback - INFO - Starting async job submit for node 69aec778feb96b28aa34b54b 2026-03-11 13:13:32,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:13:32,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec778feb96b28aa34b54b HTTP/1.1" 200 None 2026-03-11 13:13:32,443 - lava_callback - DEBUG - Processing node 69aec778feb96b28aa34b54b: baseline-arm-clabbe 2026-03-11 13:13:32,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec778feb96b28aa34b54b 2026-03-11 13:13:32,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:13:32,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec778feb96b28aa34b54b HTTP/1.1" 200 None 2026-03-11 13:13:32,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:13:32,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:13:32,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:13:32,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec778feb96b28aa34b54b HTTP/1.1" 200 None 2026-03-11 13:13:32,514 - lava_callback - ERROR - Error processing callback for node 69aec778feb96b28aa34b54b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54670 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:15:32,488 - lava_callback - INFO - Received callback for node 69aec7e5feb96b28aa34b5ab INFO: 172.21.0.1:55460 - "POST /node/69aec7e5feb96b28aa34b5ab HTTP/1.0" 202 Accepted 2026-03-11 13:15:32,494 - lava_callback - INFO - Starting async job submit for node 69aec7e5feb96b28aa34b5ab 2026-03-11 13:15:32,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:15:32,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec7e5feb96b28aa34b5ab HTTP/1.1" 200 None 2026-03-11 13:15:32,510 - lava_callback - DEBUG - Processing node 69aec7e5feb96b28aa34b5ab: baseline-arm-clabbe 2026-03-11 13:15:32,510 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec7e5feb96b28aa34b5ab 2026-03-11 13:15:32,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:15:32,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec7e5feb96b28aa34b5ab HTTP/1.1" 200 None 2026-03-11 13:15:32,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:15:32,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:15:32,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:15:32,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec7e5feb96b28aa34b5ab HTTP/1.1" 200 None 2026-03-11 13:15:32,562 - lava_callback - ERROR - Error processing callback for node 69aec7e5feb96b28aa34b5ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:16:12,517 - lava_callback - INFO - Received callback for node 69aec80ffeb96b28aa34b5ca INFO: 172.21.0.1:50712 - "POST /node/69aec80ffeb96b28aa34b5ca HTTP/1.0" 202 Accepted 2026-03-11 13:16:12,523 - lava_callback - INFO - Starting async job submit for node 69aec80ffeb96b28aa34b5ca 2026-03-11 13:16:12,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:16:12,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec80ffeb96b28aa34b5ca HTTP/1.1" 200 None 2026-03-11 13:16:12,538 - lava_callback - DEBUG - Processing node 69aec80ffeb96b28aa34b5ca: baseline-arm-clabbe 2026-03-11 13:16:12,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec80ffeb96b28aa34b5ca 2026-03-11 13:16:12,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:16:12,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec80ffeb96b28aa34b5ca HTTP/1.1" 200 None 2026-03-11 13:16:12,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:16:12,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:16:12,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:16:12,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec80ffeb96b28aa34b5ca HTTP/1.1" 200 None 2026-03-11 13:16:12,596 - lava_callback - ERROR - Error processing callback for node 69aec80ffeb96b28aa34b5ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET /node/69a62d117da105ad098359ff%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35944 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:18:30,520 - lava_callback - INFO - Received callback for node 69aec899feb96b28aa34b6d5 INFO: 172.21.0.1:43246 - "POST /node/69aec899feb96b28aa34b6d5 HTTP/1.0" 202 Accepted 2026-03-11 13:18:30,526 - lava_callback - INFO - Starting async job submit for node 69aec899feb96b28aa34b6d5 2026-03-11 13:18:30,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:30,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec899feb96b28aa34b6d5 HTTP/1.1" 200 None 2026-03-11 13:18:30,545 - lava_callback - DEBUG - Processing node 69aec899feb96b28aa34b6d5: baseline-arm64-baylibre 2026-03-11 13:18:30,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec899feb96b28aa34b6d5 2026-03-11 13:18:30,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:30,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec899feb96b28aa34b6d5 HTTP/1.1" 200 None 2026-03-11 13:18:30,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:30,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:30,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:30,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec899feb96b28aa34b6d5 HTTP/1.1" 200 None 2026-03-11 13:18:30,596 - lava_callback - ERROR - Error processing callback for node 69aec899feb96b28aa34b6d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:31,165 - lava_callback - INFO - Received callback for node 69aec89afeb96b28aa34b6d8 INFO: 172.21.0.1:43260 - "POST /node/69aec89afeb96b28aa34b6d8 HTTP/1.0" 202 Accepted 2026-03-11 13:18:31,171 - lava_callback - INFO - Starting async job submit for node 69aec89afeb96b28aa34b6d8 2026-03-11 13:18:31,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89afeb96b28aa34b6d8 HTTP/1.1" 200 None 2026-03-11 13:18:31,186 - lava_callback - DEBUG - Processing node 69aec89afeb96b28aa34b6d8: baseline-arm64-baylibre 2026-03-11 13:18:31,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec89afeb96b28aa34b6d8 2026-03-11 13:18:31,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89afeb96b28aa34b6d8 HTTP/1.1" 200 None 2026-03-11 13:18:31,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:31,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec89afeb96b28aa34b6d8 HTTP/1.1" 200 None 2026-03-11 13:18:31,242 - lava_callback - ERROR - Error processing callback for node 69aec89afeb96b28aa34b6d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:31,839 - lava_callback - INFO - Received callback for node 69aec89bfeb96b28aa34b6db INFO: 172.21.0.1:43274 - "POST /node/69aec89bfeb96b28aa34b6db HTTP/1.0" 202 Accepted 2026-03-11 13:18:31,844 - lava_callback - INFO - Starting async job submit for node 69aec89bfeb96b28aa34b6db 2026-03-11 13:18:31,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89bfeb96b28aa34b6db HTTP/1.1" 200 None 2026-03-11 13:18:31,863 - lava_callback - DEBUG - Processing node 69aec89bfeb96b28aa34b6db: baseline-arm64-baylibre 2026-03-11 13:18:31,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec89bfeb96b28aa34b6db 2026-03-11 13:18:31,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89bfeb96b28aa34b6db HTTP/1.1" 200 None 2026-03-11 13:18:31,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:31,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:31,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec89bfeb96b28aa34b6db HTTP/1.1" 200 None 2026-03-11 13:18:31,921 - lava_callback - ERROR - Error processing callback for node 69aec89bfeb96b28aa34b6db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:32,496 - lava_callback - INFO - Received callback for node 69aec89dfeb96b28aa34b6e2 INFO: 172.21.0.1:43282 - "POST /node/69aec89dfeb96b28aa34b6e2 HTTP/1.0" 202 Accepted 2026-03-11 13:18:32,502 - lava_callback - INFO - Starting async job submit for node 69aec89dfeb96b28aa34b6e2 2026-03-11 13:18:32,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:32,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89dfeb96b28aa34b6e2 HTTP/1.1" 200 None 2026-03-11 13:18:32,528 - lava_callback - DEBUG - Processing node 69aec89dfeb96b28aa34b6e2: baseline-arm64-baylibre 2026-03-11 13:18:32,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec89dfeb96b28aa34b6e2 2026-03-11 13:18:32,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:32,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89dfeb96b28aa34b6e2 HTTP/1.1" 200 None 2026-03-11 13:18:32,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:32,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:32,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:32,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec89dfeb96b28aa34b6e2 HTTP/1.1" 200 None 2026-03-11 13:18:32,586 - lava_callback - ERROR - Error processing callback for node 69aec89dfeb96b28aa34b6e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:33,158 - lava_callback - INFO - Received callback for node 69aec89ffeb96b28aa34b6e5 INFO: 172.21.0.1:43296 - "POST /node/69aec89ffeb96b28aa34b6e5 HTTP/1.0" 202 Accepted 2026-03-11 13:18:33,163 - lava_callback - INFO - Starting async job submit for node 69aec89ffeb96b28aa34b6e5 2026-03-11 13:18:33,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89ffeb96b28aa34b6e5 HTTP/1.1" 200 None 2026-03-11 13:18:33,179 - lava_callback - DEBUG - Processing node 69aec89ffeb96b28aa34b6e5: baseline-arm64-baylibre 2026-03-11 13:18:33,179 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec89ffeb96b28aa34b6e5 2026-03-11 13:18:33,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec89ffeb96b28aa34b6e5 HTTP/1.1" 200 None 2026-03-11 13:18:33,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:33,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec89ffeb96b28aa34b6e5 HTTP/1.1" 200 None 2026-03-11 13:18:33,236 - lava_callback - ERROR - Error processing callback for node 69aec89ffeb96b28aa34b6e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:33,827 - lava_callback - INFO - Received callback for node 69aec8a0feb96b28aa34b6e8 INFO: 172.21.0.1:43300 - "POST /node/69aec8a0feb96b28aa34b6e8 HTTP/1.0" 202 Accepted 2026-03-11 13:18:33,832 - lava_callback - INFO - Starting async job submit for node 69aec8a0feb96b28aa34b6e8 2026-03-11 13:18:33,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a0feb96b28aa34b6e8 HTTP/1.1" 200 None 2026-03-11 13:18:33,848 - lava_callback - DEBUG - Processing node 69aec8a0feb96b28aa34b6e8: baseline-arm64-baylibre 2026-03-11 13:18:33,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8a0feb96b28aa34b6e8 2026-03-11 13:18:33,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a0feb96b28aa34b6e8 HTTP/1.1" 200 None 2026-03-11 13:18:33,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:33,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:33,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8a0feb96b28aa34b6e8 HTTP/1.1" 200 None 2026-03-11 13:18:33,904 - lava_callback - ERROR - Error processing callback for node 69aec8a0feb96b28aa34b6e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34116 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:18:52,684 - lava_callback - INFO - Received callback for node 69aec8b2feb96b28aa34b75c INFO: 172.21.0.1:43710 - "POST /node/69aec8b2feb96b28aa34b75c HTTP/1.0" 202 Accepted 2026-03-11 13:18:52,690 - lava_callback - INFO - Starting async job submit for node 69aec8b2feb96b28aa34b75c 2026-03-11 13:18:52,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:52,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b2feb96b28aa34b75c HTTP/1.1" 200 None 2026-03-11 13:18:52,711 - lava_callback - DEBUG - Processing node 69aec8b2feb96b28aa34b75c: baseline-arm64-clabbe 2026-03-11 13:18:52,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b2feb96b28aa34b75c 2026-03-11 13:18:52,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:52,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b2feb96b28aa34b75c HTTP/1.1" 200 None 2026-03-11 13:18:52,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:52,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:52,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:52,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b2feb96b28aa34b75c HTTP/1.1" 200 None 2026-03-11 13:18:52,777 - lava_callback - ERROR - Error processing callback for node 69aec8b2feb96b28aa34b75c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:53,334 - lava_callback - INFO - Received callback for node 69aec8b4feb96b28aa34b75f INFO: 172.21.0.1:43722 - "POST /node/69aec8b4feb96b28aa34b75f HTTP/1.0" 202 Accepted 2026-03-11 13:18:53,339 - lava_callback - INFO - Starting async job submit for node 69aec8b4feb96b28aa34b75f 2026-03-11 13:18:53,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:53,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b4feb96b28aa34b75f HTTP/1.1" 200 None 2026-03-11 13:18:53,357 - lava_callback - DEBUG - Processing node 69aec8b4feb96b28aa34b75f: baseline-arm64-clabbe 2026-03-11 13:18:53,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b4feb96b28aa34b75f 2026-03-11 13:18:53,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:53,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b4feb96b28aa34b75f HTTP/1.1" 200 None 2026-03-11 13:18:53,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:53,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:53,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:53,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b4feb96b28aa34b75f HTTP/1.1" 200 None 2026-03-11 13:18:53,427 - lava_callback - ERROR - Error processing callback for node 69aec8b4feb96b28aa34b75f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:53,996 - lava_callback - INFO - Received callback for node 69aec8b5feb96b28aa34b762 INFO: 172.21.0.1:43728 - "POST /node/69aec8b5feb96b28aa34b762 HTTP/1.0" 202 Accepted 2026-03-11 13:18:54,002 - lava_callback - INFO - Starting async job submit for node 69aec8b5feb96b28aa34b762 2026-03-11 13:18:54,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b5feb96b28aa34b762 HTTP/1.1" 200 None 2026-03-11 13:18:54,019 - lava_callback - DEBUG - Processing node 69aec8b5feb96b28aa34b762: baseline-arm64-clabbe 2026-03-11 13:18:54,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b5feb96b28aa34b762 2026-03-11 13:18:54,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b5feb96b28aa34b762 HTTP/1.1" 200 None 2026-03-11 13:18:54,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:54,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b5feb96b28aa34b762 HTTP/1.1" 200 None 2026-03-11 13:18:54,088 - lava_callback - ERROR - Error processing callback for node 69aec8b5feb96b28aa34b762: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:54,646 - lava_callback - INFO - Received callback for node 69aec8b6feb96b28aa34b765 INFO: 172.21.0.1:43738 - "POST /node/69aec8b6feb96b28aa34b765 HTTP/1.0" 202 Accepted 2026-03-11 13:18:54,652 - lava_callback - INFO - Starting async job submit for node 69aec8b6feb96b28aa34b765 2026-03-11 13:18:54,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b6feb96b28aa34b765 HTTP/1.1" 200 None 2026-03-11 13:18:54,668 - lava_callback - DEBUG - Processing node 69aec8b6feb96b28aa34b765: baseline-arm64-clabbe 2026-03-11 13:18:54,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b6feb96b28aa34b765 2026-03-11 13:18:54,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b6feb96b28aa34b765 HTTP/1.1" 200 None 2026-03-11 13:18:54,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:54,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:54,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b6feb96b28aa34b765 HTTP/1.1" 200 None 2026-03-11 13:18:54,729 - lava_callback - ERROR - Error processing callback for node 69aec8b6feb96b28aa34b765: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:55,306 - lava_callback - INFO - Received callback for node 69aec8b8feb96b28aa34b76e INFO: 172.21.0.1:43752 - "POST /node/69aec8b8feb96b28aa34b76e HTTP/1.0" 202 Accepted 2026-03-11 13:18:55,311 - lava_callback - INFO - Starting async job submit for node 69aec8b8feb96b28aa34b76e 2026-03-11 13:18:55,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:55,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b8feb96b28aa34b76e HTTP/1.1" 200 None 2026-03-11 13:18:55,330 - lava_callback - DEBUG - Processing node 69aec8b8feb96b28aa34b76e: baseline-arm64-clabbe 2026-03-11 13:18:55,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b8feb96b28aa34b76e 2026-03-11 13:18:55,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:55,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b8feb96b28aa34b76e HTTP/1.1" 200 None 2026-03-11 13:18:55,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:55,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:55,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:55,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b8feb96b28aa34b76e HTTP/1.1" 200 None 2026-03-11 13:18:55,391 - lava_callback - ERROR - Error processing callback for node 69aec8b8feb96b28aa34b76e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-11 13:18:55,967 - lava_callback - INFO - Received callback for node 69aec8b8feb96b28aa34b76b INFO: 172.21.0.1:43768 - "POST /node/69aec8b8feb96b28aa34b76b HTTP/1.0" 202 Accepted 2026-03-11 13:18:55,972 - lava_callback - INFO - Starting async job submit for node 69aec8b8feb96b28aa34b76b 2026-03-11 13:18:55,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:55,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b8feb96b28aa34b76b HTTP/1.1" 200 None 2026-03-11 13:18:55,988 - lava_callback - DEBUG - Processing node 69aec8b8feb96b28aa34b76b: baseline-arm64-clabbe 2026-03-11 13:18:55,988 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8b8feb96b28aa34b76b 2026-03-11 13:18:55,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:56,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b8feb96b28aa34b76b HTTP/1.1" 200 None 2026-03-11 13:18:56,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:56,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-11 13:18:56,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:18:56,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b8feb96b28aa34b76b HTTP/1.1" 200 None 2026-03-11 13:18:56,046 - lava_callback - ERROR - Error processing callback for node 69aec8b8feb96b28aa34b76b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:19:12,642 - lava_callback - INFO - Received callback for node 69aec8cdfeb96b28aa34b7c1 INFO: 172.21.0.1:55762 - "POST /node/69aec8cdfeb96b28aa34b7c1 HTTP/1.0" 202 Accepted 2026-03-11 13:19:12,648 - lava_callback - INFO - Starting async job submit for node 69aec8cdfeb96b28aa34b7c1 2026-03-11 13:19:12,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:19:12,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8cdfeb96b28aa34b7c1 HTTP/1.1" 200 None 2026-03-11 13:19:12,664 - lava_callback - DEBUG - Processing node 69aec8cdfeb96b28aa34b7c1: baseline-arm-clabbe 2026-03-11 13:19:12,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec8cdfeb96b28aa34b7c1 2026-03-11 13:19:12,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:19:12,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8cdfeb96b28aa34b7c1 HTTP/1.1" 200 None 2026-03-11 13:19:12,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:19:12,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:19:12,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:19:12,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8cdfeb96b28aa34b7c1 HTTP/1.1" 200 None 2026-03-11 13:19:12,726 - lava_callback - ERROR - Error processing callback for node 69aec8cdfeb96b28aa34b7c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33400 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:21:12,777 - lava_callback - INFO - Received callback for node 69aec945feb96b28aa34b8d6 INFO: 172.21.0.1:58286 - "POST /node/69aec945feb96b28aa34b8d6 HTTP/1.0" 202 Accepted 2026-03-11 13:21:12,782 - lava_callback - INFO - Starting async job submit for node 69aec945feb96b28aa34b8d6 2026-03-11 13:21:12,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:21:12,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec945feb96b28aa34b8d6 HTTP/1.1" 200 None 2026-03-11 13:21:12,798 - lava_callback - DEBUG - Processing node 69aec945feb96b28aa34b8d6: baseline-arm-clabbe 2026-03-11 13:21:12,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aec945feb96b28aa34b8d6 2026-03-11 13:21:12,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:21:12,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec945feb96b28aa34b8d6 HTTP/1.1" 200 None 2026-03-11 13:21:12,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:21:12,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:21:12,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:21:12,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec945feb96b28aa34b8d6 HTTP/1.1" 200 None 2026-03-11 13:21:12,857 - lava_callback - ERROR - Error processing callback for node 69aec945feb96b28aa34b8d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41700 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:25:32,912 - lava_callback - INFO - Received callback for node 69aeca3bfeb96b28aa34ba19 INFO: 172.21.0.1:48980 - "POST /node/69aeca3bfeb96b28aa34ba19 HTTP/1.0" 202 Accepted 2026-03-11 13:25:32,918 - lava_callback - INFO - Starting async job submit for node 69aeca3bfeb96b28aa34ba19 2026-03-11 13:25:32,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:25:32,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca3bfeb96b28aa34ba19 HTTP/1.1" 200 None 2026-03-11 13:25:32,934 - lava_callback - DEBUG - Processing node 69aeca3bfeb96b28aa34ba19: baseline-arm-clabbe 2026-03-11 13:25:32,934 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeca3bfeb96b28aa34ba19 2026-03-11 13:25:32,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:25:32,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca3bfeb96b28aa34ba19 HTTP/1.1" 200 None 2026-03-11 13:25:32,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:25:32,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:25:32,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:25:32,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeca3bfeb96b28aa34ba19 HTTP/1.1" 200 None 2026-03-11 13:25:33,002 - lava_callback - ERROR - Error processing callback for node 69aeca3bfeb96b28aa34ba19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:26:12,935 - lava_callback - INFO - Received callback for node 69aeca64feb96b28aa34ba3d INFO: 172.21.0.1:47068 - "POST /node/69aeca64feb96b28aa34ba3d HTTP/1.0" 202 Accepted 2026-03-11 13:26:12,941 - lava_callback - INFO - Starting async job submit for node 69aeca64feb96b28aa34ba3d 2026-03-11 13:26:12,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:26:12,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca64feb96b28aa34ba3d HTTP/1.1" 200 None 2026-03-11 13:26:12,957 - lava_callback - DEBUG - Processing node 69aeca64feb96b28aa34ba3d: baseline-arm-clabbe 2026-03-11 13:26:12,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeca64feb96b28aa34ba3d 2026-03-11 13:26:12,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:26:12,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca64feb96b28aa34ba3d HTTP/1.1" 200 None 2026-03-11 13:26:12,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:26:12,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:26:12,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:26:13,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeca64feb96b28aa34ba3d HTTP/1.1" 200 None 2026-03-11 13:26:13,023 - lava_callback - ERROR - Error processing callback for node 69aeca64feb96b28aa34ba3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:27:33,009 - lava_callback - INFO - Received callback for node 69aecab5feb96b28aa34bab5 INFO: 172.21.0.1:46272 - "POST /node/69aecab5feb96b28aa34bab5 HTTP/1.0" 202 Accepted 2026-03-11 13:27:33,014 - lava_callback - INFO - Starting async job submit for node 69aecab5feb96b28aa34bab5 2026-03-11 13:27:33,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:27:33,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecab5feb96b28aa34bab5 HTTP/1.1" 200 None 2026-03-11 13:27:33,036 - lava_callback - DEBUG - Processing node 69aecab5feb96b28aa34bab5: baseline-arm-clabbe 2026-03-11 13:27:33,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aecab5feb96b28aa34bab5 2026-03-11 13:27:33,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:27:33,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecab5feb96b28aa34bab5 HTTP/1.1" 200 None 2026-03-11 13:27:33,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:27:33,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-11 13:27:33,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:27:33,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecab5feb96b28aa34bab5 HTTP/1.1" 200 None 2026-03-11 13:27:33,088 - lava_callback - ERROR - Error processing callback for node 69aecab5feb96b28aa34bab5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:31:31,720 - lava_callback - INFO - Received callback for node 69aecba6feb96b28aa34bbfe INFO: 172.21.0.1:38912 - "POST /node/69aecba6feb96b28aa34bbfe HTTP/1.0" 202 Accepted 2026-03-11 13:31:31,725 - lava_callback - INFO - Starting async job submit for node 69aecba6feb96b28aa34bbfe 2026-03-11 13:31:31,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:31:31,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecba6feb96b28aa34bbfe HTTP/1.1" 200 None 2026-03-11 13:31:31,743 - lava_callback - DEBUG - Processing node 69aecba6feb96b28aa34bbfe: baseline-arm64-baylibre 2026-03-11 13:31:31,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aecba6feb96b28aa34bbfe 2026-03-11 13:31:31,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:31:31,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecba6feb96b28aa34bbfe HTTP/1.1" 200 None 2026-03-11 13:31:31,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:31:31,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 13:31:31,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:31:31,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecba6feb96b28aa34bbfe HTTP/1.1" 200 None 2026-03-11 13:31:31,811 - lava_callback - ERROR - Error processing callback for node 69aecba6feb96b28aa34bbfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:32:51,157 - lava_callback - INFO - Received callback for node 69aecbf7feb96b28aa34bc0d INFO: 172.21.0.1:50102 - "POST /node/69aecbf7feb96b28aa34bc0d HTTP/1.0" 202 Accepted 2026-03-11 13:32:51,163 - lava_callback - INFO - Starting async job submit for node 69aecbf7feb96b28aa34bc0d 2026-03-11 13:32:51,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:32:51,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecbf7feb96b28aa34bc0d HTTP/1.1" 200 None 2026-03-11 13:32:51,179 - lava_callback - DEBUG - Processing node 69aecbf7feb96b28aa34bc0d: baseline-arm64-baylibre 2026-03-11 13:32:51,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aecbf7feb96b28aa34bc0d 2026-03-11 13:32:51,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:32:51,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecbf7feb96b28aa34bc0d HTTP/1.1" 200 None 2026-03-11 13:32:51,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:32:51,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 13:32:51,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:32:51,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecbf7feb96b28aa34bc0d HTTP/1.1" 200 None 2026-03-11 13:32:51,240 - lava_callback - ERROR - Error processing callback for node 69aecbf7feb96b28aa34bc0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:34:11,248 - lava_callback - INFO - Received callback for node 69aecc48feb96b28aa34bc19 INFO: 172.21.0.1:58198 - "POST /node/69aecc48feb96b28aa34bc19 HTTP/1.0" 202 Accepted 2026-03-11 13:34:11,253 - lava_callback - INFO - Starting async job submit for node 69aecc48feb96b28aa34bc19 2026-03-11 13:34:11,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:34:11,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecc48feb96b28aa34bc19 HTTP/1.1" 200 None 2026-03-11 13:34:11,274 - lava_callback - DEBUG - Processing node 69aecc48feb96b28aa34bc19: baseline-arm64-baylibre 2026-03-11 13:34:11,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aecc48feb96b28aa34bc19 2026-03-11 13:34:11,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:34:11,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecc48feb96b28aa34bc19 HTTP/1.1" 200 None 2026-03-11 13:34:11,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:34:11,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 13:34:11,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:34:11,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecc48feb96b28aa34bc19 HTTP/1.1" 200 None 2026-03-11 13:34:11,327 - lava_callback - ERROR - Error processing callback for node 69aecc48feb96b28aa34bc19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK 2026-03-11 13:51:32,279 - lava_callback - INFO - Received callback for node 69aed059feb96b28aa34bd0d INFO: 172.21.0.1:51932 - "POST /node/69aed059feb96b28aa34bd0d HTTP/1.0" 202 Accepted 2026-03-11 13:51:32,284 - lava_callback - INFO - Starting async job submit for node 69aed059feb96b28aa34bd0d 2026-03-11 13:51:32,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:51:32,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed059feb96b28aa34bd0d HTTP/1.1" 200 None 2026-03-11 13:51:32,301 - lava_callback - DEBUG - Processing node 69aed059feb96b28aa34bd0d: baseline-arm64-baylibre 2026-03-11 13:51:32,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed059feb96b28aa34bd0d 2026-03-11 13:51:32,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:51:32,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed059feb96b28aa34bd0d HTTP/1.1" 200 None 2026-03-11 13:51:32,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:51:32,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 13:51:32,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 13:51:32,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed059feb96b28aa34bd0d HTTP/1.1" 200 None 2026-03-11 13:51:32,359 - lava_callback - ERROR - Error processing callback for node 69aed059feb96b28aa34bd0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37464 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:15:34,204 - lava_callback - INFO - Received callback for node 69aed604feb96b28aa34bdef INFO: 172.21.0.1:42034 - "POST /node/69aed604feb96b28aa34bdef HTTP/1.0" 202 Accepted 2026-03-11 14:15:34,210 - lava_callback - INFO - Starting async job submit for node 69aed604feb96b28aa34bdef 2026-03-11 14:15:34,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:15:34,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed604feb96b28aa34bdef HTTP/1.1" 200 None 2026-03-11 14:15:34,232 - lava_callback - DEBUG - Processing node 69aed604feb96b28aa34bdef: baseline-arm64-baylibre 2026-03-11 14:15:34,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed604feb96b28aa34bdef 2026-03-11 14:15:34,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:15:34,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed604feb96b28aa34bdef HTTP/1.1" 200 None 2026-03-11 14:15:34,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:15:34,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 14:15:34,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:15:34,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed604feb96b28aa34bdef HTTP/1.1" 200 None 2026-03-11 14:15:34,295 - lava_callback - ERROR - Error processing callback for node 69aed604feb96b28aa34bdef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:18:33,723 - lava_callback - INFO - Received callback for node 69aed6a4feb96b28aa34be09 INFO: 172.21.0.1:42736 - "POST /node/69aed6a4feb96b28aa34be09 HTTP/1.0" 202 Accepted 2026-03-11 14:18:33,729 - lava_callback - INFO - Starting async job submit for node 69aed6a4feb96b28aa34be09 2026-03-11 14:18:33,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:18:33,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed6a4feb96b28aa34be09 HTTP/1.1" 200 None 2026-03-11 14:18:33,745 - lava_callback - DEBUG - Processing node 69aed6a4feb96b28aa34be09: baseline-arm64-baylibre 2026-03-11 14:18:33,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed6a4feb96b28aa34be09 2026-03-11 14:18:33,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:18:33,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed6a4feb96b28aa34be09 HTTP/1.1" 200 None 2026-03-11 14:18:33,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:18:33,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-11 14:18:33,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:18:33,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed6a4feb96b28aa34be09 HTTP/1.1" 200 None 2026-03-11 14:18:33,843 - lava_callback - ERROR - Error processing callback for node 69aed6a4feb96b28aa34be09: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:20:53,960 - lava_callback - INFO - Received callback for node 69aed73efeb96b28aa34be2b INFO: 172.21.0.1:39502 - "POST /node/69aed73efeb96b28aa34be2b HTTP/1.0" 202 Accepted 2026-03-11 14:20:53,965 - lava_callback - INFO - Starting async job submit for node 69aed73efeb96b28aa34be2b 2026-03-11 14:20:53,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:20:53,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed73efeb96b28aa34be2b HTTP/1.1" 200 None 2026-03-11 14:20:53,997 - lava_callback - DEBUG - Processing node 69aed73efeb96b28aa34be2b: baseline-arm64-baylibre 2026-03-11 14:20:53,998 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed73efeb96b28aa34be2b 2026-03-11 14:20:53,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:20:54,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed73efeb96b28aa34be2b HTTP/1.1" 200 None 2026-03-11 14:20:54,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:20:54,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:20:54,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:20:54,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed73efeb96b28aa34be2b HTTP/1.1" 200 None 2026-03-11 14:20:54,085 - lava_callback - ERROR - Error processing callback for node 69aed73efeb96b28aa34be2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:22:13,845 - lava_callback - INFO - Received callback for node 69aed78dfeb96b28aa34be44 INFO: 172.21.0.1:35248 - "POST /node/69aed78dfeb96b28aa34be44 HTTP/1.0" 202 Accepted 2026-03-11 14:22:13,851 - lava_callback - INFO - Starting async job submit for node 69aed78dfeb96b28aa34be44 2026-03-11 14:22:13,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:22:13,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed78dfeb96b28aa34be44 HTTP/1.1" 200 None 2026-03-11 14:22:13,891 - lava_callback - DEBUG - Processing node 69aed78dfeb96b28aa34be44: baseline-arm64-baylibre 2026-03-11 14:22:13,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed78dfeb96b28aa34be44 2026-03-11 14:22:13,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:22:13,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed78dfeb96b28aa34be44 HTTP/1.1" 200 None 2026-03-11 14:22:13,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:22:13,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:22:13,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:22:13,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed78dfeb96b28aa34be44 HTTP/1.1" 200 None 2026-03-11 14:22:13,973 - lava_callback - ERROR - Error processing callback for node 69aed78dfeb96b28aa34be44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58542 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:23:34,230 - lava_callback - INFO - Received callback for node 69aed7dcfeb96b28aa34be4d INFO: 172.21.0.1:50798 - "POST /node/69aed7dcfeb96b28aa34be4d HTTP/1.0" 202 Accepted 2026-03-11 14:23:34,235 - lava_callback - INFO - Starting async job submit for node 69aed7dcfeb96b28aa34be4d 2026-03-11 14:23:34,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:23:34,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed7dcfeb96b28aa34be4d HTTP/1.1" 200 None 2026-03-11 14:23:34,251 - lava_callback - DEBUG - Processing node 69aed7dcfeb96b28aa34be4d: baseline-arm64-baylibre 2026-03-11 14:23:34,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed7dcfeb96b28aa34be4d 2026-03-11 14:23:34,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:23:34,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed7dcfeb96b28aa34be4d HTTP/1.1" 200 None 2026-03-11 14:23:34,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:23:34,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:23:34,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:23:34,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed7dcfeb96b28aa34be4d HTTP/1.1" 200 None 2026-03-11 14:23:34,340 - lava_callback - ERROR - Error processing callback for node 69aed7dcfeb96b28aa34be4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:30:14,409 - lava_callback - INFO - Received callback for node 69aed962feb96b28aa34be84 INFO: 172.21.0.1:42092 - "POST /node/69aed962feb96b28aa34be84 HTTP/1.0" 202 Accepted 2026-03-11 14:30:14,415 - lava_callback - INFO - Starting async job submit for node 69aed962feb96b28aa34be84 2026-03-11 14:30:14,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:30:14,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed962feb96b28aa34be84 HTTP/1.1" 200 None 2026-03-11 14:30:14,431 - lava_callback - DEBUG - Processing node 69aed962feb96b28aa34be84: baseline-arm64-baylibre 2026-03-11 14:30:14,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed962feb96b28aa34be84 2026-03-11 14:30:14,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:30:14,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed962feb96b28aa34be84 HTTP/1.1" 200 None 2026-03-11 14:30:14,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:30:14,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:30:14,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:30:14,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed962feb96b28aa34be84 HTTP/1.1" 200 None 2026-03-11 14:30:14,490 - lava_callback - ERROR - Error processing callback for node 69aed962feb96b28aa34be84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57826 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:31:14,359 - lava_callback - INFO - Received callback for node 69aed9affeb96b28aa34be8f INFO: 172.21.0.1:60320 - "POST /node/69aed9affeb96b28aa34be8f HTTP/1.0" 202 Accepted 2026-03-11 14:31:14,364 - lava_callback - INFO - Starting async job submit for node 69aed9affeb96b28aa34be8f 2026-03-11 14:31:14,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:31:14,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed9affeb96b28aa34be8f HTTP/1.1" 200 None 2026-03-11 14:31:14,406 - lava_callback - DEBUG - Processing node 69aed9affeb96b28aa34be8f: baseline-arm64-baylibre 2026-03-11 14:31:14,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed9affeb96b28aa34be8f 2026-03-11 14:31:14,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:31:14,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed9affeb96b28aa34be8f HTTP/1.1" 200 None 2026-03-11 14:31:14,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:31:14,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:31:14,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:31:14,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed9affeb96b28aa34be8f HTTP/1.1" 200 None 2026-03-11 14:31:14,534 - lava_callback - ERROR - Error processing callback for node 69aed9affeb96b28aa34be8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38940 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:32:34,615 - lava_callback - INFO - Received callback for node 69aed9f9feb96b28aa34be94 INFO: 172.21.0.1:49578 - "POST /node/69aed9f9feb96b28aa34be94 HTTP/1.0" 202 Accepted 2026-03-11 14:32:34,620 - lava_callback - INFO - Starting async job submit for node 69aed9f9feb96b28aa34be94 2026-03-11 14:32:34,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:32:34,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed9f9feb96b28aa34be94 HTTP/1.1" 200 None 2026-03-11 14:32:34,670 - lava_callback - DEBUG - Processing node 69aed9f9feb96b28aa34be94: baseline-arm64-baylibre 2026-03-11 14:32:34,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aed9f9feb96b28aa34be94 2026-03-11 14:32:34,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:32:34,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed9f9feb96b28aa34be94 HTTP/1.1" 200 None 2026-03-11 14:32:34,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:32:34,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:32:34,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:32:34,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed9f9feb96b28aa34be94 HTTP/1.1" 200 None 2026-03-11 14:32:34,749 - lava_callback - ERROR - Error processing callback for node 69aed9f9feb96b28aa34be94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:33:54,547 - lava_callback - INFO - Received callback for node 69aeda46feb96b28aa34be9e INFO: 172.21.0.1:52482 - "POST /node/69aeda46feb96b28aa34be9e HTTP/1.0" 202 Accepted 2026-03-11 14:33:54,553 - lava_callback - INFO - Starting async job submit for node 69aeda46feb96b28aa34be9e 2026-03-11 14:33:54,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:33:54,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeda46feb96b28aa34be9e HTTP/1.1" 200 None 2026-03-11 14:33:54,571 - lava_callback - DEBUG - Processing node 69aeda46feb96b28aa34be9e: baseline-arm64-baylibre 2026-03-11 14:33:54,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeda46feb96b28aa34be9e 2026-03-11 14:33:54,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:33:54,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeda46feb96b28aa34be9e HTTP/1.1" 200 None 2026-03-11 14:33:54,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:33:54,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:33:54,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:33:54,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeda46feb96b28aa34be9e HTTP/1.1" 200 None 2026-03-11 14:33:54,637 - lava_callback - ERROR - Error processing callback for node 69aeda46feb96b28aa34be9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 14:35:16,034 - lava_callback - INFO - Received callback for node 69aeda9cfeb96b28aa34bea9 INFO: 172.21.0.1:58492 - "POST /node/69aeda9cfeb96b28aa34bea9 HTTP/1.0" 202 Accepted 2026-03-11 14:35:16,039 - lava_callback - INFO - Starting async job submit for node 69aeda9cfeb96b28aa34bea9 2026-03-11 14:35:16,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:35:16,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeda9cfeb96b28aa34bea9 HTTP/1.1" 200 None 2026-03-11 14:35:16,056 - lava_callback - DEBUG - Processing node 69aeda9cfeb96b28aa34bea9: baseline-arm64-clabbe 2026-03-11 14:35:16,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeda9cfeb96b28aa34bea9 2026-03-11 14:35:16,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:35:16,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeda9cfeb96b28aa34bea9 HTTP/1.1" 200 None 2026-03-11 14:35:16,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:35:16,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:35:16,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:35:16,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeda9cfeb96b28aa34bea9 HTTP/1.1" 200 None 2026-03-11 14:35:16,118 - lava_callback - ERROR - Error processing callback for node 69aeda9cfeb96b28aa34bea9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38964 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:36:37,094 - lava_callback - INFO - Received callback for node 69aedaebfeb96b28aa34bebe INFO: 172.21.0.1:38980 - "POST /node/69aedaebfeb96b28aa34bebe HTTP/1.0" 202 Accepted 2026-03-11 14:36:37,099 - lava_callback - INFO - Starting async job submit for node 69aedaebfeb96b28aa34bebe 2026-03-11 14:36:37,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:36:37,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedaebfeb96b28aa34bebe HTTP/1.1" 200 None 2026-03-11 14:36:37,115 - lava_callback - DEBUG - Processing node 69aedaebfeb96b28aa34bebe: baseline-arm64-clabbe 2026-03-11 14:36:37,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedaebfeb96b28aa34bebe 2026-03-11 14:36:37,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:36:37,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedaebfeb96b28aa34bebe HTTP/1.1" 200 None 2026-03-11 14:36:37,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:36:37,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:36:37,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:36:37,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedaebfeb96b28aa34bebe HTTP/1.1" 200 None 2026-03-11 14:36:37,172 - lava_callback - ERROR - Error processing callback for node 69aedaebfeb96b28aa34bebe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44300 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:37:54,740 - lava_callback - INFO - Received callback for node 69aedb33feb96b28aa34bed6 INFO: 172.21.0.1:46834 - "POST /node/69aedb33feb96b28aa34bed6 HTTP/1.0" 202 Accepted 2026-03-11 14:37:54,745 - lava_callback - INFO - Starting async job submit for node 69aedb33feb96b28aa34bed6 2026-03-11 14:37:54,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:37:54,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedb33feb96b28aa34bed6 HTTP/1.1" 200 None 2026-03-11 14:37:54,762 - lava_callback - DEBUG - Processing node 69aedb33feb96b28aa34bed6: baseline-arm64-baylibre 2026-03-11 14:37:54,762 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedb33feb96b28aa34bed6 2026-03-11 14:37:54,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:37:54,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedb33feb96b28aa34bed6 HTTP/1.1" 200 None 2026-03-11 14:37:54,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:37:54,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:37:54,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:37:54,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedb33feb96b28aa34bed6 HTTP/1.1" 200 None 2026-03-11 14:37:54,827 - lava_callback - ERROR - Error processing callback for node 69aedb33feb96b28aa34bed6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:40:34,980 - lava_callback - INFO - Received callback for node 69aedbd0feb96b28aa34bef4 INFO: 172.21.0.1:49568 - "POST /node/69aedbd0feb96b28aa34bef4 HTTP/1.0" 202 Accepted 2026-03-11 14:40:34,985 - lava_callback - INFO - Starting async job submit for node 69aedbd0feb96b28aa34bef4 2026-03-11 14:40:34,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:40:35,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedbd0feb96b28aa34bef4 HTTP/1.1" 200 None 2026-03-11 14:40:35,027 - lava_callback - DEBUG - Processing node 69aedbd0feb96b28aa34bef4: baseline-arm64-baylibre 2026-03-11 14:40:35,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedbd0feb96b28aa34bef4 2026-03-11 14:40:35,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:40:35,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedbd0feb96b28aa34bef4 HTTP/1.1" 200 None 2026-03-11 14:40:35,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:40:35,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:40:35,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:40:35,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedbd0feb96b28aa34bef4 HTTP/1.1" 200 None 2026-03-11 14:40:35,102 - lava_callback - ERROR - Error processing callback for node 69aedbd0feb96b28aa34bef4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 14:43:16,362 - lava_callback - INFO - Received callback for node 69aedc6efeb96b28aa34bf10 INFO: 172.21.0.1:54258 - "POST /node/69aedc6efeb96b28aa34bf10 HTTP/1.0" 202 Accepted 2026-03-11 14:43:16,368 - lava_callback - INFO - Starting async job submit for node 69aedc6efeb96b28aa34bf10 2026-03-11 14:43:16,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:43:16,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedc6efeb96b28aa34bf10 HTTP/1.1" 200 None 2026-03-11 14:43:16,404 - lava_callback - DEBUG - Processing node 69aedc6efeb96b28aa34bf10: baseline-arm64-clabbe 2026-03-11 14:43:16,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedc6efeb96b28aa34bf10 2026-03-11 14:43:16,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:43:16,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedc6efeb96b28aa34bf10 HTTP/1.1" 200 None 2026-03-11 14:43:16,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:43:16,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:43:16,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:43:16,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedc6efeb96b28aa34bf10 HTTP/1.1" 200 None 2026-03-11 14:43:16,494 - lava_callback - ERROR - Error processing callback for node 69aedc6efeb96b28aa34bf10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:44:15,102 - lava_callback - INFO - Received callback for node 69aedcb3feb96b28aa34bf1a INFO: 172.21.0.1:41278 - "POST /node/69aedcb3feb96b28aa34bf1a HTTP/1.0" 202 Accepted 2026-03-11 14:44:15,107 - lava_callback - INFO - Starting async job submit for node 69aedcb3feb96b28aa34bf1a 2026-03-11 14:44:15,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:44:15,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedcb3feb96b28aa34bf1a HTTP/1.1" 200 None 2026-03-11 14:44:15,125 - lava_callback - DEBUG - Processing node 69aedcb3feb96b28aa34bf1a: baseline-arm64-baylibre 2026-03-11 14:44:15,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedcb3feb96b28aa34bf1a 2026-03-11 14:44:15,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:41280 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 14:44:15,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedcb3feb96b28aa34bf1a HTTP/1.1" 200 None 2026-03-11 14:44:15,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:44:15,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:44:15,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:44:15,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedcb3feb96b28aa34bf1a HTTP/1.1" 200 None 2026-03-11 14:44:15,227 - lava_callback - ERROR - Error processing callback for node 69aedcb3feb96b28aa34bf1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45366 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:48:16,533 - lava_callback - INFO - Received callback for node 69aedda4feb96b28aa34bf4c INFO: 172.21.0.1:45372 - "POST /node/69aedda4feb96b28aa34bf4c HTTP/1.0" 202 Accepted 2026-03-11 14:48:16,538 - lava_callback - INFO - Starting async job submit for node 69aedda4feb96b28aa34bf4c 2026-03-11 14:48:16,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:48:16,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedda4feb96b28aa34bf4c HTTP/1.1" 200 None 2026-03-11 14:48:16,554 - lava_callback - DEBUG - Processing node 69aedda4feb96b28aa34bf4c: baseline-arm64-clabbe 2026-03-11 14:48:16,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedda4feb96b28aa34bf4c 2026-03-11 14:48:16,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:48:16,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedda4feb96b28aa34bf4c HTTP/1.1" 200 None 2026-03-11 14:48:16,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:48:16,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:48:16,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:48:16,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedda4feb96b28aa34bf4c HTTP/1.1" 200 None 2026-03-11 14:48:16,613 - lava_callback - ERROR - Error processing callback for node 69aedda4feb96b28aa34bf4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:49:35,322 - lava_callback - INFO - Received callback for node 69aeddedfeb96b28aa34bf99 INFO: 172.21.0.1:54906 - "POST /node/69aeddedfeb96b28aa34bf99 HTTP/1.0" 202 Accepted 2026-03-11 14:49:35,328 - lava_callback - INFO - Starting async job submit for node 69aeddedfeb96b28aa34bf99 2026-03-11 14:49:35,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:49:35,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeddedfeb96b28aa34bf99 HTTP/1.1" 200 None 2026-03-11 14:49:35,345 - lava_callback - DEBUG - Processing node 69aeddedfeb96b28aa34bf99: baseline-arm64-baylibre 2026-03-11 14:49:35,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeddedfeb96b28aa34bf99 2026-03-11 14:49:35,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:49:35,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeddedfeb96b28aa34bf99 HTTP/1.1" 200 None 2026-03-11 14:49:35,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:49:35,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:49:35,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:49:35,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeddedfeb96b28aa34bf99 HTTP/1.1" 200 None 2026-03-11 14:49:35,410 - lava_callback - ERROR - Error processing callback for node 69aeddedfeb96b28aa34bf99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET /node/698a9b49d9a1cfa777a24e88%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36548 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:50:56,651 - lava_callback - INFO - Received callback for node 69aede41feb96b28aa34bfb4 INFO: 172.21.0.1:36562 - "POST /node/69aede41feb96b28aa34bfb4 HTTP/1.0" 202 Accepted 2026-03-11 14:50:56,657 - lava_callback - INFO - Starting async job submit for node 69aede41feb96b28aa34bfb4 2026-03-11 14:50:56,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:50:56,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aede41feb96b28aa34bfb4 HTTP/1.1" 200 None 2026-03-11 14:50:56,673 - lava_callback - DEBUG - Processing node 69aede41feb96b28aa34bfb4: baseline-arm64-clabbe 2026-03-11 14:50:56,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aede41feb96b28aa34bfb4 2026-03-11 14:50:56,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:50:56,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aede41feb96b28aa34bfb4 HTTP/1.1" 200 None 2026-03-11 14:50:56,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:50:56,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:50:56,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:50:56,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aede41feb96b28aa34bfb4 HTTP/1.1" 200 None 2026-03-11 14:50:56,734 - lava_callback - ERROR - Error processing callback for node 69aede41feb96b28aa34bfb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:54:56,920 - lava_callback - INFO - Received callback for node 69aedf33feb96b28aa34bff1 INFO: 172.21.0.1:43970 - "POST /node/69aedf33feb96b28aa34bff1 HTTP/1.0" 202 Accepted 2026-03-11 14:54:56,926 - lava_callback - INFO - Starting async job submit for node 69aedf33feb96b28aa34bff1 2026-03-11 14:54:56,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:54:56,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedf33feb96b28aa34bff1 HTTP/1.1" 200 None 2026-03-11 14:54:56,941 - lava_callback - DEBUG - Processing node 69aedf33feb96b28aa34bff1: baseline-arm64-clabbe 2026-03-11 14:54:56,941 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedf33feb96b28aa34bff1 2026-03-11 14:54:56,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:54:56,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedf33feb96b28aa34bff1 HTTP/1.1" 200 None 2026-03-11 14:54:56,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:54:56,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 14:54:56,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:54:56,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedf33feb96b28aa34bff1 HTTP/1.1" 200 None 2026-03-11 14:54:57,000 - lava_callback - ERROR - Error processing callback for node 69aedf33feb96b28aa34bff1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:57:36,953 - lava_callback - INFO - Received callback for node 69aedfd5feb96b28aa34c022 INFO: 172.21.0.1:39516 - "POST /node/69aedfd5feb96b28aa34c022 HTTP/1.0" 202 Accepted 2026-03-11 14:57:36,958 - lava_callback - INFO - Starting async job submit for node 69aedfd5feb96b28aa34c022 2026-03-11 14:57:36,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:57:36,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedfd5feb96b28aa34c022 HTTP/1.1" 200 None 2026-03-11 14:57:36,975 - lava_callback - DEBUG - Processing node 69aedfd5feb96b28aa34c022: baseline-arm64-clabbe 2026-03-11 14:57:36,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aedfd5feb96b28aa34c022 2026-03-11 14:57:36,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:57:37,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedfd5feb96b28aa34c022 HTTP/1.1" 200 None 2026-03-11 14:57:37,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:57:37,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 14:57:37,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:57:37,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedfd5feb96b28aa34c022 HTTP/1.1" 200 None 2026-03-11 14:57:37,054 - lava_callback - ERROR - Error processing callback for node 69aedfd5feb96b28aa34c022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57926 - "GET / HTTP/1.0" 200 OK 2026-03-11 14:58:35,919 - lava_callback - INFO - Received callback for node 69aee011feb96b28aa34c040 INFO: 172.21.0.1:35772 - "POST /node/69aee011feb96b28aa34c040 HTTP/1.0" 202 Accepted 2026-03-11 14:58:35,925 - lava_callback - INFO - Starting async job submit for node 69aee011feb96b28aa34c040 2026-03-11 14:58:35,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:58:35,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee011feb96b28aa34c040 HTTP/1.1" 200 None 2026-03-11 14:58:35,943 - lava_callback - DEBUG - Processing node 69aee011feb96b28aa34c040: baseline-arm-baylibre 2026-03-11 14:58:35,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee011feb96b28aa34c040 2026-03-11 14:58:35,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:58:35,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee011feb96b28aa34c040 HTTP/1.1" 200 None 2026-03-11 14:58:35,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:58:35,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 14:58:35,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 14:58:36,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee011feb96b28aa34c040 HTTP/1.1" 200 None 2026-03-11 14:58:36,009 - lava_callback - ERROR - Error processing callback for node 69aee011feb96b28aa34c040: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:00:35,775 - lava_callback - INFO - Received callback for node 69aee08bfeb96b28aa34c086 INFO: 172.21.0.1:48278 - "POST /node/69aee08bfeb96b28aa34c086 HTTP/1.0" 202 Accepted 2026-03-11 15:00:35,780 - lava_callback - INFO - Starting async job submit for node 69aee08bfeb96b28aa34c086 2026-03-11 15:00:35,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:00:35,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee08bfeb96b28aa34c086 HTTP/1.1" 200 None 2026-03-11 15:00:35,797 - lava_callback - DEBUG - Processing node 69aee08bfeb96b28aa34c086: baseline-arm-baylibre 2026-03-11 15:00:35,798 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee08bfeb96b28aa34c086 2026-03-11 15:00:35,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:00:35,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee08bfeb96b28aa34c086 HTTP/1.1" 200 None 2026-03-11 15:00:35,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:00:35,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 15:00:35,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:00:35,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee08bfeb96b28aa34c086 HTTP/1.1" 200 None 2026-03-11 15:00:35,868 - lava_callback - ERROR - Error processing callback for node 69aee08bfeb96b28aa34c086: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:02:57,164 - lava_callback - INFO - Received callback for node 69aee118feb96b28aa34c0cd INFO: 172.21.0.1:50246 - "POST /node/69aee118feb96b28aa34c0cd HTTP/1.0" 202 Accepted 2026-03-11 15:02:57,173 - lava_callback - INFO - Starting async job submit for node 69aee118feb96b28aa34c0cd 2026-03-11 15:02:57,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:02:57,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee118feb96b28aa34c0cd HTTP/1.1" 200 None 2026-03-11 15:02:57,237 - lava_callback - DEBUG - Processing node 69aee118feb96b28aa34c0cd: baseline-arm64-clabbe 2026-03-11 15:02:57,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee118feb96b28aa34c0cd 2026-03-11 15:02:57,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:02:57,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee118feb96b28aa34c0cd HTTP/1.1" 200 None 2026-03-11 15:02:57,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:02:57,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:02:57,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:02:57,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee118feb96b28aa34c0cd HTTP/1.1" 200 None 2026-03-11 15:02:57,362 - lava_callback - ERROR - Error processing callback for node 69aee118feb96b28aa34c0cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57096 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 15:04:16,045 - lava_callback - INFO - Received callback for node 69aee15efeb96b28aa34c0de INFO: 172.21.0.1:57098 - "POST /node/69aee15efeb96b28aa34c0de HTTP/1.0" 202 Accepted 2026-03-11 15:04:16,050 - lava_callback - INFO - Starting async job submit for node 69aee15efeb96b28aa34c0de 2026-03-11 15:04:16,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:04:16,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee15efeb96b28aa34c0de HTTP/1.1" 200 None 2026-03-11 15:04:16,069 - lava_callback - DEBUG - Processing node 69aee15efeb96b28aa34c0de: baseline-arm64-baylibre 2026-03-11 15:04:16,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee15efeb96b28aa34c0de 2026-03-11 15:04:16,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:04:16,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee15efeb96b28aa34c0de HTTP/1.1" 200 None 2026-03-11 15:04:16,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:04:16,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:04:16,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:04:16,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee15efeb96b28aa34c0de HTTP/1.1" 200 None 2026-03-11 15:04:16,134 - lava_callback - ERROR - Error processing callback for node 69aee15efeb96b28aa34c0de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33878 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 15:05:16,010 - lava_callback - INFO - Received callback for node 69aee1a5feb96b28aa34c0ea INFO: 172.21.0.1:33888 - "POST /node/69aee1a5feb96b28aa34c0ea HTTP/1.0" 202 Accepted 2026-03-11 15:05:16,016 - lava_callback - INFO - Starting async job submit for node 69aee1a5feb96b28aa34c0ea 2026-03-11 15:05:16,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:05:16,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee1a5feb96b28aa34c0ea HTTP/1.1" 200 None 2026-03-11 15:05:16,033 - lava_callback - DEBUG - Processing node 69aee1a5feb96b28aa34c0ea: baseline-arm-baylibre 2026-03-11 15:05:16,033 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee1a5feb96b28aa34c0ea 2026-03-11 15:05:16,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:05:16,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee1a5feb96b28aa34c0ea HTTP/1.1" 200 None 2026-03-11 15:05:16,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:05:16,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 15:05:16,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:05:16,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee1a5feb96b28aa34c0ea HTTP/1.1" 200 None 2026-03-11 15:05:16,114 - lava_callback - ERROR - Error processing callback for node 69aee1a5feb96b28aa34c0ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52078 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-11 15:09:16,302 - lava_callback - INFO - Received callback for node 69aee28dfeb96b28aa34c163 INFO: 172.21.0.1:52082 - "POST /node/69aee28dfeb96b28aa34c163 HTTP/1.0" 202 Accepted 2026-03-11 15:09:16,307 - lava_callback - INFO - Starting async job submit for node 69aee28dfeb96b28aa34c163 2026-03-11 15:09:16,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:16,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee28dfeb96b28aa34c163 HTTP/1.1" 200 None 2026-03-11 15:09:16,327 - lava_callback - DEBUG - Processing node 69aee28dfeb96b28aa34c163: baseline-arm-baylibre 2026-03-11 15:09:16,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee28dfeb96b28aa34c163 2026-03-11 15:09:16,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:16,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee28dfeb96b28aa34c163 HTTP/1.1" 200 None 2026-03-11 15:09:16,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:16,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 15:09:16,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:16,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee28dfeb96b28aa34c163 HTTP/1.1" 200 None 2026-03-11 15:09:16,382 - lava_callback - ERROR - Error processing callback for node 69aee28dfeb96b28aa34c163: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:09:56,370 - lava_callback - INFO - Received callback for node 69aee2b8feb96b28aa34c193 INFO: 172.21.0.1:33016 - "POST /node/69aee2b8feb96b28aa34c193 HTTP/1.0" 202 Accepted 2026-03-11 15:09:56,376 - lava_callback - INFO - Starting async job submit for node 69aee2b8feb96b28aa34c193 2026-03-11 15:09:56,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:56,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee2b8feb96b28aa34c193 HTTP/1.1" 200 None 2026-03-11 15:09:56,392 - lava_callback - DEBUG - Processing node 69aee2b8feb96b28aa34c193: baseline-arm-baylibre 2026-03-11 15:09:56,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee2b8feb96b28aa34c193 2026-03-11 15:09:56,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:56,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee2b8feb96b28aa34c193 HTTP/1.1" 200 None 2026-03-11 15:09:56,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:56,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 15:09:56,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:09:56,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee2b8feb96b28aa34c193 HTTP/1.1" 200 None 2026-03-11 15:09:56,495 - lava_callback - ERROR - Error processing callback for node 69aee2b8feb96b28aa34c193: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:11:56,479 - lava_callback - INFO - Received callback for node 69aee32dfeb96b28aa34c1d4 INFO: 172.21.0.1:45438 - "POST /node/69aee32dfeb96b28aa34c1d4 HTTP/1.0" 202 Accepted 2026-03-11 15:11:56,484 - lava_callback - INFO - Starting async job submit for node 69aee32dfeb96b28aa34c1d4 2026-03-11 15:11:56,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:11:56,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee32dfeb96b28aa34c1d4 HTTP/1.1" 200 None 2026-03-11 15:11:56,501 - lava_callback - DEBUG - Processing node 69aee32dfeb96b28aa34c1d4: baseline-arm-baylibre 2026-03-11 15:11:56,502 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee32dfeb96b28aa34c1d4 2026-03-11 15:11:56,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:11:56,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee32dfeb96b28aa34c1d4 HTTP/1.1" 200 None 2026-03-11 15:11:56,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:45454 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:11:56,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-11 15:11:56,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:11:56,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee32dfeb96b28aa34c1d4 HTTP/1.1" 200 None 2026-03-11 15:11:56,570 - lava_callback - ERROR - Error processing callback for node 69aee32dfeb96b28aa34c1d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:15:16,621 - lava_callback - INFO - Received callback for node 69aee3fafeb96b28aa34c215 INFO: 172.21.0.1:54184 - "POST /node/69aee3fafeb96b28aa34c215 HTTP/1.0" 202 Accepted 2026-03-11 15:15:16,627 - lava_callback - INFO - Starting async job submit for node 69aee3fafeb96b28aa34c215 2026-03-11 15:15:16,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:15:16,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee3fafeb96b28aa34c215 HTTP/1.1" 200 None 2026-03-11 15:15:16,644 - lava_callback - DEBUG - Processing node 69aee3fafeb96b28aa34c215: baseline-arm64-baylibre 2026-03-11 15:15:16,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee3fafeb96b28aa34c215 2026-03-11 15:15:16,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:15:16,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee3fafeb96b28aa34c215 HTTP/1.1" 200 None 2026-03-11 15:15:16,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:15:16,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:15:16,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:15:16,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee3fafeb96b28aa34c215 HTTP/1.1" 200 None 2026-03-11 15:15:16,706 - lava_callback - ERROR - Error processing callback for node 69aee3fafeb96b28aa34c215: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:17:56,768 - lava_callback - INFO - Received callback for node 69aee496feb96b28aa34c237 INFO: 172.21.0.1:56902 - "POST /node/69aee496feb96b28aa34c237 HTTP/1.0" 202 Accepted 2026-03-11 15:17:56,774 - lava_callback - INFO - Starting async job submit for node 69aee496feb96b28aa34c237 2026-03-11 15:17:56,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:17:56,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee496feb96b28aa34c237 HTTP/1.1" 200 None 2026-03-11 15:17:56,789 - lava_callback - DEBUG - Processing node 69aee496feb96b28aa34c237: baseline-arm64-baylibre 2026-03-11 15:17:56,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee496feb96b28aa34c237 2026-03-11 15:17:56,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:17:56,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee496feb96b28aa34c237 HTTP/1.1" 200 None 2026-03-11 15:17:56,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:17:56,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:17:56,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:17:56,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee496feb96b28aa34c237 HTTP/1.1" 200 None 2026-03-11 15:17:56,858 - lava_callback - ERROR - Error processing callback for node 69aee496feb96b28aa34c237: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34078 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:19:56,928 - lava_callback - INFO - Received callback for node 69aee50afeb96b28aa34c255 INFO: 172.21.0.1:34080 - "POST /node/69aee50afeb96b28aa34c255 HTTP/1.0" 202 Accepted 2026-03-11 15:19:56,934 - lava_callback - INFO - Starting async job submit for node 69aee50afeb96b28aa34c255 2026-03-11 15:19:56,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:19:56,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee50afeb96b28aa34c255 HTTP/1.1" 200 None 2026-03-11 15:19:56,958 - lava_callback - DEBUG - Processing node 69aee50afeb96b28aa34c255: baseline-arm64-baylibre 2026-03-11 15:19:56,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee50afeb96b28aa34c255 2026-03-11 15:19:56,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:19:56,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee50afeb96b28aa34c255 HTTP/1.1" 200 None 2026-03-11 15:19:56,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:19:56,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:19:56,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:19:57,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee50afeb96b28aa34c255 HTTP/1.1" 200 None 2026-03-11 15:19:57,017 - lava_callback - ERROR - Error processing callback for node 69aee50afeb96b28aa34c255: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:22:37,063 - lava_callback - INFO - Received callback for node 69aee5a7feb96b28aa34c28b INFO: 172.21.0.1:42866 - "POST /node/69aee5a7feb96b28aa34c28b HTTP/1.0" 202 Accepted 2026-03-11 15:22:37,069 - lava_callback - INFO - Starting async job submit for node 69aee5a7feb96b28aa34c28b 2026-03-11 15:22:37,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:22:37,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee5a7feb96b28aa34c28b HTTP/1.1" 200 None 2026-03-11 15:22:37,085 - lava_callback - DEBUG - Processing node 69aee5a7feb96b28aa34c28b: baseline-arm64-baylibre 2026-03-11 15:22:37,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee5a7feb96b28aa34c28b 2026-03-11 15:22:37,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:22:37,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee5a7feb96b28aa34c28b HTTP/1.1" 200 None 2026-03-11 15:22:37,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:22:37,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ae11758ef4424e487b2eb1 HTTP/1.1" 200 None 2026-03-11 15:22:37,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:22:37,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee5a7feb96b28aa34c28b HTTP/1.1" 200 None 2026-03-11 15:22:37,153 - lava_callback - ERROR - Error processing callback for node 69aee5a7feb96b28aa34c28b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:23:37,092 - lava_callback - INFO - Received callback for node 69aee5f3feb96b28aa34c29f INFO: 172.21.0.1:55284 - "POST /node/69aee5f3feb96b28aa34c29f HTTP/1.0" 202 Accepted 2026-03-11 15:23:37,097 - lava_callback - INFO - Starting async job submit for node 69aee5f3feb96b28aa34c29f 2026-03-11 15:23:37,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:23:37,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee5f3feb96b28aa34c29f HTTP/1.1" 200 None 2026-03-11 15:23:37,115 - lava_callback - DEBUG - Processing node 69aee5f3feb96b28aa34c29f: baseline-arm64-baylibre 2026-03-11 15:23:37,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee5f3feb96b28aa34c29f 2026-03-11 15:23:37,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:23:37,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee5f3feb96b28aa34c29f HTTP/1.1" 200 None 2026-03-11 15:23:37,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:23:37,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:23:37,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:23:37,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee5f3feb96b28aa34c29f HTTP/1.1" 200 None 2026-03-11 15:23:37,174 - lava_callback - ERROR - Error processing callback for node 69aee5f3feb96b28aa34c29f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35694 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:26:17,277 - lava_callback - INFO - Received callback for node 69aee68dfeb96b28aa34c2b9 INFO: 172.21.0.1:35704 - "POST /node/69aee68dfeb96b28aa34c2b9 HTTP/1.0" 202 Accepted 2026-03-11 15:26:17,283 - lava_callback - INFO - Starting async job submit for node 69aee68dfeb96b28aa34c2b9 2026-03-11 15:26:17,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:26:17,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee68dfeb96b28aa34c2b9 HTTP/1.1" 200 None 2026-03-11 15:26:17,298 - lava_callback - DEBUG - Processing node 69aee68dfeb96b28aa34c2b9: baseline-arm64-baylibre 2026-03-11 15:26:17,299 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee68dfeb96b28aa34c2b9 2026-03-11 15:26:17,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:26:17,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee68dfeb96b28aa34c2b9 HTTP/1.1" 200 None 2026-03-11 15:26:17,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:26:17,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:26:17,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:26:17,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee68dfeb96b28aa34c2b9 HTTP/1.1" 200 None 2026-03-11 15:26:17,351 - lava_callback - ERROR - Error processing callback for node 69aee68dfeb96b28aa34c2b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:28:57,430 - lava_callback - INFO - Received callback for node 69aee728feb96b28aa34c2d7 INFO: 172.21.0.1:57568 - "POST /node/69aee728feb96b28aa34c2d7 HTTP/1.0" 202 Accepted 2026-03-11 15:28:57,435 - lava_callback - INFO - Starting async job submit for node 69aee728feb96b28aa34c2d7 2026-03-11 15:28:57,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:28:57,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee728feb96b28aa34c2d7 HTTP/1.1" 200 None 2026-03-11 15:28:57,463 - lava_callback - DEBUG - Processing node 69aee728feb96b28aa34c2d7: baseline-arm64-baylibre 2026-03-11 15:28:57,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee728feb96b28aa34c2d7 2026-03-11 15:28:57,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:28:57,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee728feb96b28aa34c2d7 HTTP/1.1" 200 None 2026-03-11 15:28:57,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:28:57,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:28:57,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:28:57,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee728feb96b28aa34c2d7 HTTP/1.1" 200 None 2026-03-11 15:28:57,518 - lava_callback - ERROR - Error processing callback for node 69aee728feb96b28aa34c2d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:33:58,087 - lava_callback - INFO - Received callback for node 69aee859feb96b28aa34c30d INFO: 172.21.0.1:44100 - "POST /node/69aee859feb96b28aa34c30d HTTP/1.0" 202 Accepted 2026-03-11 15:33:58,092 - lava_callback - INFO - Starting async job submit for node 69aee859feb96b28aa34c30d 2026-03-11 15:33:58,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:33:58,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee859feb96b28aa34c30d HTTP/1.1" 200 None 2026-03-11 15:33:58,108 - lava_callback - DEBUG - Processing node 69aee859feb96b28aa34c30d: baseline-arm64-baylibre 2026-03-11 15:33:58,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee859feb96b28aa34c30d 2026-03-11 15:33:58,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:33:58,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee859feb96b28aa34c30d HTTP/1.1" 200 None 2026-03-11 15:33:58,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:33:58,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:33:58,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:33:58,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee859feb96b28aa34c30d HTTP/1.1" 200 None 2026-03-11 15:33:58,167 - lava_callback - ERROR - Error processing callback for node 69aee859feb96b28aa34c30d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:35:17,758 - lava_callback - INFO - Received callback for node 69aee8a6feb96b28aa34c317 INFO: 172.21.0.1:48810 - "POST /node/69aee8a6feb96b28aa34c317 HTTP/1.0" 202 Accepted 2026-03-11 15:35:17,764 - lava_callback - INFO - Starting async job submit for node 69aee8a6feb96b28aa34c317 2026-03-11 15:35:17,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:35:17,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee8a6feb96b28aa34c317 HTTP/1.1" 200 None 2026-03-11 15:35:17,781 - lava_callback - DEBUG - Processing node 69aee8a6feb96b28aa34c317: baseline-arm64-baylibre 2026-03-11 15:35:17,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee8a6feb96b28aa34c317 2026-03-11 15:35:17,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:35:17,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee8a6feb96b28aa34c317 HTTP/1.1" 200 None 2026-03-11 15:35:17,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:35:17,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:35:17,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:35:17,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee8a6feb96b28aa34c317 HTTP/1.1" 200 None 2026-03-11 15:35:17,847 - lava_callback - ERROR - Error processing callback for node 69aee8a6feb96b28aa34c317: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:36:38,598 - lava_callback - INFO - Received callback for node 69aee8fafeb96b28aa34c32a INFO: 172.21.0.1:35326 - "POST /node/69aee8fafeb96b28aa34c32a HTTP/1.0" 202 Accepted 2026-03-11 15:36:38,604 - lava_callback - INFO - Starting async job submit for node 69aee8fafeb96b28aa34c32a 2026-03-11 15:36:38,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:36:38,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee8fafeb96b28aa34c32a HTTP/1.1" 200 None 2026-03-11 15:36:38,619 - lava_callback - DEBUG - Processing node 69aee8fafeb96b28aa34c32a: baseline-arm64-clabbe 2026-03-11 15:36:38,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee8fafeb96b28aa34c32a 2026-03-11 15:36:38,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:36:38,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee8fafeb96b28aa34c32a HTTP/1.1" 200 None 2026-03-11 15:36:38,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:36:38,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:36:38,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:36:38,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee8fafeb96b28aa34c32a HTTP/1.1" 200 None 2026-03-11 15:36:38,682 - lava_callback - ERROR - Error processing callback for node 69aee8fafeb96b28aa34c32a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:37:58,662 - lava_callback - INFO - Received callback for node 69aee949feb96b28aa34c337 INFO: 172.21.0.1:39506 - "POST /node/69aee949feb96b28aa34c337 HTTP/1.0" 202 Accepted 2026-03-11 15:37:58,667 - lava_callback - INFO - Starting async job submit for node 69aee949feb96b28aa34c337 2026-03-11 15:37:58,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:37:58,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee949feb96b28aa34c337 HTTP/1.1" 200 None 2026-03-11 15:37:58,686 - lava_callback - DEBUG - Processing node 69aee949feb96b28aa34c337: baseline-arm64-clabbe 2026-03-11 15:37:58,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aee949feb96b28aa34c337 2026-03-11 15:37:58,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:37:58,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee949feb96b28aa34c337 HTTP/1.1" 200 None 2026-03-11 15:37:58,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:37:58,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:37:58,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:37:58,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee949feb96b28aa34c337 HTTP/1.1" 200 None 2026-03-11 15:37:58,739 - lava_callback - ERROR - Error processing callback for node 69aee949feb96b28aa34c337: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:41:58,788 - lava_callback - INFO - Received callback for node 69aeea36feb96b28aa34c361 INFO: 172.21.0.1:49954 - "POST /node/69aeea36feb96b28aa34c361 HTTP/1.0" 202 Accepted 2026-03-11 15:41:58,794 - lava_callback - INFO - Starting async job submit for node 69aeea36feb96b28aa34c361 2026-03-11 15:41:58,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:41:58,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeea36feb96b28aa34c361 HTTP/1.1" 200 None 2026-03-11 15:41:58,810 - lava_callback - DEBUG - Processing node 69aeea36feb96b28aa34c361: baseline-arm64-clabbe 2026-03-11 15:41:58,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeea36feb96b28aa34c361 2026-03-11 15:41:58,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:41:58,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeea36feb96b28aa34c361 HTTP/1.1" 200 None 2026-03-11 15:41:58,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:41:58,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:41:58,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:41:58,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeea36feb96b28aa34c361 HTTP/1.1" 200 None 2026-03-11 15:41:58,870 - lava_callback - ERROR - Error processing callback for node 69aeea36feb96b28aa34c361: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47988 - "GET / HTTP/1.0" 200 OK 2026-03-11 15:43:18,863 - lava_callback - INFO - Received callback for node 69aeea86feb96b28aa34c368 INFO: 172.21.0.1:48004 - "POST /node/69aeea86feb96b28aa34c368 HTTP/1.0" 202 Accepted 2026-03-11 15:43:18,869 - lava_callback - INFO - Starting async job submit for node 69aeea86feb96b28aa34c368 2026-03-11 15:43:18,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:43:18,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeea86feb96b28aa34c368 HTTP/1.1" 200 None 2026-03-11 15:43:18,908 - lava_callback - DEBUG - Processing node 69aeea86feb96b28aa34c368: baseline-arm64-clabbe 2026-03-11 15:43:18,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aeea86feb96b28aa34c368 2026-03-11 15:43:18,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:43:18,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeea86feb96b28aa34c368 HTTP/1.1" 200 None 2026-03-11 15:43:18,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:43:18,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-11 15:43:18,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 15:43:18,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeea86feb96b28aa34c368 HTTP/1.1" 200 None 2026-03-11 15:43:18,995 - lava_callback - ERROR - Error processing callback for node 69aeea86feb96b28aa34c368: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:13:39,847 - lava_callback - INFO - Received callback for node 69aef1b0feb96b28aa34c4d6 INFO: 172.21.0.1:58466 - "POST /node/69aef1b0feb96b28aa34c4d6 HTTP/1.0" 202 Accepted 2026-03-11 16:13:39,852 - lava_callback - INFO - Starting async job submit for node 69aef1b0feb96b28aa34c4d6 2026-03-11 16:13:39,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:13:39,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef1b0feb96b28aa34c4d6 HTTP/1.1" 200 None 2026-03-11 16:13:39,869 - lava_callback - DEBUG - Processing node 69aef1b0feb96b28aa34c4d6: baseline-arm-baylibre 2026-03-11 16:13:39,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef1b0feb96b28aa34c4d6 2026-03-11 16:13:39,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:13:39,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef1b0feb96b28aa34c4d6 HTTP/1.1" 200 None 2026-03-11 16:13:39,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:13:39,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-11 16:13:39,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:13:39,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef1b0feb96b28aa34c4d6 HTTP/1.1" 200 None 2026-03-11 16:13:39,932 - lava_callback - ERROR - Error processing callback for node 69aef1b0feb96b28aa34c4d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK 2026-03-11 16:14:19,859 - lava_callback - INFO - Received callback for node 69aef1d5feb96b28aa34c50b INFO: 172.21.0.1:37706 - "POST /node/69aef1d5feb96b28aa34c50b HTTP/1.0" 202 Accepted 2026-03-11 16:14:19,867 - lava_callback - INFO - Starting async job submit for node 69aef1d5feb96b28aa34c50b 2026-03-11 16:14:19,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:14:19,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef1d5feb96b28aa34c50b HTTP/1.1" 200 None 2026-03-11 16:14:19,892 - lava_callback - DEBUG - Processing node 69aef1d5feb96b28aa34c50b: baseline-arm-baylibre 2026-03-11 16:14:19,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69aef1d5feb96b28aa34c50b 2026-03-11 16:14:19,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:14:19,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef1d5feb96b28aa34c50b HTTP/1.1" 200 None 2026-03-11 16:14:19,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:14:19,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-11 16:14:19,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-11 16:14:19,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef1d5feb96b28aa34c50b HTTP/1.1" 200 None 2026-03-11 16:14:19,981 - lava_callback - ERROR - Error processing callback for node 69aef1d5feb96b28aa34c50b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]