INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.19.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51954 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:34:39,625 - lava_callback - INFO - Received callback for node 69d36fff2214054febe37f88 2026-04-06 08:34:39,635 - lava_callback - INFO - Starting async job submit for node 69d36fff2214054febe37f88 INFO: 172.19.0.1:51968 - "POST /node/69d36fff2214054febe37f88 HTTP/1.0" 202 Accepted 2026-04-06 08:34:39,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:34:39,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36fff2214054febe37f88 HTTP/1.1" 200 None 2026-04-06 08:34:39,701 - lava_callback - DEBUG - Processing node 69d36fff2214054febe37f88: baseline-x86 2026-04-06 08:34:40,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:34:40,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:34:40,506 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d36fff2214054febe37f88/log.txt.gz 2026-04-06 08:34:40,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:34:41,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:34:41,316 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d36fff2214054febe37f88/lava-logs.yaml 2026-04-06 08:34:41,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:34:41,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:34:41,752 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d36fff2214054febe37f88/lava_callback.json.gz 2026-04-06 08:34:41,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:34:41,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36fff2214054febe37f88 HTTP/1.1" 200 None 2026-04-06 08:34:41,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:34:41,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c3f2214054febe37d8c HTTP/1.1" 200 None 2026-04-06 08:34:41,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:34:41,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d36fff2214054febe37f88 HTTP/1.1" 200 None 2026-04-06 08:34:41,898 - lava_callback - INFO - Completed processing callback for node 69d36fff2214054febe37f88 INFO: 172.19.0.1:60794 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:34:48,423 - lava_callback - INFO - Received callback for node 69d370012214054febe37f91 INFO: 172.19.0.1:60810 - "POST /node/69d370012214054febe37f91 HTTP/1.0" 202 Accepted 2026-04-06 08:34:48,433 - lava_callback - INFO - Starting async job submit for node 69d370012214054febe37f91 2026-04-06 08:34:48,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:34:48,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d370012214054febe37f91 HTTP/1.1" 200 None 2026-04-06 08:34:48,531 - lava_callback - DEBUG - Processing node 69d370012214054febe37f91: baseline-x86 2026-04-06 08:34:48,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:34:49,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:34:49,149 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d370012214054febe37f91/log.txt.gz 2026-04-06 08:34:49,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:34:49,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:34:49,864 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d370012214054febe37f91/lava-logs.yaml 2026-04-06 08:34:49,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:34:50,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:34:50,351 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d370012214054febe37f91/lava_callback.json.gz 2026-04-06 08:34:50,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:34:50,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d370012214054febe37f91 HTTP/1.1" 200 None 2026-04-06 08:34:50,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:34:50,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c3f2214054febe37d8c HTTP/1.1" 200 None 2026-04-06 08:34:50,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:34:50,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d370012214054febe37f91 HTTP/1.1" 200 None 2026-04-06 08:34:50,493 - lava_callback - INFO - Completed processing callback for node 69d370012214054febe37f91 INFO: 172.19.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56010 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:35:11,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:35:11,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44630 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:35:46,645 - lava_callback - INFO - Received callback for node 69d370002214054febe37f8b INFO: 172.19.0.1:44642 - "POST /node/69d370002214054febe37f8b HTTP/1.0" 202 Accepted 2026-04-06 08:35:46,651 - lava_callback - INFO - Starting async job submit for node 69d370002214054febe37f8b 2026-04-06 08:35:46,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:35:46,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d370002214054febe37f8b HTTP/1.1" 200 None 2026-04-06 08:35:46,685 - lava_callback - DEBUG - Processing node 69d370002214054febe37f8b: baseline-x86 2026-04-06 08:35:46,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:35:47,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:35:47,092 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d370002214054febe37f8b/log.txt.gz 2026-04-06 08:35:47,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:35:47,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:35:47,477 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d370002214054febe37f8b/lava-logs.yaml 2026-04-06 08:35:47,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:35:47,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:35:47,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d370002214054febe37f8b/lava_callback.json.gz 2026-04-06 08:35:47,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:35:47,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d370002214054febe37f8b HTTP/1.1" 200 None 2026-04-06 08:35:47,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:35:47,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c3f2214054febe37d8c HTTP/1.1" 200 None 2026-04-06 08:35:47,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:35:47,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d370002214054febe37f8b HTTP/1.1" 200 None 2026-04-06 08:35:47,728 - lava_callback - INFO - Completed processing callback for node 69d370002214054febe37f8b INFO: 172.19.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58852 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:36:11,450 - lava_callback - INFO - Received callback for node 69d370082214054febe37f9b INFO: 172.19.0.1:60540 - "POST /node/69d370082214054febe37f9b HTTP/1.0" 202 Accepted 2026-04-06 08:36:11,456 - lava_callback - INFO - Starting async job submit for node 69d370082214054febe37f9b 2026-04-06 08:36:11,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:36:11,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d370082214054febe37f9b HTTP/1.1" 200 None 2026-04-06 08:36:11,514 - lava_callback - DEBUG - Processing node 69d370082214054febe37f9b: baseline-arm 2026-04-06 08:36:11,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:36:11,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:36:11,912 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d370082214054febe37f9b/log.txt.gz 2026-04-06 08:36:11,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:36:12,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 08:36:12,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:36:12,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:36:12,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d370082214054febe37f9b/lava-logs.yaml 2026-04-06 08:36:12,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:36:12,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:36:12,475 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d370082214054febe37f9b/lava_callback.json.gz 2026-04-06 08:36:12,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:36:12,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d370082214054febe37f9b HTTP/1.1" 200 None 2026-04-06 08:36:12,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:36:12,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c272214054febe37d68 HTTP/1.1" 200 None 2026-04-06 08:36:12,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:36:12,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d370082214054febe37f9b HTTP/1.1" 200 None 2026-04-06 08:36:12,578 - lava_callback - INFO - Completed processing callback for node 69d370082214054febe37f9b INFO: 172.19.0.1:60556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40690 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:36:42,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:36:42,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52986 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:37:54,921 - lava_callback - INFO - Received callback for node 69d0cdd5691bac272b323015 INFO: 172.19.0.1:41602 - "POST /node/69d0cdd5691bac272b323015 HTTP/1.0" 202 Accepted 2026-04-06 08:37:54,929 - lava_callback - INFO - Starting async job submit for node 69d0cdd5691bac272b323015 2026-04-06 08:37:54,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:37:54,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdd5691bac272b323015 HTTP/1.1" 200 None 2026-04-06 08:37:54,952 - lava_callback - DEBUG - Processing node 69d0cdd5691bac272b323015: baseline-arm-baylibre 2026-04-06 08:37:54,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cdd5691bac272b323015 2026-04-06 08:37:54,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:37:54,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdd5691bac272b323015 HTTP/1.1" 200 None 2026-04-06 08:37:54,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:37:54,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-06 08:37:54,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:37:55,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cdd5691bac272b323015 HTTP/1.1" 200 None 2026-04-06 08:37:55,021 - lava_callback - ERROR - Error processing callback for node 69d0cdd5691bac272b323015: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54992 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:38:34,475 - lava_callback - INFO - Received callback for node 69d0cdfe691bac272b32304c INFO: 172.19.0.1:57626 - "POST /node/69d0cdfe691bac272b32304c HTTP/1.0" 202 Accepted 2026-04-06 08:38:34,481 - lava_callback - INFO - Starting async job submit for node 69d0cdfe691bac272b32304c 2026-04-06 08:38:34,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:34,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdfe691bac272b32304c HTTP/1.1" 200 None 2026-04-06 08:38:34,498 - lava_callback - DEBUG - Processing node 69d0cdfe691bac272b32304c: baseline-arm-baylibre 2026-04-06 08:38:34,498 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cdfe691bac272b32304c 2026-04-06 08:38:34,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:34,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cdfe691bac272b32304c HTTP/1.1" 200 None 2026-04-06 08:38:34,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:34,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 08:38:34,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:34,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cdfe691bac272b32304c HTTP/1.1" 200 None 2026-04-06 08:38:34,562 - lava_callback - ERROR - Error processing callback for node 69d0cdfe691bac272b32304c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:38:35,118 - lava_callback - INFO - Received callback for node 69d0ce00691bac272b32304f INFO: 172.19.0.1:57638 - "POST /node/69d0ce00691bac272b32304f HTTP/1.0" 202 Accepted 2026-04-06 08:38:35,125 - lava_callback - INFO - Starting async job submit for node 69d0ce00691bac272b32304f 2026-04-06 08:38:35,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:35,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce00691bac272b32304f HTTP/1.1" 200 None 2026-04-06 08:38:35,151 - lava_callback - DEBUG - Processing node 69d0ce00691bac272b32304f: baseline-arm-baylibre 2026-04-06 08:38:35,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ce00691bac272b32304f 2026-04-06 08:38:35,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:35,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce00691bac272b32304f HTTP/1.1" 200 None 2026-04-06 08:38:35,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:35,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 08:38:35,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:35,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce00691bac272b32304f HTTP/1.1" 200 None 2026-04-06 08:38:35,211 - lava_callback - ERROR - Error processing callback for node 69d0ce00691bac272b32304f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:38:35,786 - lava_callback - INFO - Received callback for node 69d0ce03691bac272b32305a INFO: 172.19.0.1:57650 - "POST /node/69d0ce03691bac272b32305a HTTP/1.0" 202 Accepted 2026-04-06 08:38:35,792 - lava_callback - INFO - Starting async job submit for node 69d0ce03691bac272b32305a 2026-04-06 08:38:35,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:35,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce03691bac272b32305a HTTP/1.1" 200 None 2026-04-06 08:38:35,808 - lava_callback - DEBUG - Processing node 69d0ce03691bac272b32305a: baseline-arm-baylibre 2026-04-06 08:38:35,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ce03691bac272b32305a 2026-04-06 08:38:35,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:35,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce03691bac272b32305a HTTP/1.1" 200 None 2026-04-06 08:38:35,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:35,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 08:38:35,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:35,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce03691bac272b32305a HTTP/1.1" 200 None 2026-04-06 08:38:35,876 - lava_callback - ERROR - Error processing callback for node 69d0ce03691bac272b32305a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:38:36,473 - lava_callback - INFO - Received callback for node 69d0ce04691bac272b32305d INFO: 172.19.0.1:57664 - "POST /node/69d0ce04691bac272b32305d HTTP/1.0" 202 Accepted 2026-04-06 08:38:36,479 - lava_callback - INFO - Starting async job submit for node 69d0ce04691bac272b32305d 2026-04-06 08:38:36,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:36,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce04691bac272b32305d HTTP/1.1" 200 None 2026-04-06 08:38:36,503 - lava_callback - DEBUG - Processing node 69d0ce04691bac272b32305d: baseline-arm-baylibre 2026-04-06 08:38:36,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ce04691bac272b32305d 2026-04-06 08:38:36,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:57674 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:38:36,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce04691bac272b32305d HTTP/1.1" 200 None 2026-04-06 08:38:36,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:36,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 08:38:36,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:36,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce04691bac272b32305d HTTP/1.1" 200 None 2026-04-06 08:38:36,576 - lava_callback - ERROR - Error processing callback for node 69d0ce04691bac272b32305d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:38:42,360 - lava_callback - INFO - Received callback for node 69d0ce0c691bac272b323073 INFO: 172.19.0.1:46732 - "POST /node/69d0ce0c691bac272b323073 HTTP/1.0" 202 Accepted 2026-04-06 08:38:42,367 - lava_callback - INFO - Starting async job submit for node 69d0ce0c691bac272b323073 2026-04-06 08:38:42,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:42,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce0c691bac272b323073 HTTP/1.1" 200 None 2026-04-06 08:38:42,385 - lava_callback - DEBUG - Processing node 69d0ce0c691bac272b323073: baseline-arm-clabbe 2026-04-06 08:38:42,386 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ce0c691bac272b323073 2026-04-06 08:38:42,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:42,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce0c691bac272b323073 HTTP/1.1" 200 None 2026-04-06 08:38:42,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:42,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 08:38:42,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:42,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce0c691bac272b323073 HTTP/1.1" 200 None 2026-04-06 08:38:42,462 - lava_callback - ERROR - Error processing callback for node 69d0ce0c691bac272b323073: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:38:43,058 - lava_callback - INFO - Received callback for node 69d0ce0e691bac272b32307b INFO: 172.19.0.1:46748 - "POST /node/69d0ce0e691bac272b32307b HTTP/1.0" 202 Accepted 2026-04-06 08:38:43,063 - lava_callback - INFO - Starting async job submit for node 69d0ce0e691bac272b32307b 2026-04-06 08:38:43,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:43,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce0e691bac272b32307b HTTP/1.1" 200 None 2026-04-06 08:38:43,080 - lava_callback - DEBUG - Processing node 69d0ce0e691bac272b32307b: baseline-arm-clabbe 2026-04-06 08:38:43,080 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ce0e691bac272b32307b 2026-04-06 08:38:43,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:43,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce0e691bac272b32307b HTTP/1.1" 200 None 2026-04-06 08:38:43,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:43,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 08:38:43,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:43,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce0e691bac272b32307b HTTP/1.1" 200 None 2026-04-06 08:38:43,152 - lava_callback - ERROR - Error processing callback for node 69d0ce0e691bac272b32307b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:38:43,724 - lava_callback - INFO - Received callback for node 69d0ce10691bac272b323082 INFO: 172.19.0.1:46750 - "POST /node/69d0ce10691bac272b323082 HTTP/1.0" 202 Accepted 2026-04-06 08:38:43,733 - lava_callback - INFO - Starting async job submit for node 69d0ce10691bac272b323082 2026-04-06 08:38:43,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:43,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce10691bac272b323082 HTTP/1.1" 200 None 2026-04-06 08:38:43,757 - lava_callback - DEBUG - Processing node 69d0ce10691bac272b323082: baseline-arm-clabbe 2026-04-06 08:38:43,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ce10691bac272b323082 2026-04-06 08:38:43,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:43,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce10691bac272b323082 HTTP/1.1" 200 None 2026-04-06 08:38:43,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:43,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 08:38:43,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:38:43,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce10691bac272b323082 HTTP/1.1" 200 None 2026-04-06 08:38:43,849 - lava_callback - ERROR - Error processing callback for node 69d0ce10691bac272b323082: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48330 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:39:02,264 - lava_callback - INFO - Received callback for node 69d0ce11691bac272b323085 INFO: 172.19.0.1:43732 - "POST /node/69d0ce11691bac272b323085 HTTP/1.0" 202 Accepted 2026-04-06 08:39:02,269 - lava_callback - INFO - Starting async job submit for node 69d0ce11691bac272b323085 2026-04-06 08:39:02,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:02,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce11691bac272b323085 HTTP/1.1" 200 None 2026-04-06 08:39:02,286 - lava_callback - DEBUG - Processing node 69d0ce11691bac272b323085: baseline-arm-clabbe 2026-04-06 08:39:02,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ce11691bac272b323085 2026-04-06 08:39:02,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:02,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce11691bac272b323085 HTTP/1.1" 200 None 2026-04-06 08:39:02,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:02,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 08:39:02,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:02,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce11691bac272b323085 HTTP/1.1" 200 None 2026-04-06 08:39:02,356 - lava_callback - ERROR - Error processing callback for node 69d0ce11691bac272b323085: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:39:02,994 - lava_callback - INFO - Received callback for node 69d0ce12691bac272b32308a INFO: 172.19.0.1:43738 - "POST /node/69d0ce12691bac272b32308a HTTP/1.0" 202 Accepted 2026-04-06 08:39:03,000 - lava_callback - INFO - Starting async job submit for node 69d0ce12691bac272b32308a 2026-04-06 08:39:03,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:03,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce12691bac272b32308a HTTP/1.1" 200 None 2026-04-06 08:39:03,019 - lava_callback - DEBUG - Processing node 69d0ce12691bac272b32308a: baseline-arm-clabbe 2026-04-06 08:39:03,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ce12691bac272b32308a 2026-04-06 08:39:03,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:03,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce12691bac272b32308a HTTP/1.1" 200 None 2026-04-06 08:39:03,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:03,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 08:39:03,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:03,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce12691bac272b32308a HTTP/1.1" 200 None 2026-04-06 08:39:03,087 - lava_callback - ERROR - Error processing callback for node 69d0ce12691bac272b32308a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:39:03,681 - lava_callback - INFO - Received callback for node 69d0ce14691bac272b323090 INFO: 172.19.0.1:43746 - "POST /node/69d0ce14691bac272b323090 HTTP/1.0" 202 Accepted 2026-04-06 08:39:03,686 - lava_callback - INFO - Starting async job submit for node 69d0ce14691bac272b323090 2026-04-06 08:39:03,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:03,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce14691bac272b323090 HTTP/1.1" 200 None 2026-04-06 08:39:03,703 - lava_callback - DEBUG - Processing node 69d0ce14691bac272b323090: baseline-arm-clabbe 2026-04-06 08:39:03,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ce14691bac272b323090 2026-04-06 08:39:03,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:03,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce14691bac272b323090 HTTP/1.1" 200 None 2026-04-06 08:39:03,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:03,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 08:39:03,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:03,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce14691bac272b323090 HTTP/1.1" 200 None 2026-04-06 08:39:03,767 - lava_callback - ERROR - Error processing callback for node 69d0ce14691bac272b323090: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:39:04,366 - lava_callback - INFO - Received callback for node 69d0ce15691bac272b323093 INFO: 172.19.0.1:43754 - "POST /node/69d0ce15691bac272b323093 HTTP/1.0" 202 Accepted 2026-04-06 08:39:04,372 - lava_callback - INFO - Starting async job submit for node 69d0ce15691bac272b323093 2026-04-06 08:39:04,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:04,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce15691bac272b323093 HTTP/1.1" 200 None 2026-04-06 08:39:04,394 - lava_callback - DEBUG - Processing node 69d0ce15691bac272b323093: baseline-arm-clabbe 2026-04-06 08:39:04,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ce15691bac272b323093 2026-04-06 08:39:04,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:04,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce15691bac272b323093 HTTP/1.1" 200 None 2026-04-06 08:39:04,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:04,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 08:39:04,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:04,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce15691bac272b323093 HTTP/1.1" 200 None 2026-04-06 08:39:04,454 - lava_callback - ERROR - Error processing callback for node 69d0ce15691bac272b323093: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58304 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:39:34,595 - lava_callback - INFO - Received callback for node 69d0ce3b691bac272b323134 INFO: 172.19.0.1:39196 - "POST /node/69d0ce3b691bac272b323134 HTTP/1.0" 202 Accepted 2026-04-06 08:39:34,603 - lava_callback - INFO - Starting async job submit for node 69d0ce3b691bac272b323134 2026-04-06 08:39:34,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:34,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce3b691bac272b323134 HTTP/1.1" 200 None 2026-04-06 08:39:34,622 - lava_callback - DEBUG - Processing node 69d0ce3b691bac272b323134: baseline-arm-baylibre 2026-04-06 08:39:34,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ce3b691bac272b323134 2026-04-06 08:39:34,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:34,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ce3b691bac272b323134 HTTP/1.1" 200 None 2026-04-06 08:39:34,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:34,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 08:39:34,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:39:34,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ce3b691bac272b323134 HTTP/1.1" 200 None 2026-04-06 08:39:34,683 - lava_callback - ERROR - Error processing callback for node 69d0ce3b691bac272b323134: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54688 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:41:54,680 - lava_callback - INFO - Received callback for node 69d0cec4691bac272b323223 INFO: 172.19.0.1:38734 - "POST /node/69d0cec4691bac272b323223 HTTP/1.0" 202 Accepted 2026-04-06 08:41:54,688 - lava_callback - INFO - Starting async job submit for node 69d0cec4691bac272b323223 2026-04-06 08:41:54,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:41:54,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cec4691bac272b323223 HTTP/1.1" 200 None 2026-04-06 08:41:54,719 - lava_callback - DEBUG - Processing node 69d0cec4691bac272b323223: baseline-arm-baylibre 2026-04-06 08:41:54,719 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cec4691bac272b323223 2026-04-06 08:41:54,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:41:54,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cec4691bac272b323223 HTTP/1.1" 200 None 2026-04-06 08:41:54,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:41:54,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 08:41:54,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:41:54,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cec4691bac272b323223 HTTP/1.1" 200 None 2026-04-06 08:41:54,823 - lava_callback - ERROR - Error processing callback for node 69d0cec4691bac272b323223: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35982 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:44:19,718 - lava_callback - INFO - Received callback for node 69d372512214054febe3816a INFO: 172.19.0.1:41822 - "POST /node/69d372512214054febe3816a HTTP/1.0" 202 Accepted 2026-04-06 08:44:19,733 - lava_callback - INFO - Starting async job submit for node 69d372512214054febe3816a 2026-04-06 08:44:19,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:19,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372512214054febe3816a HTTP/1.1" 200 None 2026-04-06 08:44:19,791 - lava_callback - DEBUG - Processing node 69d372512214054febe3816a: baseline-arm 2026-04-06 08:44:19,804 - lava_callback - WARNING - Failed to upload log 2026-04-06 08:44:19,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:44:21,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:44:21,080 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d372512214054febe3816a/lava-logs.yaml 2026-04-06 08:44:21,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:44:22,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:44:22,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d372512214054febe3816a/lava_callback.json.gz 2026-04-06 08:44:22,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:22,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372512214054febe3816a HTTP/1.1" 200 None 2026-04-06 08:44:22,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:22,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:44:22,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:22,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372512214054febe3816a HTTP/1.1" 200 None 2026-04-06 08:44:22,353 - lava_callback - INFO - Completed processing callback for node 69d372512214054febe3816a INFO: 172.19.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51446 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:44:42,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:42,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 08:44:44,657 - lava_callback - INFO - Received callback for node 69d372522214054febe3816d INFO: 172.19.0.1:56938 - "POST /node/69d372522214054febe3816d HTTP/1.0" 202 Accepted 2026-04-06 08:44:44,708 - lava_callback - INFO - Starting async job submit for node 69d372522214054febe3816d 2026-04-06 08:44:44,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:44,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372522214054febe3816d HTTP/1.1" 200 None 2026-04-06 08:44:44,756 - lava_callback - DEBUG - Processing node 69d372522214054febe3816d: baseline-arm 2026-04-06 08:44:44,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:44:45,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:44:45,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d372522214054febe3816d/log.txt.gz 2026-04-06 08:44:46,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:56942 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:44:46,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:44:46,995 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d372522214054febe3816d/lava-logs.yaml 2026-04-06 08:44:47,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:44:47,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:44:47,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d372522214054febe3816d/lava_callback.json.gz 2026-04-06 08:44:47,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:47,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372522214054febe3816d HTTP/1.1" 200 None 2026-04-06 08:44:47,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:48,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:44:48,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:48,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372522214054febe3816d HTTP/1.1" 200 None 2026-04-06 08:44:48,052 - lava_callback - INFO - Completed processing callback for node 69d372522214054febe3816d 2026-04-06 08:44:55,657 - lava_callback - INFO - Received callback for node 69d372572214054febe38176 INFO: 172.19.0.1:34428 - "POST /node/69d372572214054febe38176 HTTP/1.0" 202 Accepted 2026-04-06 08:44:55,711 - lava_callback - INFO - Starting async job submit for node 69d372572214054febe38176 2026-04-06 08:44:55,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:55,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372572214054febe38176 HTTP/1.1" 200 None 2026-04-06 08:44:55,771 - lava_callback - DEBUG - Processing node 69d372572214054febe38176: baseline-arm 2026-04-06 08:44:55,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:34444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34460 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:44:56,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:44:56,941 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d372572214054febe38176/log.txt.gz 2026-04-06 08:44:57,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:44:58,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:44:58,116 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d372572214054febe38176/lava-logs.yaml 2026-04-06 08:44:58,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:44:59,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:44:59,203 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d372572214054febe38176/lava_callback.json.gz 2026-04-06 08:44:59,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:59,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372572214054febe38176 HTTP/1.1" 200 None 2026-04-06 08:44:59,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:59,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:44:59,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:44:59,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372572214054febe38176 HTTP/1.1" 200 None 2026-04-06 08:44:59,295 - lava_callback - INFO - Completed processing callback for node 69d372572214054febe38176 INFO: 172.19.0.1:49406 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:45:12,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:12,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:53650 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 08:45:15,936 - lava_callback - INFO - Received callback for node 69d372552214054febe38173 INFO: 172.19.0.1:53666 - "POST /node/69d372552214054febe38173 HTTP/1.0" 202 Accepted 2026-04-06 08:45:15,944 - lava_callback - INFO - Starting async job submit for node 69d372552214054febe38173 2026-04-06 08:45:15,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:15,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372552214054febe38173 HTTP/1.1" 200 None 2026-04-06 08:45:15,995 - lava_callback - DEBUG - Processing node 69d372552214054febe38173: baseline-arm 2026-04-06 08:45:16,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:53668 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:45:16,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:45:16,850 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d372552214054febe38173/log.txt.gz 2026-04-06 08:45:17,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:45:17,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:45:17,572 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d372552214054febe38173/lava-logs.yaml 2026-04-06 08:45:17,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:45:18,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:45:18,093 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d372552214054febe38173/lava_callback.json.gz 2026-04-06 08:45:18,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:18,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372552214054febe38173 HTTP/1.1" 200 None 2026-04-06 08:45:18,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:18,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:45:18,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:18,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372552214054febe38173 HTTP/1.1" 200 None 2026-04-06 08:45:18,233 - lava_callback - INFO - Completed processing callback for node 69d372552214054febe38173 INFO: 172.19.0.1:58468 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:45:29,354 - lava_callback - INFO - Received callback for node 69d3724f2214054febe38167 INFO: 172.19.0.1:58478 - "POST /node/69d3724f2214054febe38167 HTTP/1.0" 202 Accepted 2026-04-06 08:45:29,362 - lava_callback - INFO - Starting async job submit for node 69d3724f2214054febe38167 2026-04-06 08:45:29,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:29,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3724f2214054febe38167 HTTP/1.1" 200 None 2026-04-06 08:45:29,423 - lava_callback - DEBUG - Processing node 69d3724f2214054febe38167: baseline-arm 2026-04-06 08:45:29,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:45:30,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:45:30,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d3724f2214054febe38167/log.txt.gz 2026-04-06 08:45:30,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:45:31,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:45:31,102 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d3724f2214054febe38167/lava-logs.yaml 2026-04-06 08:45:31,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:45:31,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:45:31,617 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d3724f2214054febe38167/lava_callback.json.gz 2026-04-06 08:45:31,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:31,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3724f2214054febe38167 HTTP/1.1" 200 None 2026-04-06 08:45:31,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:31,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:45:31,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:31,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3724f2214054febe38167 HTTP/1.1" 200 None 2026-04-06 08:45:31,735 - lava_callback - INFO - Completed processing callback for node 69d3724f2214054febe38167 2026-04-06 08:45:34,929 - lava_callback - INFO - Received callback for node 69d0cfa5691bac272b3233a9 INFO: 172.19.0.1:36064 - "POST /node/69d0cfa5691bac272b3233a9 HTTP/1.0" 202 Accepted 2026-04-06 08:45:34,938 - lava_callback - INFO - Starting async job submit for node 69d0cfa5691bac272b3233a9 2026-04-06 08:45:34,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:34,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa5691bac272b3233a9 HTTP/1.1" 200 None 2026-04-06 08:45:34,955 - lava_callback - DEBUG - Processing node 69d0cfa5691bac272b3233a9: baseline-arm-baylibre 2026-04-06 08:45:34,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfa5691bac272b3233a9 2026-04-06 08:45:34,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:34,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfa5691bac272b3233a9 HTTP/1.1" 200 None 2026-04-06 08:45:34,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:35,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 08:45:35,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:35,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfa5691bac272b3233a9 HTTP/1.1" 200 None 2026-04-06 08:45:35,056 - lava_callback - ERROR - Error processing callback for node 69d0cfa5691bac272b3233a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36070 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:45:42,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:42,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:35486 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:45:53,509 - lava_callback - INFO - Received callback for node 69d3726f2214054febe381b4 INFO: 172.19.0.1:59404 - "POST /node/69d3726f2214054febe381b4 HTTP/1.0" 202 Accepted 2026-04-06 08:45:53,515 - lava_callback - INFO - Starting async job submit for node 69d3726f2214054febe381b4 2026-04-06 08:45:53,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:53,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3726f2214054febe381b4 HTTP/1.1" 200 None 2026-04-06 08:45:53,577 - lava_callback - DEBUG - Processing node 69d3726f2214054febe381b4: baseline-arm-broonie 2026-04-06 08:45:53,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:45:54,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:45:54,391 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d3726f2214054febe381b4/log.txt.gz 2026-04-06 08:45:54,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:45:55,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:45:55,185 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d3726f2214054febe381b4/lava-logs.yaml 2026-04-06 08:45:55,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:45:55,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:45:55,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d3726f2214054febe381b4/lava_callback.json.gz 2026-04-06 08:45:55,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:56,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3726f2214054febe381b4 HTTP/1.1" 200 None 2026-04-06 08:45:56,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:56,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:45:56,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:45:56,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3726f2214054febe381b4 HTTP/1.1" 200 None 2026-04-06 08:45:56,060 - lava_callback - INFO - Completed processing callback for node 69d3726f2214054febe381b4 INFO: 172.19.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49692 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:46:12,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:12,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 08:46:12,880 - lava_callback - INFO - Received callback for node 69d372712214054febe381b7 INFO: 172.19.0.1:53946 - "POST /node/69d372712214054febe381b7 HTTP/1.0" 202 Accepted 2026-04-06 08:46:12,889 - lava_callback - INFO - Starting async job submit for node 69d372712214054febe381b7 2026-04-06 08:46:12,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:12,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372712214054febe381b7 HTTP/1.1" 200 None 2026-04-06 08:46:12,946 - lava_callback - DEBUG - Processing node 69d372712214054febe381b7: baseline-arm-broonie 2026-04-06 08:46:13,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:13,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:13,970 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d372712214054febe381b7/log.txt.gz 2026-04-06 08:46:14,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:14,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:14,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d372712214054febe381b7/lava-logs.yaml 2026-04-06 08:46:14,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:14,859 - lava_callback - INFO - Received callback for node 69d0cfc2691bac272b323446 2026-04-06 08:46:14,868 - lava_callback - INFO - Starting async job submit for node 69d0cfc2691bac272b323446 INFO: 172.19.0.1:53956 - "POST /node/69d0cfc2691bac272b323446 HTTP/1.0" 202 Accepted 2026-04-06 08:46:14,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:14,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc2691bac272b323446 HTTP/1.1" 200 None 2026-04-06 08:46:14,895 - lava_callback - DEBUG - Processing node 69d0cfc2691bac272b323446: baseline-arm-baylibre 2026-04-06 08:46:14,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfc2691bac272b323446 2026-04-06 08:46:14,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:14,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc2691bac272b323446 HTTP/1.1" 200 None 2026-04-06 08:46:14,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:14,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 08:46:14,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:14,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfc2691bac272b323446 HTTP/1.1" 200 None 2026-04-06 08:46:14,968 - lava_callback - ERROR - Error processing callback for node 69d0cfc2691bac272b323446: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53970 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 08:46:15,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:15,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d372712214054febe381b7/lava_callback.json.gz 2026-04-06 08:46:15,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:15,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372712214054febe381b7 HTTP/1.1" 200 None 2026-04-06 08:46:15,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:15,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:46:15,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:15,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372712214054febe381b7 HTTP/1.1" 200 None 2026-04-06 08:46:15,333 - lava_callback - INFO - Completed processing callback for node 69d372712214054febe381b7 2026-04-06 08:46:15,352 - lava_callback - INFO - Received callback for node 69d372952214054febe38222 INFO: 172.19.0.1:53974 - "POST /node/69d372952214054febe38222 HTTP/1.0" 202 Accepted 2026-04-06 08:46:15,413 - lava_callback - INFO - Starting async job submit for node 69d372952214054febe38222 2026-04-06 08:46:15,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:15,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372952214054febe38222 HTTP/1.1" 200 None 2026-04-06 08:46:15,490 - lava_callback - DEBUG - Processing node 69d372952214054febe38222: baseline-arm-pengutronix 2026-04-06 08:46:15,549 - lava_callback - INFO - Received callback for node 69d0cfc3691bac272b323448 INFO: 172.19.0.1:53990 - "POST /node/69d0cfc3691bac272b323448 HTTP/1.0" 202 Accepted 2026-04-06 08:46:15,568 - lava_callback - INFO - Starting async job submit for node 69d0cfc3691bac272b323448 2026-04-06 08:46:15,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:15,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc3691bac272b323448 HTTP/1.1" 200 None 2026-04-06 08:46:15,674 - lava_callback - DEBUG - Processing node 69d0cfc3691bac272b323448: baseline-arm64-baylibre 2026-04-06 08:46:15,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfc3691bac272b323448 2026-04-06 08:46:15,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:15,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:15,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc3691bac272b323448 HTTP/1.1" 200 None 2026-04-06 08:46:15,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:15,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:15,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:15,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfc3691bac272b323448 HTTP/1.1" 200 None 2026-04-06 08:46:15,786 - lava_callback - ERROR - Error processing callback for node 69d0cfc3691bac272b323448: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:46:16,249 - lava_callback - INFO - Received callback for node 69d0cfc5691bac272b323450 INFO: 172.19.0.1:54000 - "POST /node/69d0cfc5691bac272b323450 HTTP/1.0" 202 Accepted 2026-04-06 08:46:16,259 - lava_callback - INFO - Starting async job submit for node 69d0cfc5691bac272b323450 2026-04-06 08:46:16,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:16,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc5691bac272b323450 HTTP/1.1" 200 None 2026-04-06 08:46:16,300 - lava_callback - DEBUG - Processing node 69d0cfc5691bac272b323450: baseline-arm64-baylibre 2026-04-06 08:46:16,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfc5691bac272b323450 2026-04-06 08:46:16,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:16,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc5691bac272b323450 HTTP/1.1" 200 None 2026-04-06 08:46:16,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:16,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:16,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:16,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfc5691bac272b323450 HTTP/1.1" 200 None 2026-04-06 08:46:16,390 - lava_callback - ERROR - Error processing callback for node 69d0cfc5691bac272b323450: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:46:16,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:16,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d372952214054febe38222/log.txt.gz INFO: 172.19.0.1:54006 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:46:16,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:16,950 - lava_callback - INFO - Received callback for node 69d0cfc6691bac272b323453 INFO: 172.19.0.1:54010 - "POST /node/69d0cfc6691bac272b323453 HTTP/1.0" 202 Accepted 2026-04-06 08:46:16,956 - lava_callback - INFO - Starting async job submit for node 69d0cfc6691bac272b323453 2026-04-06 08:46:16,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:16,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc6691bac272b323453 HTTP/1.1" 200 None 2026-04-06 08:46:16,980 - lava_callback - DEBUG - Processing node 69d0cfc6691bac272b323453: baseline-arm64-baylibre 2026-04-06 08:46:16,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfc6691bac272b323453 2026-04-06 08:46:16,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:17,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc6691bac272b323453 HTTP/1.1" 200 None 2026-04-06 08:46:17,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:17,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:17,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:17,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfc6691bac272b323453 HTTP/1.1" 200 None 2026-04-06 08:46:17,059 - lava_callback - ERROR - Error processing callback for node 69d0cfc6691bac272b323453: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:46:17,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:17,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d372952214054febe38222/lava-logs.yaml 2026-04-06 08:46:17,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:17,594 - lava_callback - INFO - Received callback for node 69d0cfc9691bac272b32345a INFO: 172.19.0.1:54016 - "POST /node/69d0cfc9691bac272b32345a HTTP/1.0" 202 Accepted 2026-04-06 08:46:17,601 - lava_callback - INFO - Starting async job submit for node 69d0cfc9691bac272b32345a 2026-04-06 08:46:17,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:17,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc9691bac272b32345a HTTP/1.1" 200 None 2026-04-06 08:46:17,625 - lava_callback - DEBUG - Processing node 69d0cfc9691bac272b32345a: baseline-arm64-baylibre 2026-04-06 08:46:17,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfc9691bac272b32345a 2026-04-06 08:46:17,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:17,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfc9691bac272b32345a HTTP/1.1" 200 None 2026-04-06 08:46:17,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:17,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:17,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:17,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfc9691bac272b32345a HTTP/1.1" 200 None 2026-04-06 08:46:17,733 - lava_callback - ERROR - Error processing callback for node 69d0cfc9691bac272b32345a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:46:17,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:17,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d372952214054febe38222/lava_callback.json.gz 2026-04-06 08:46:18,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:18,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372952214054febe38222 HTTP/1.1" 200 None 2026-04-06 08:46:18,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:18,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:46:18,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:18,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372952214054febe38222 HTTP/1.1" 200 None 2026-04-06 08:46:18,125 - lava_callback - INFO - Completed processing callback for node 69d372952214054febe38222 2026-04-06 08:46:18,265 - lava_callback - INFO - Received callback for node 69d0cfca691bac272b32345d INFO: 172.19.0.1:54024 - "POST /node/69d0cfca691bac272b32345d HTTP/1.0" 202 Accepted 2026-04-06 08:46:18,275 - lava_callback - INFO - Starting async job submit for node 69d0cfca691bac272b32345d 2026-04-06 08:46:18,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:18,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfca691bac272b32345d HTTP/1.1" 200 None 2026-04-06 08:46:18,326 - lava_callback - DEBUG - Processing node 69d0cfca691bac272b32345d: baseline-arm64-baylibre 2026-04-06 08:46:18,326 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfca691bac272b32345d 2026-04-06 08:46:18,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:18,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfca691bac272b32345d HTTP/1.1" 200 None 2026-04-06 08:46:18,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:18,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:18,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:18,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfca691bac272b32345d HTTP/1.1" 200 None 2026-04-06 08:46:18,410 - lava_callback - ERROR - Error processing callback for node 69d0cfca691bac272b32345d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:46:18,965 - lava_callback - INFO - Received callback for node 69d0cfcc691bac272b323460 INFO: 172.19.0.1:54038 - "POST /node/69d0cfcc691bac272b323460 HTTP/1.0" 202 Accepted 2026-04-06 08:46:18,975 - lava_callback - INFO - Starting async job submit for node 69d0cfcc691bac272b323460 2026-04-06 08:46:18,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:18,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfcc691bac272b323460 HTTP/1.1" 200 None 2026-04-06 08:46:18,999 - lava_callback - DEBUG - Processing node 69d0cfcc691bac272b323460: baseline-arm64-baylibre 2026-04-06 08:46:19,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfcc691bac272b323460 2026-04-06 08:46:19,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:19,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfcc691bac272b323460 HTTP/1.1" 200 None 2026-04-06 08:46:19,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:19,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:19,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:19,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfcc691bac272b323460 HTTP/1.1" 200 None 2026-04-06 08:46:19,094 - lava_callback - ERROR - Error processing callback for node 69d0cfcc691bac272b323460: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:46:19,478 - lava_callback - INFO - Received callback for node 69d372932214054febe3821d INFO: 172.19.0.1:54040 - "POST /node/69d372932214054febe3821d HTTP/1.0" 202 Accepted 2026-04-06 08:46:19,489 - lava_callback - INFO - Starting async job submit for node 69d372932214054febe3821d 2026-04-06 08:46:19,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:19,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372932214054febe3821d HTTP/1.1" 200 None 2026-04-06 08:46:19,538 - lava_callback - DEBUG - Processing node 69d372932214054febe3821d: baseline-arm-pengutronix 2026-04-06 08:46:19,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:20,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:20,325 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d372932214054febe3821d/log.txt.gz 2026-04-06 08:46:20,475 - lava_callback - INFO - Received callback for node 69d372732214054febe381ba INFO: 172.19.0.1:34530 - "POST /node/69d372732214054febe381ba HTTP/1.0" 202 Accepted 2026-04-06 08:46:20,490 - lava_callback - INFO - Starting async job submit for node 69d372732214054febe381ba 2026-04-06 08:46:20,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:20,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:20,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372732214054febe381ba HTTP/1.1" 200 None 2026-04-06 08:46:20,558 - lava_callback - DEBUG - Processing node 69d372732214054febe381ba: baseline-arm-broonie 2026-04-06 08:46:20,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:21,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:21,075 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d372932214054febe3821d/lava-logs.yaml 2026-04-06 08:46:21,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:21,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:21,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d372732214054febe381ba/log.txt.gz 2026-04-06 08:46:21,519 - lava_callback - INFO - Received callback for node 69d372922214054febe3821a 2026-04-06 08:46:21,542 - lava_callback - INFO - Starting async job submit for node 69d372922214054febe3821a INFO: 172.19.0.1:34534 - "POST /node/69d372922214054febe3821a HTTP/1.0" 202 Accepted 2026-04-06 08:46:21,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:21,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:21,645 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d372932214054febe3821d/lava_callback.json.gz 2026-04-06 08:46:21,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372922214054febe3821a HTTP/1.1" 200 None 2026-04-06 08:46:21,697 - lava_callback - DEBUG - Processing node 69d372922214054febe3821a: baseline-arm-pengutronix 2026-04-06 08:46:21,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:21,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372932214054febe3821d HTTP/1.1" 200 None 2026-04-06 08:46:21,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:21,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:22,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:46:22,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:22,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:22,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372932214054febe3821d HTTP/1.1" 200 None 2026-04-06 08:46:22,139 - lava_callback - INFO - Completed processing callback for node 69d372932214054febe3821d 2026-04-06 08:46:22,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:22,651 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d372732214054febe381ba/lava-logs.yaml 2026-04-06 08:46:22,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:22,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:22,727 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d372922214054febe3821a/log.txt.gz 2026-04-06 08:46:22,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:23,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:23,399 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d372732214054febe381ba/lava_callback.json.gz 2026-04-06 08:46:23,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:23,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372732214054febe381ba HTTP/1.1" 200 None 2026-04-06 08:46:23,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:23,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:46:23,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:23,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372732214054febe381ba HTTP/1.1" 200 None 2026-04-06 08:46:23,505 - lava_callback - INFO - Completed processing callback for node 69d372732214054febe381ba 2026-04-06 08:46:23,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:23,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d372922214054febe3821a/lava-logs.yaml 2026-04-06 08:46:23,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:24,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:24,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d372922214054febe3821a/lava_callback.json.gz 2026-04-06 08:46:24,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:24,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372922214054febe3821a HTTP/1.1" 200 None 2026-04-06 08:46:24,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:24,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:46:24,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:24,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372922214054febe3821a HTTP/1.1" 200 None 2026-04-06 08:46:24,237 - lava_callback - INFO - Completed processing callback for node 69d372922214054febe3821a INFO: 172.19.0.1:34540 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:46:34,886 - lava_callback - INFO - Received callback for node 69d0cfe8691bac272b3234c7 INFO: 172.19.0.1:36970 - "POST /node/69d0cfe8691bac272b3234c7 HTTP/1.0" 202 Accepted 2026-04-06 08:46:34,894 - lava_callback - INFO - Starting async job submit for node 69d0cfe8691bac272b3234c7 2026-04-06 08:46:34,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:34,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe8691bac272b3234c7 HTTP/1.1" 200 None 2026-04-06 08:46:34,914 - lava_callback - DEBUG - Processing node 69d0cfe8691bac272b3234c7: baseline-arm-baylibre 2026-04-06 08:46:34,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfe8691bac272b3234c7 2026-04-06 08:46:34,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:34,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe8691bac272b3234c7 HTTP/1.1" 200 None 2026-04-06 08:46:34,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:34,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 08:46:34,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:34,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfe8691bac272b3234c7 HTTP/1.1" 200 None 2026-04-06 08:46:34,977 - lava_callback - ERROR - Error processing callback for node 69d0cfe8691bac272b3234c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36972 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:46:40,673 - lava_callback - INFO - Received callback for node 69d3726c2214054febe381b1 INFO: 172.19.0.1:56090 - "POST /node/69d3726c2214054febe381b1 HTTP/1.0" 202 Accepted 2026-04-06 08:46:40,679 - lava_callback - INFO - Starting async job submit for node 69d3726c2214054febe381b1 2026-04-06 08:46:40,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:40,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3726c2214054febe381b1 HTTP/1.1" 200 None 2026-04-06 08:46:40,718 - lava_callback - DEBUG - Processing node 69d3726c2214054febe381b1: baseline-arm-broonie 2026-04-06 08:46:40,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:41,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:41,093 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d3726c2214054febe381b1/log.txt.gz 2026-04-06 08:46:41,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:41,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:41,444 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d3726c2214054febe381b1/lava-logs.yaml 2026-04-06 08:46:41,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:41,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:41,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d3726c2214054febe381b1/lava_callback.json.gz 2026-04-06 08:46:41,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:41,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3726c2214054febe381b1 HTTP/1.1" 200 None 2026-04-06 08:46:41,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:41,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:46:41,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:41,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3726c2214054febe381b1 HTTP/1.1" 200 None 2026-04-06 08:46:41,713 - lava_callback - INFO - Completed processing callback for node 69d3726c2214054febe381b1 2026-04-06 08:46:42,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:42,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-06 08:46:42,561 - lava_callback - INFO - Received callback for node 69d0cfdc691bac272b3234a4 INFO: 172.19.0.1:56100 - "POST /node/69d0cfdc691bac272b3234a4 HTTP/1.0" 202 Accepted 2026-04-06 08:46:42,566 - lava_callback - INFO - Starting async job submit for node 69d0cfdc691bac272b3234a4 2026-04-06 08:46:42,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:42,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfdc691bac272b3234a4 HTTP/1.1" 200 None 2026-04-06 08:46:42,587 - lava_callback - DEBUG - Processing node 69d0cfdc691bac272b3234a4: baseline-arm64-clabbe 2026-04-06 08:46:42,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfdc691bac272b3234a4 2026-04-06 08:46:42,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:42,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfdc691bac272b3234a4 HTTP/1.1" 200 None 2026-04-06 08:46:42,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:42,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:42,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:42,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfdc691bac272b3234a4 HTTP/1.1" 200 None 2026-04-06 08:46:42,640 - lava_callback - ERROR - Error processing callback for node 69d0cfdc691bac272b3234a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:46:43,246 - lava_callback - INFO - Received callback for node 69d0cfde691bac272b3234a7 INFO: 172.19.0.1:56104 - "POST /node/69d0cfde691bac272b3234a7 HTTP/1.0" 202 Accepted 2026-04-06 08:46:43,254 - lava_callback - INFO - Starting async job submit for node 69d0cfde691bac272b3234a7 2026-04-06 08:46:43,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:43,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfde691bac272b3234a7 HTTP/1.1" 200 None 2026-04-06 08:46:43,271 - lava_callback - DEBUG - Processing node 69d0cfde691bac272b3234a7: baseline-arm64-clabbe 2026-04-06 08:46:43,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfde691bac272b3234a7 2026-04-06 08:46:43,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:43,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfde691bac272b3234a7 HTTP/1.1" 200 None 2026-04-06 08:46:43,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:43,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:43,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:43,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfde691bac272b3234a7 HTTP/1.1" 200 None 2026-04-06 08:46:43,355 - lava_callback - ERROR - Error processing callback for node 69d0cfde691bac272b3234a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:46:43,904 - lava_callback - INFO - Received callback for node 69d0cfdf691bac272b3234aa INFO: 172.19.0.1:56108 - "POST /node/69d0cfdf691bac272b3234aa HTTP/1.0" 202 Accepted 2026-04-06 08:46:43,909 - lava_callback - INFO - Starting async job submit for node 69d0cfdf691bac272b3234aa 2026-04-06 08:46:43,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:43,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfdf691bac272b3234aa HTTP/1.1" 200 None 2026-04-06 08:46:43,926 - lava_callback - DEBUG - Processing node 69d0cfdf691bac272b3234aa: baseline-arm64-clabbe 2026-04-06 08:46:43,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfdf691bac272b3234aa 2026-04-06 08:46:43,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:43,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfdf691bac272b3234aa HTTP/1.1" 200 None 2026-04-06 08:46:43,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:43,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:43,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:44,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfdf691bac272b3234aa HTTP/1.1" 200 None 2026-04-06 08:46:44,070 - lava_callback - ERROR - Error processing callback for node 69d0cfdf691bac272b3234aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:46:44,597 - lava_callback - INFO - Received callback for node 69d0cfe0691bac272b3234b1 INFO: 172.19.0.1:56122 - "POST /node/69d0cfe0691bac272b3234b1 HTTP/1.0" 202 Accepted 2026-04-06 08:46:44,603 - lava_callback - INFO - Starting async job submit for node 69d0cfe0691bac272b3234b1 2026-04-06 08:46:44,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:44,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe0691bac272b3234b1 HTTP/1.1" 200 None 2026-04-06 08:46:44,620 - lava_callback - DEBUG - Processing node 69d0cfe0691bac272b3234b1: baseline-arm64-clabbe 2026-04-06 08:46:44,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfe0691bac272b3234b1 2026-04-06 08:46:44,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:44,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe0691bac272b3234b1 HTTP/1.1" 200 None 2026-04-06 08:46:44,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:44,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:44,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:44,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfe0691bac272b3234b1 HTTP/1.1" 200 None 2026-04-06 08:46:44,686 - lava_callback - ERROR - Error processing callback for node 69d0cfe0691bac272b3234b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:46:45,257 - lava_callback - INFO - Received callback for node 69d0cfe3691bac272b3234be INFO: 172.19.0.1:56134 - "POST /node/69d0cfe3691bac272b3234be HTTP/1.0" 202 Accepted 2026-04-06 08:46:45,269 - lava_callback - INFO - Starting async job submit for node 69d0cfe3691bac272b3234be 2026-04-06 08:46:45,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:45,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe3691bac272b3234be HTTP/1.1" 200 None 2026-04-06 08:46:45,300 - lava_callback - DEBUG - Processing node 69d0cfe3691bac272b3234be: baseline-arm64-clabbe 2026-04-06 08:46:45,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfe3691bac272b3234be 2026-04-06 08:46:45,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:45,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe3691bac272b3234be HTTP/1.1" 200 None 2026-04-06 08:46:45,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:45,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:45,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:45,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfe3691bac272b3234be HTTP/1.1" 200 None 2026-04-06 08:46:45,371 - lava_callback - ERROR - Error processing callback for node 69d0cfe3691bac272b3234be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:46:45,948 - lava_callback - INFO - Received callback for node 69d0cfe2691bac272b3234bb INFO: 172.19.0.1:56140 - "POST /node/69d0cfe2691bac272b3234bb HTTP/1.0" 202 Accepted 2026-04-06 08:46:45,953 - lava_callback - INFO - Starting async job submit for node 69d0cfe2691bac272b3234bb 2026-04-06 08:46:45,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:45,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe2691bac272b3234bb HTTP/1.1" 200 None 2026-04-06 08:46:45,969 - lava_callback - DEBUG - Processing node 69d0cfe2691bac272b3234bb: baseline-arm64-clabbe 2026-04-06 08:46:45,969 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0cfe2691bac272b3234bb 2026-04-06 08:46:45,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:45,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0cfe2691bac272b3234bb HTTP/1.1" 200 None 2026-04-06 08:46:45,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:45,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 08:46:46,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:46,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0cfe2691bac272b3234bb HTTP/1.1" 200 None 2026-04-06 08:46:46,044 - lava_callback - ERROR - Error processing callback for node 69d0cfe2691bac272b3234bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56156 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:46:48,635 - lava_callback - INFO - Received callback for node 69d372df2214054febe38358 INFO: 172.19.0.1:56168 - "POST /node/69d372df2214054febe38358 HTTP/1.0" 202 Accepted 2026-04-06 08:46:48,642 - lava_callback - INFO - Starting async job submit for node 69d372df2214054febe38358 2026-04-06 08:46:48,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:48,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372df2214054febe38358 HTTP/1.1" 200 None 2026-04-06 08:46:48,695 - lava_callback - DEBUG - Processing node 69d372df2214054febe38358: baseline-arm 2026-04-06 08:46:48,705 - lava_callback - WARNING - Failed to upload log 2026-04-06 08:46:48,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:48,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:48,844 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d372df2214054febe38358/lava-logs.yaml 2026-04-06 08:46:48,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:48,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:48,959 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d372df2214054febe38358/lava_callback.json.gz 2026-04-06 08:46:48,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:48,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372df2214054febe38358 HTTP/1.1" 200 None 2026-04-06 08:46:48,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:48,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:46:48,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:49,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372df2214054febe38358 HTTP/1.1" 200 None 2026-04-06 08:46:49,018 - lava_callback - INFO - Completed processing callback for node 69d372df2214054febe38358 2026-04-06 08:46:51,423 - lava_callback - INFO - Received callback for node 69d3728e2214054febe3820d INFO: 172.19.0.1:43188 - "POST /node/69d3728e2214054febe3820d HTTP/1.0" 202 Accepted 2026-04-06 08:46:51,434 - lava_callback - INFO - Starting async job submit for node 69d3728e2214054febe3820d 2026-04-06 08:46:51,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:51,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3728e2214054febe3820d HTTP/1.1" 200 None 2026-04-06 08:46:51,489 - lava_callback - DEBUG - Processing node 69d3728e2214054febe3820d: baseline-arm-kontron 2026-04-06 08:46:51,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:51,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:51,797 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d3728e2214054febe3820d/log.txt.gz 2026-04-06 08:46:51,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:52,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:52,108 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d3728e2214054febe3820d/lava-logs.yaml 2026-04-06 08:46:52,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:46:52,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:46:52,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d3728e2214054febe3820d/lava_callback.json.gz 2026-04-06 08:46:52,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:52,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3728e2214054febe3820d HTTP/1.1" 200 None 2026-04-06 08:46:52,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:52,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:46:52,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:46:52,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3728e2214054febe3820d HTTP/1.1" 200 None 2026-04-06 08:46:52,495 - lava_callback - INFO - Completed processing callback for node 69d3728e2214054febe3820d INFO: 172.19.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43906 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:47:06,721 - lava_callback - INFO - Received callback for node 69d372ed2214054febe38382 INFO: 172.19.0.1:43922 - "POST /node/69d372ed2214054febe38382 HTTP/1.0" 202 Accepted 2026-04-06 08:47:06,730 - lava_callback - INFO - Starting async job submit for node 69d372ed2214054febe38382 2026-04-06 08:47:06,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:06,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ed2214054febe38382 HTTP/1.1" 200 None 2026-04-06 08:47:06,763 - lava_callback - DEBUG - Processing node 69d372ed2214054febe38382: baseline-arm64 2026-04-06 08:47:06,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:07,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:07,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ed2214054febe38382/log.txt.gz 2026-04-06 08:47:07,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:07,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:07,462 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ed2214054febe38382/lava-logs.yaml 2026-04-06 08:47:07,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:07,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:07,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ed2214054febe38382/lava_callback.json.gz 2026-04-06 08:47:07,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:07,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ed2214054febe38382 HTTP/1.1" 200 None 2026-04-06 08:47:07,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:07,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:47:07,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:07,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372ed2214054febe38382 HTTP/1.1" 200 None 2026-04-06 08:47:07,692 - lava_callback - INFO - Completed processing callback for node 69d372ed2214054febe38382 2026-04-06 08:47:11,457 - lava_callback - INFO - Received callback for node 69d3728b2214054febe3820a INFO: 172.19.0.1:53110 - "POST /node/69d3728b2214054febe3820a HTTP/1.0" 202 Accepted 2026-04-06 08:47:11,463 - lava_callback - INFO - Starting async job submit for node 69d3728b2214054febe3820a 2026-04-06 08:47:11,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:11,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3728b2214054febe3820a HTTP/1.1" 200 None 2026-04-06 08:47:11,502 - lava_callback - DEBUG - Processing node 69d3728b2214054febe3820a: baseline-arm-kontron 2026-04-06 08:47:11,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:11,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:11,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d3728b2214054febe3820a/log.txt.gz 2026-04-06 08:47:11,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:12,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:12,201 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d3728b2214054febe3820a/lava-logs.yaml 2026-04-06 08:47:12,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:12,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:12,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 08:47:12,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:12,340 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d3728b2214054febe3820a/lava_callback.json.gz 2026-04-06 08:47:12,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:12,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3728b2214054febe3820a HTTP/1.1" 200 None 2026-04-06 08:47:12,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:12,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:47:12,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:12,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3728b2214054febe3820a HTTP/1.1" 200 None 2026-04-06 08:47:12,437 - lava_callback - INFO - Completed processing callback for node 69d3728b2214054febe3820a 2026-04-06 08:47:14,985 - lava_callback - INFO - Received callback for node 69d0d008691bac272b323541 INFO: 172.19.0.1:53126 - "POST /node/69d0d008691bac272b323541 HTTP/1.0" 202 Accepted 2026-04-06 08:47:14,990 - lava_callback - INFO - Starting async job submit for node 69d0d008691bac272b323541 2026-04-06 08:47:14,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:15,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d008691bac272b323541 HTTP/1.1" 200 None 2026-04-06 08:47:15,005 - lava_callback - DEBUG - Processing node 69d0d008691bac272b323541: baseline-arm-baylibre 2026-04-06 08:47:15,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d008691bac272b323541 2026-04-06 08:47:15,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:15,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d008691bac272b323541 HTTP/1.1" 200 None 2026-04-06 08:47:15,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:15,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 08:47:15,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:15,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d008691bac272b323541 HTTP/1.1" 200 None 2026-04-06 08:47:15,065 - lava_callback - ERROR - Error processing callback for node 69d0d008691bac272b323541: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53142 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 08:47:15,393 - lava_callback - INFO - Received callback for node 69d373092214054febe3841d INFO: 172.19.0.1:53158 - "POST /node/69d373092214054febe3841d HTTP/1.0" 202 Accepted 2026-04-06 08:47:15,399 - lava_callback - INFO - Starting async job submit for node 69d373092214054febe3841d 2026-04-06 08:47:15,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:15,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373092214054febe3841d HTTP/1.1" 200 None 2026-04-06 08:47:15,416 - lava_callback - DEBUG - Processing node 69d373092214054febe3841d: baseline-nfs-arm64 2026-04-06 08:47:15,418 - lava_callback - WARNING - Failed to upload log 2026-04-06 08:47:15,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:15,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:15,550 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373092214054febe3841d/lava-logs.yaml 2026-04-06 08:47:15,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:15,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:15,707 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373092214054febe3841d/lava_callback.json.gz 2026-04-06 08:47:15,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:15,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373092214054febe3841d HTTP/1.1" 200 None 2026-04-06 08:47:15,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:15,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:47:15,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:15,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373092214054febe3841d HTTP/1.1" 200 None 2026-04-06 08:47:15,832 - lava_callback - INFO - Completed processing callback for node 69d373092214054febe3841d INFO: 172.19.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43060 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:47:30,759 - lava_callback - INFO - Received callback for node 69d372fa2214054febe383c7 INFO: 172.19.0.1:41546 - "POST /node/69d372fa2214054febe383c7 HTTP/1.0" 202 Accepted 2026-04-06 08:47:30,770 - lava_callback - INFO - Starting async job submit for node 69d372fa2214054febe383c7 2026-04-06 08:47:30,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:30,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372fa2214054febe383c7 HTTP/1.1" 200 None 2026-04-06 08:47:30,826 - lava_callback - DEBUG - Processing node 69d372fa2214054febe383c7: baseline-arm64 2026-04-06 08:47:31,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:31,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:31,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fa2214054febe383c7/log.txt.gz 2026-04-06 08:47:31,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:31,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:31,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fa2214054febe383c7/lava-logs.yaml 2026-04-06 08:47:31,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:31,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:31,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fa2214054febe383c7/lava_callback.json.gz 2026-04-06 08:47:31,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:31,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372fa2214054febe383c7 HTTP/1.1" 200 None 2026-04-06 08:47:31,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:31,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:47:31,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:31,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372fa2214054febe383c7 HTTP/1.1" 200 None 2026-04-06 08:47:31,911 - lava_callback - INFO - Completed processing callback for node 69d372fa2214054febe383c7 2026-04-06 08:47:36,449 - lava_callback - INFO - Received callback for node 69d372f62214054febe383bc INFO: 172.19.0.1:41548 - "POST /node/69d372f62214054febe383bc HTTP/1.0" 202 Accepted 2026-04-06 08:47:36,457 - lava_callback - INFO - Starting async job submit for node 69d372f62214054febe383bc 2026-04-06 08:47:36,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:36,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f62214054febe383bc HTTP/1.1" 200 None 2026-04-06 08:47:36,506 - lava_callback - DEBUG - Processing node 69d372f62214054febe383bc: baseline-arm64 INFO: 172.19.0.1:41556 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:47:36,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:37,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:37,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f62214054febe383bc/log.txt.gz 2026-04-06 08:47:37,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:37,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:37,614 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f62214054febe383bc/lava-logs.yaml 2026-04-06 08:47:37,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:37,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:37,782 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f62214054febe383bc/lava_callback.json.gz 2026-04-06 08:47:37,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:37,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f62214054febe383bc HTTP/1.1" 200 None 2026-04-06 08:47:37,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:37,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:47:37,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:37,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372f62214054febe383bc HTTP/1.1" 200 None 2026-04-06 08:47:37,874 - lava_callback - INFO - Completed processing callback for node 69d372f62214054febe383bc 2026-04-06 08:47:38,330 - lava_callback - INFO - Received callback for node 69d372f22214054febe383a8 INFO: 172.19.0.1:41560 - "POST /node/69d372f22214054febe383a8 HTTP/1.0" 202 Accepted 2026-04-06 08:47:38,337 - lava_callback - INFO - Starting async job submit for node 69d372f22214054febe383a8 2026-04-06 08:47:38,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:38,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f22214054febe383a8 HTTP/1.1" 200 None 2026-04-06 08:47:38,386 - lava_callback - DEBUG - Processing node 69d372f22214054febe383a8: baseline-arm64 2026-04-06 08:47:38,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:38,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:38,654 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f22214054febe383a8/log.txt.gz 2026-04-06 08:47:38,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:38,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:38,937 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f22214054febe383a8/lava-logs.yaml 2026-04-06 08:47:38,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:39,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:39,090 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f22214054febe383a8/lava_callback.json.gz 2026-04-06 08:47:39,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:39,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f22214054febe383a8 HTTP/1.1" 200 None 2026-04-06 08:47:39,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:39,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:47:39,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:39,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372f22214054febe383a8 HTTP/1.1" 200 None 2026-04-06 08:47:39,240 - lava_callback - INFO - Completed processing callback for node 69d372f22214054febe383a8 2026-04-06 08:47:42,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:42,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-06 08:47:42,518 - lava_callback - INFO - Received callback for node 69d0d029691bac272b3235af INFO: 172.19.0.1:44002 - "POST /node/69d0d029691bac272b3235af HTTP/1.0" 202 Accepted 2026-04-06 08:47:42,524 - lava_callback - INFO - Starting async job submit for node 69d0d029691bac272b3235af 2026-04-06 08:47:42,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:42,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d029691bac272b3235af HTTP/1.1" 200 None 2026-04-06 08:47:42,542 - lava_callback - DEBUG - Processing node 69d0d029691bac272b3235af: baseline-arm-clabbe 2026-04-06 08:47:42,542 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d029691bac272b3235af 2026-04-06 08:47:42,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:42,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d029691bac272b3235af HTTP/1.1" 200 None 2026-04-06 08:47:42,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:42,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 08:47:42,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:42,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d029691bac272b3235af HTTP/1.1" 200 None 2026-04-06 08:47:42,596 - lava_callback - ERROR - Error processing callback for node 69d0d029691bac272b3235af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:47:44,910 - lava_callback - INFO - Received callback for node 69d372ee2214054febe38388 INFO: 172.19.0.1:44008 - "POST /node/69d372ee2214054febe38388 HTTP/1.0" 202 Accepted 2026-04-06 08:47:44,917 - lava_callback - INFO - Starting async job submit for node 69d372ee2214054febe38388 2026-04-06 08:47:44,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:44,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ee2214054febe38388 HTTP/1.1" 200 None 2026-04-06 08:47:44,953 - lava_callback - DEBUG - Processing node 69d372ee2214054febe38388: baseline-arm64 2026-04-06 08:47:45,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:45,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:45,410 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ee2214054febe38388/log.txt.gz 2026-04-06 08:47:45,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:45,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:45,836 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ee2214054febe38388/lava-logs.yaml 2026-04-06 08:47:45,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:46,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:46,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ee2214054febe38388/lava_callback.json.gz 2026-04-06 08:47:46,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:46,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ee2214054febe38388 HTTP/1.1" 200 None 2026-04-06 08:47:46,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:46,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:47:46,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:46,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372ee2214054febe38388 HTTP/1.1" 200 None 2026-04-06 08:47:46,093 - lava_callback - INFO - Completed processing callback for node 69d372ee2214054febe38388 INFO: 172.19.0.1:44024 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:47:49,371 - lava_callback - INFO - Received callback for node 69d372f12214054febe3838e INFO: 172.19.0.1:44038 - "POST /node/69d372f12214054febe3838e HTTP/1.0" 202 Accepted 2026-04-06 08:47:49,378 - lava_callback - INFO - Starting async job submit for node 69d372f12214054febe3838e 2026-04-06 08:47:49,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:49,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f12214054febe3838e HTTP/1.1" 200 None 2026-04-06 08:47:49,430 - lava_callback - DEBUG - Processing node 69d372f12214054febe3838e: baseline-arm64 2026-04-06 08:47:49,591 - lava_callback - WARNING - Failed to upload log 2026-04-06 08:47:49,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:49,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:49,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f12214054febe3838e/lava-logs.yaml 2026-04-06 08:47:49,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:49,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:49,956 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f12214054febe3838e/lava_callback.json.gz 2026-04-06 08:47:49,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:50,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f12214054febe3838e HTTP/1.1" 200 None 2026-04-06 08:47:50,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:50,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:47:50,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:50,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372f12214054febe3838e HTTP/1.1" 200 None 2026-04-06 08:47:50,110 - lava_callback - INFO - Completed processing callback for node 69d372f12214054febe3838e INFO: 172.19.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53658 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:47:57,027 - lava_callback - INFO - Received callback for node 69d372a92214054febe382a3 INFO: 172.19.0.1:53670 - "POST /node/69d372a92214054febe382a3 HTTP/1.0" 202 Accepted 2026-04-06 08:47:57,034 - lava_callback - INFO - Starting async job submit for node 69d372a92214054febe382a3 2026-04-06 08:47:57,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:57,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372a92214054febe382a3 HTTP/1.1" 200 None 2026-04-06 08:47:57,073 - lava_callback - DEBUG - Processing node 69d372a92214054febe382a3: ltp-dio 2026-04-06 08:47:57,353 - lava_callback - INFO - Received callback for node 69d372f02214054febe3838b INFO: 172.19.0.1:53674 - "POST /node/69d372f02214054febe3838b HTTP/1.0" 202 Accepted 2026-04-06 08:47:57,376 - lava_callback - INFO - Starting async job submit for node 69d372f02214054febe3838b 2026-04-06 08:47:57,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:57,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f02214054febe3838b HTTP/1.1" 200 None 2026-04-06 08:47:57,518 - lava_callback - DEBUG - Processing node 69d372f02214054febe3838b: baseline-arm64 2026-04-06 08:47:57,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:57,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:57,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:57,848 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69d372a92214054febe382a3/log.txt.gz 2026-04-06 08:47:57,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:58,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f02214054febe3838b/log.txt.gz 2026-04-06 08:47:58,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:58,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:58,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:58,479 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f02214054febe3838b/lava-logs.yaml 2026-04-06 08:47:58,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:58,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:58,499 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69d372a92214054febe382a3/lava-logs.yaml 2026-04-06 08:47:58,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:47:58,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:58,635 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f02214054febe3838b/lava_callback.json.gz 2026-04-06 08:47:58,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:58,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:47:58,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69d372a92214054febe382a3/lava_callback.json.gz 2026-04-06 08:47:58,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:58,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f02214054febe3838b HTTP/1.1" 200 None 2026-04-06 08:47:58,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:58,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372a92214054febe382a3 HTTP/1.1" 200 None 2026-04-06 08:47:58,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:58,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:47:58,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:58,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:47:58,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:47:58,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372f02214054febe3838b HTTP/1.1" 200 None 2026-04-06 08:47:58,757 - lava_callback - INFO - Completed processing callback for node 69d372f02214054febe3838b 2026-04-06 08:47:58,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372a92214054febe382a3 HTTP/1.1" 200 None 2026-04-06 08:47:58,818 - lava_callback - INFO - Completed processing callback for node 69d372a92214054febe382a3 2026-04-06 08:48:01,872 - lava_callback - INFO - Received callback for node 69d372fb2214054febe383ca INFO: 172.19.0.1:58542 - "POST /node/69d372fb2214054febe383ca HTTP/1.0" 202 Accepted 2026-04-06 08:48:01,878 - lava_callback - INFO - Starting async job submit for node 69d372fb2214054febe383ca 2026-04-06 08:48:01,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:01,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372fb2214054febe383ca HTTP/1.1" 200 None 2026-04-06 08:48:01,938 - lava_callback - DEBUG - Processing node 69d372fb2214054febe383ca: baseline-arm64 2026-04-06 08:48:02,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:02,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:02,298 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fb2214054febe383ca/log.txt.gz 2026-04-06 08:48:02,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:02,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:02,622 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fb2214054febe383ca/lava-logs.yaml 2026-04-06 08:48:02,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:02,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:02,806 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fb2214054febe383ca/lava_callback.json.gz 2026-04-06 08:48:02,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:02,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372fb2214054febe383ca HTTP/1.1" 200 None 2026-04-06 08:48:02,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:02,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:02,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:02,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372fb2214054febe383ca HTTP/1.1" 200 None 2026-04-06 08:48:02,907 - lava_callback - INFO - Completed processing callback for node 69d372fb2214054febe383ca INFO: 172.19.0.1:58554 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:48:10,232 - lava_callback - INFO - Received callback for node 69d372f72214054febe383bf INFO: 172.19.0.1:33290 - "POST /node/69d372f72214054febe383bf HTTP/1.0" 202 Accepted 2026-04-06 08:48:10,239 - lava_callback - INFO - Starting async job submit for node 69d372f72214054febe383bf 2026-04-06 08:48:10,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:10,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f72214054febe383bf HTTP/1.1" 200 None 2026-04-06 08:48:10,276 - lava_callback - DEBUG - Processing node 69d372f72214054febe383bf: baseline-arm64 2026-04-06 08:48:10,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:10,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:10,772 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f72214054febe383bf/log.txt.gz 2026-04-06 08:48:10,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:11,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:11,170 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f72214054febe383bf/lava-logs.yaml 2026-04-06 08:48:11,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:11,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:11,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f72214054febe383bf/lava_callback.json.gz 2026-04-06 08:48:11,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:11,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f72214054febe383bf HTTP/1.1" 200 None 2026-04-06 08:48:11,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:11,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:11,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:11,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372f72214054febe383bf HTTP/1.1" 200 None 2026-04-06 08:48:11,492 - lava_callback - INFO - Completed processing callback for node 69d372f72214054febe383bf 2026-04-06 08:48:12,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:12,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.19.0.1:33296 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 08:48:16,088 - lava_callback - INFO - Received callback for node 69d373072214054febe38413 INFO: 172.19.0.1:33300 - "POST /node/69d373072214054febe38413 HTTP/1.0" 202 Accepted 2026-04-06 08:48:16,096 - lava_callback - INFO - Starting async job submit for node 69d373072214054febe38413 2026-04-06 08:48:16,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:16,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373072214054febe38413 HTTP/1.1" 200 None 2026-04-06 08:48:16,141 - lava_callback - DEBUG - Processing node 69d373072214054febe38413: baseline-nfs-arm64 INFO: 172.19.0.1:33312 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:48:16,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:16,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:16,825 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373072214054febe38413/log.txt.gz 2026-04-06 08:48:17,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:17,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:17,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373072214054febe38413/lava-logs.yaml 2026-04-06 08:48:17,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:17,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:17,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373072214054febe38413/lava_callback.json.gz 2026-04-06 08:48:17,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:17,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373072214054febe38413 HTTP/1.1" 200 None 2026-04-06 08:48:17,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:17,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:17,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:17,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373072214054febe38413 HTTP/1.1" 200 None 2026-04-06 08:48:17,702 - lava_callback - INFO - Completed processing callback for node 69d373072214054febe38413 2026-04-06 08:48:21,304 - lava_callback - INFO - Received callback for node 69d373082214054febe3841a INFO: 172.19.0.1:57646 - "POST /node/69d373082214054febe3841a HTTP/1.0" 202 Accepted 2026-04-06 08:48:21,315 - lava_callback - INFO - Starting async job submit for node 69d373082214054febe3841a 2026-04-06 08:48:21,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:21,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373082214054febe3841a HTTP/1.1" 200 None 2026-04-06 08:48:21,385 - lava_callback - DEBUG - Processing node 69d373082214054febe3841a: baseline-nfs-arm64 2026-04-06 08:48:21,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:22,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:22,110 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373082214054febe3841a/log.txt.gz 2026-04-06 08:48:22,230 - lava_callback - INFO - Received callback for node 69d372fd2214054febe383d4 INFO: 172.19.0.1:57662 - "POST /node/69d372fd2214054febe383d4 HTTP/1.0" 202 Accepted 2026-04-06 08:48:22,289 - lava_callback - INFO - Starting async job submit for node 69d372fd2214054febe383d4 2026-04-06 08:48:22,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:22,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372fd2214054febe383d4 HTTP/1.1" 200 None 2026-04-06 08:48:22,477 - lava_callback - DEBUG - Processing node 69d372fd2214054febe383d4: baseline-arm64 2026-04-06 08:48:22,679 - lava_callback - INFO - Received callback for node 69d0d04a691bac272b323617 INFO: 172.19.0.1:57678 - "POST /node/69d0d04a691bac272b323617 HTTP/1.0" 202 Accepted 2026-04-06 08:48:22,699 - lava_callback - INFO - Starting async job submit for node 69d0d04a691bac272b323617 2026-04-06 08:48:22,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:22,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:22,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d04a691bac272b323617 HTTP/1.1" 200 None 2026-04-06 08:48:22,870 - lava_callback - DEBUG - Processing node 69d0d04a691bac272b323617: baseline-arm-clabbe 2026-04-06 08:48:22,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d04a691bac272b323617 2026-04-06 08:48:22,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:22,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d04a691bac272b323617 HTTP/1.1" 200 None 2026-04-06 08:48:22,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:22,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:23,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 08:48:23,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:23,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d04a691bac272b323617 HTTP/1.1" 200 None 2026-04-06 08:48:23,043 - lava_callback - ERROR - Error processing callback for node 69d0d04a691bac272b323617: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:48:23,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:23,355 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fd2214054febe383d4/log.txt.gz 2026-04-06 08:48:23,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:23,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373082214054febe3841a/lava-logs.yaml 2026-04-06 08:48:23,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:23,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:23,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:23,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373082214054febe3841a/lava_callback.json.gz 2026-04-06 08:48:23,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:23,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373082214054febe3841a HTTP/1.1" 200 None 2026-04-06 08:48:23,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:23,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:23,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:23,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:23,916 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fd2214054febe383d4/lava-logs.yaml 2026-04-06 08:48:23,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373082214054febe3841a HTTP/1.1" 200 None 2026-04-06 08:48:23,920 - lava_callback - INFO - Completed processing callback for node 69d373082214054febe3841a 2026-04-06 08:48:23,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:24,075 - lava_callback - INFO - Received callback for node 69d372f92214054febe383c4 INFO: 172.19.0.1:57692 - "POST /node/69d372f92214054febe383c4 HTTP/1.0" 202 Accepted 2026-04-06 08:48:24,086 - lava_callback - INFO - Starting async job submit for node 69d372f92214054febe383c4 2026-04-06 08:48:24,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:24,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:24,127 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fd2214054febe383d4/lava_callback.json.gz 2026-04-06 08:48:24,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:24,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f92214054febe383c4 HTTP/1.1" 200 None 2026-04-06 08:48:24,172 - lava_callback - DEBUG - Processing node 69d372f92214054febe383c4: baseline-arm64 2026-04-06 08:48:24,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372fd2214054febe383d4 HTTP/1.1" 200 None 2026-04-06 08:48:24,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:24,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:24,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:24,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372fd2214054febe383d4 HTTP/1.1" 200 None 2026-04-06 08:48:24,438 - lava_callback - INFO - Completed processing callback for node 69d372fd2214054febe383d4 2026-04-06 08:48:24,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:25,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:25,040 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f92214054febe383c4/log.txt.gz 2026-04-06 08:48:25,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:25,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:25,445 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f92214054febe383c4/lava-logs.yaml 2026-04-06 08:48:25,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:25,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:25,769 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f92214054febe383c4/lava_callback.json.gz 2026-04-06 08:48:25,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:25,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f92214054febe383c4 HTTP/1.1" 200 None 2026-04-06 08:48:25,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:25,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:25,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:25,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372f92214054febe383c4 HTTP/1.1" 200 None 2026-04-06 08:48:26,019 - lava_callback - INFO - Completed processing callback for node 69d372f92214054febe383c4 INFO: 172.19.0.1:57696 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:48:33,681 - lava_callback - INFO - Received callback for node 69d3730f2214054febe38431 INFO: 172.19.0.1:51238 - "POST /node/69d3730f2214054febe38431 HTTP/1.0" 202 Accepted 2026-04-06 08:48:33,689 - lava_callback - INFO - Starting async job submit for node 69d3730f2214054febe38431 2026-04-06 08:48:33,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:33,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3730f2214054febe38431 HTTP/1.1" 200 None 2026-04-06 08:48:33,739 - lava_callback - DEBUG - Processing node 69d3730f2214054febe38431: baseline-nfs-arm64 2026-04-06 08:48:34,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:34,393 - lava_callback - INFO - Received callback for node 69d372ff2214054febe38401 INFO: 172.19.0.1:51248 - "POST /node/69d372ff2214054febe38401 HTTP/1.0" 202 Accepted 2026-04-06 08:48:34,401 - lava_callback - INFO - Starting async job submit for node 69d372ff2214054febe38401 2026-04-06 08:48:34,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:34,433 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:34,435 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730f2214054febe38431/log.txt.gz 2026-04-06 08:48:34,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ff2214054febe38401 HTTP/1.1" 200 None 2026-04-06 08:48:34,497 - lava_callback - DEBUG - Processing node 69d372ff2214054febe38401: baseline-arm64 2026-04-06 08:48:34,670 - lava_callback - INFO - Received callback for node 69d373042214054febe3840d INFO: 172.19.0.1:51250 - "POST /node/69d373042214054febe3840d HTTP/1.0" 202 Accepted 2026-04-06 08:48:34,702 - lava_callback - INFO - Starting async job submit for node 69d373042214054febe3840d 2026-04-06 08:48:34,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:34,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373042214054febe3840d HTTP/1.1" 200 None 2026-04-06 08:48:35,090 - lava_callback - DEBUG - Processing node 69d373042214054febe3840d: baseline-nfs-arm64 2026-04-06 08:48:35,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:35,416 - lava_callback - INFO - Received callback for node 69d372ee2214054febe38385 2026-04-06 08:48:35,438 - lava_callback - INFO - Starting async job submit for node 69d372ee2214054febe38385 INFO: 172.19.0.1:51260 - "POST /node/69d372ee2214054febe38385 HTTP/1.0" 202 Accepted 2026-04-06 08:48:35,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:35,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:35,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ee2214054febe38385 HTTP/1.1" 200 None 2026-04-06 08:48:35,641 - lava_callback - DEBUG - Processing node 69d372ee2214054febe38385: baseline-arm64 2026-04-06 08:48:36,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:36,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:36,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ff2214054febe38401/log.txt.gz 2026-04-06 08:48:36,194 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730f2214054febe38431/lava-logs.yaml 2026-04-06 08:48:36,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:51268 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:48:36,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:36,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:36,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:37,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:37,141 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ee2214054febe38385/log.txt.gz 2026-04-06 08:48:37,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:37,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373042214054febe3840d/log.txt.gz 2026-04-06 08:48:37,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:37,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:37,358 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730f2214054febe38431/lava_callback.json.gz 2026-04-06 08:48:37,403 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ff2214054febe38401/lava-logs.yaml 2026-04-06 08:48:37,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:37,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:37,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3730f2214054febe38431 HTTP/1.1" 200 None 2026-04-06 08:48:37,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:37,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:37,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:37,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:37,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:37,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3730f2214054febe38431 HTTP/1.1" 200 None 2026-04-06 08:48:37,754 - lava_callback - INFO - Completed processing callback for node 69d3730f2214054febe38431 2026-04-06 08:48:37,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:37,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ff2214054febe38401/lava_callback.json.gz 2026-04-06 08:48:37,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:37,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ff2214054febe38401 HTTP/1.1" 200 None 2026-04-06 08:48:38,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:38,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:38,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:38,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372ff2214054febe38401 HTTP/1.1" 200 None 2026-04-06 08:48:38,191 - lava_callback - INFO - Completed processing callback for node 69d372ff2214054febe38401 2026-04-06 08:48:38,626 - lava_callback - INFO - Received callback for node 69d3730b2214054febe38420 2026-04-06 08:48:38,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:38,642 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ee2214054febe38385/lava-logs.yaml INFO: 172.19.0.1:51274 - "POST /node/69d3730b2214054febe38420 HTTP/1.0" 202 Accepted 2026-04-06 08:48:38,654 - lava_callback - INFO - Starting async job submit for node 69d3730b2214054febe38420 2026-04-06 08:48:38,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:38,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:38,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3730b2214054febe38420 HTTP/1.1" 200 None 2026-04-06 08:48:38,744 - lava_callback - DEBUG - Processing node 69d3730b2214054febe38420: baseline-nfs-arm64 2026-04-06 08:48:38,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:38,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373042214054febe3840d/lava-logs.yaml 2026-04-06 08:48:38,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:38,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:38,959 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372ee2214054febe38385/lava_callback.json.gz 2026-04-06 08:48:39,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:39,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:39,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ee2214054febe38385 HTTP/1.1" 200 None 2026-04-06 08:48:39,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:39,147 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373042214054febe3840d/lava_callback.json.gz 2026-04-06 08:48:39,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:39,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:39,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:39,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:39,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373042214054febe3840d HTTP/1.1" 200 None 2026-04-06 08:48:39,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:39,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372ee2214054febe38385 HTTP/1.1" 200 None 2026-04-06 08:48:39,329 - lava_callback - INFO - Completed processing callback for node 69d372ee2214054febe38385 2026-04-06 08:48:39,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:39,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:39,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373042214054febe3840d HTTP/1.1" 200 None 2026-04-06 08:48:39,418 - lava_callback - INFO - Completed processing callback for node 69d373042214054febe3840d 2026-04-06 08:48:39,790 - lava_callback - INFO - Received callback for node 69d373342214054febe38533 INFO: 172.19.0.1:34480 - "POST /node/69d373342214054febe38533 HTTP/1.0" 202 Accepted 2026-04-06 08:48:39,800 - lava_callback - INFO - Starting async job submit for node 69d373342214054febe38533 2026-04-06 08:48:39,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:39,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730b2214054febe38420/log.txt.gz 2026-04-06 08:48:39,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:39,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373342214054febe38533 HTTP/1.1" 200 None 2026-04-06 08:48:39,926 - lava_callback - DEBUG - Processing node 69d373342214054febe38533: baseline-arm64-foundriesio 2026-04-06 08:48:40,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:40,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:40,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:40,590 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d373342214054febe38533/log.txt.gz 2026-04-06 08:48:40,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:40,642 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730b2214054febe38420/lava-logs.yaml 2026-04-06 08:48:40,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:40,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:40,831 - lava_callback - INFO - Received callback for node 69d373352214054febe38536 INFO: 172.19.0.1:34494 - "POST /node/69d373352214054febe38536 HTTP/1.0" 202 Accepted 2026-04-06 08:48:40,842 - lava_callback - INFO - Starting async job submit for node 69d373352214054febe38536 2026-04-06 08:48:40,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:40,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373352214054febe38536 HTTP/1.1" 200 None 2026-04-06 08:48:40,951 - lava_callback - DEBUG - Processing node 69d373352214054febe38536: baseline-arm64-foundriesio 2026-04-06 08:48:41,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:41,266 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730b2214054febe38420/lava_callback.json.gz 2026-04-06 08:48:41,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:41,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:41,389 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d373342214054febe38533/lava-logs.yaml 2026-04-06 08:48:41,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:41,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3730b2214054febe38420 HTTP/1.1" 200 None 2026-04-06 08:48:41,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:41,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:41,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:41,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:41,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3730b2214054febe38420 HTTP/1.1" 200 None 2026-04-06 08:48:41,578 - lava_callback - INFO - Completed processing callback for node 69d3730b2214054febe38420 2026-04-06 08:48:41,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:41,738 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d373342214054febe38533/lava_callback.json.gz 2026-04-06 08:48:41,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:41,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:41,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d373352214054febe38536/log.txt.gz 2026-04-06 08:48:41,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373342214054febe38533 HTTP/1.1" 200 None 2026-04-06 08:48:41,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:41,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:41,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:42,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373342214054febe38533 HTTP/1.1" 200 None 2026-04-06 08:48:42,070 - lava_callback - INFO - Completed processing callback for node 69d373342214054febe38533 2026-04-06 08:48:42,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:42,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:42,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-06 08:48:42,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:42,595 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d373352214054febe38536/lava-logs.yaml 2026-04-06 08:48:42,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:42,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:42,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d373352214054febe38536/lava_callback.json.gz 2026-04-06 08:48:42,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:42,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373352214054febe38536 HTTP/1.1" 200 None 2026-04-06 08:48:42,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:42,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:42,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:42,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373352214054febe38536 HTTP/1.1" 200 None 2026-04-06 08:48:42,841 - lava_callback - INFO - Completed processing callback for node 69d373352214054febe38536 INFO: 172.19.0.1:34502 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:48:52,268 - lava_callback - INFO - Received callback for node 69d3731b2214054febe3848c INFO: 172.19.0.1:39234 - "POST /node/69d3731b2214054febe3848c HTTP/1.0" 202 Accepted 2026-04-06 08:48:52,278 - lava_callback - INFO - Starting async job submit for node 69d3731b2214054febe3848c 2026-04-06 08:48:52,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:52,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3731b2214054febe3848c HTTP/1.1" 200 None 2026-04-06 08:48:52,340 - lava_callback - DEBUG - Processing node 69d3731b2214054febe3848c: baseline-arm64-broonie 2026-04-06 08:48:52,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:52,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:52,794 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3731b2214054febe3848c/log.txt.gz 2026-04-06 08:48:52,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:53,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:53,134 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3731b2214054febe3848c/lava-logs.yaml 2026-04-06 08:48:53,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:53,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:53,369 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3731b2214054febe3848c/lava_callback.json.gz 2026-04-06 08:48:53,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:53,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3731b2214054febe3848c HTTP/1.1" 200 None 2026-04-06 08:48:53,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:53,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:53,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:53,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3731b2214054febe3848c HTTP/1.1" 200 None 2026-04-06 08:48:53,483 - lava_callback - INFO - Completed processing callback for node 69d3731b2214054febe3848c 2026-04-06 08:48:53,492 - lava_callback - INFO - Received callback for node 69d373312214054febe38529 INFO: 172.19.0.1:39238 - "POST /node/69d373312214054febe38529 HTTP/1.0" 202 Accepted 2026-04-06 08:48:53,516 - lava_callback - INFO - Starting async job submit for node 69d373312214054febe38529 2026-04-06 08:48:53,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:53,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373312214054febe38529 HTTP/1.1" 200 None 2026-04-06 08:48:53,606 - lava_callback - DEBUG - Processing node 69d373312214054febe38529: baseline-arm64-pengutronix 2026-04-06 08:48:53,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:54,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:54,043 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d373312214054febe38529/log.txt.gz 2026-04-06 08:48:54,080 - lava_callback - INFO - Received callback for node 69d373212214054febe384ae INFO: 172.19.0.1:39254 - "POST /node/69d373212214054febe384ae HTTP/1.0" 202 Accepted 2026-04-06 08:48:54,096 - lava_callback - INFO - Starting async job submit for node 69d373212214054febe384ae 2026-04-06 08:48:54,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:54,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:54,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373212214054febe384ae HTTP/1.1" 200 None 2026-04-06 08:48:54,204 - lava_callback - DEBUG - Processing node 69d373212214054febe384ae: baseline-arm64-broonie 2026-04-06 08:48:54,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:54,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:54,592 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d373312214054febe38529/lava-logs.yaml 2026-04-06 08:48:54,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:54,726 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:54,728 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d373212214054febe384ae/log.txt.gz 2026-04-06 08:48:54,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:54,805 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d373312214054febe38529/lava_callback.json.gz 2026-04-06 08:48:54,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:54,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:54,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373312214054febe38529 HTTP/1.1" 200 None 2026-04-06 08:48:54,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:54,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:54,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:54,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373312214054febe38529 HTTP/1.1" 200 None 2026-04-06 08:48:54,977 - lava_callback - INFO - Completed processing callback for node 69d373312214054febe38529 2026-04-06 08:48:55,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:55,215 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d373212214054febe384ae/lava-logs.yaml 2026-04-06 08:48:55,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:48:55,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:48:55,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d373212214054febe384ae/lava_callback.json.gz 2026-04-06 08:48:55,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:55,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373212214054febe384ae HTTP/1.1" 200 None 2026-04-06 08:48:55,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:55,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:48:55,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:48:55,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373212214054febe384ae HTTP/1.1" 200 None 2026-04-06 08:48:55,576 - lava_callback - INFO - Completed processing callback for node 69d373212214054febe384ae INFO: 172.19.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39278 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:49:02,660 - lava_callback - INFO - Received callback for node 69d0d06b691bac272b323660 INFO: 172.19.0.1:56440 - "POST /node/69d0d06b691bac272b323660 HTTP/1.0" 202 Accepted 2026-04-06 08:49:02,668 - lava_callback - INFO - Starting async job submit for node 69d0d06b691bac272b323660 2026-04-06 08:49:02,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:02,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d06b691bac272b323660 HTTP/1.1" 200 None 2026-04-06 08:49:02,697 - lava_callback - DEBUG - Processing node 69d0d06b691bac272b323660: baseline-arm-clabbe 2026-04-06 08:49:02,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d06b691bac272b323660 2026-04-06 08:49:02,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:02,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d06b691bac272b323660 HTTP/1.1" 200 None 2026-04-06 08:49:02,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:02,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 08:49:02,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:02,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d06b691bac272b323660 HTTP/1.1" 200 None 2026-04-06 08:49:02,797 - lava_callback - ERROR - Error processing callback for node 69d0d06b691bac272b323660: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:49:04,386 - lava_callback - INFO - Received callback for node 69d373322214054febe38530 INFO: 172.19.0.1:56452 - "POST /node/69d373322214054febe38530 HTTP/1.0" 202 Accepted 2026-04-06 08:49:04,392 - lava_callback - INFO - Starting async job submit for node 69d373322214054febe38530 2026-04-06 08:49:04,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:04,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373322214054febe38530 HTTP/1.1" 200 None 2026-04-06 08:49:04,440 - lava_callback - DEBUG - Processing node 69d373322214054febe38530: baseline-arm64-pengutronix 2026-04-06 08:49:04,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:04,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:04,806 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d373322214054febe38530/log.txt.gz 2026-04-06 08:49:04,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:05,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:05,172 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d373322214054febe38530/lava-logs.yaml 2026-04-06 08:49:05,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:05,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:05,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d373322214054febe38530/lava_callback.json.gz 2026-04-06 08:49:05,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:05,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373322214054febe38530 HTTP/1.1" 200 None 2026-04-06 08:49:05,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:05,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:49:05,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:05,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373322214054febe38530 HTTP/1.1" 200 None 2026-04-06 08:49:05,471 - lava_callback - INFO - Completed processing callback for node 69d373322214054febe38530 INFO: 172.19.0.1:56456 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:49:11,471 - lava_callback - INFO - Received callback for node 69d3732e2214054febe38523 INFO: 172.19.0.1:51958 - "POST /node/69d3732e2214054febe38523 HTTP/1.0" 202 Accepted 2026-04-06 08:49:11,478 - lava_callback - INFO - Starting async job submit for node 69d3732e2214054febe38523 2026-04-06 08:49:11,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:11,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3732e2214054febe38523 HTTP/1.1" 200 None 2026-04-06 08:49:11,518 - lava_callback - DEBUG - Processing node 69d3732e2214054febe38523: baseline-arm64-kontron 2026-04-06 08:49:11,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:11,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:11,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d3732e2214054febe38523/log.txt.gz 2026-04-06 08:49:12,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:12,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:12,256 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d3732e2214054febe38523/lava-logs.yaml 2026-04-06 08:49:12,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:12,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:12,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-06 08:49:12,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:12,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d3732e2214054febe38523/lava_callback.json.gz 2026-04-06 08:49:12,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:12,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3732e2214054febe38523 HTTP/1.1" 200 None 2026-04-06 08:49:12,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:12,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:49:12,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:12,601 - lava_callback - INFO - Received callback for node 69d373302214054febe38526 2026-04-06 08:49:12,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3732e2214054febe38523 HTTP/1.1" 200 None 2026-04-06 08:49:12,634 - lava_callback - INFO - Completed processing callback for node 69d3732e2214054febe38523 INFO: 172.19.0.1:51962 - "POST /node/69d373302214054febe38526 HTTP/1.0" 202 Accepted 2026-04-06 08:49:12,638 - lava_callback - INFO - Starting async job submit for node 69d373302214054febe38526 2026-04-06 08:49:12,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:12,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373302214054febe38526 HTTP/1.1" 200 None 2026-04-06 08:49:12,742 - lava_callback - DEBUG - Processing node 69d373302214054febe38526: baseline-arm64-kontron 2026-04-06 08:49:13,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:13,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:13,364 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d373302214054febe38526/log.txt.gz 2026-04-06 08:49:13,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:13,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:13,974 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d373302214054febe38526/lava-logs.yaml 2026-04-06 08:49:13,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:14,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:14,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d373302214054febe38526/lava_callback.json.gz 2026-04-06 08:49:14,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:14,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373302214054febe38526 HTTP/1.1" 200 None 2026-04-06 08:49:14,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:14,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:49:14,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:14,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373302214054febe38526 HTTP/1.1" 200 None 2026-04-06 08:49:14,259 - lava_callback - INFO - Completed processing callback for node 69d373302214054febe38526 INFO: 172.19.0.1:51974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51988 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:49:22,629 - lava_callback - INFO - Received callback for node 69d0d088691bac272b323694 INFO: 172.19.0.1:39540 - "POST /node/69d0d088691bac272b323694 HTTP/1.0" 202 Accepted 2026-04-06 08:49:22,637 - lava_callback - INFO - Starting async job submit for node 69d0d088691bac272b323694 2026-04-06 08:49:22,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:22,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d088691bac272b323694 HTTP/1.1" 200 None 2026-04-06 08:49:22,653 - lava_callback - DEBUG - Processing node 69d0d088691bac272b323694: baseline-arm-clabbe 2026-04-06 08:49:22,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d088691bac272b323694 2026-04-06 08:49:22,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:22,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d088691bac272b323694 HTTP/1.1" 200 None 2026-04-06 08:49:22,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:22,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 08:49:22,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:22,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d088691bac272b323694 HTTP/1.1" 200 None 2026-04-06 08:49:22,740 - lava_callback - ERROR - Error processing callback for node 69d0d088691bac272b323694: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39548 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:49:32,476 - lava_callback - INFO - Received callback for node 69d372ab2214054febe382a6 INFO: 172.19.0.1:48794 - "POST /node/69d372ab2214054febe382a6 HTTP/1.0" 202 Accepted 2026-04-06 08:49:32,487 - lava_callback - INFO - Starting async job submit for node 69d372ab2214054febe382a6 2026-04-06 08:49:32,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:32,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ab2214054febe382a6 HTTP/1.1" 200 None 2026-04-06 08:49:32,550 - lava_callback - DEBUG - Processing node 69d372ab2214054febe382a6: ltp-fs_bind 2026-04-06 08:49:33,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:33,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:33,302 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d372ab2214054febe382a6/log.txt.gz 2026-04-06 08:49:33,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:33,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:33,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d372ab2214054febe382a6/lava-logs.yaml 2026-04-06 08:49:33,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:33,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:33,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d372ab2214054febe382a6/lava_callback.json.gz 2026-04-06 08:49:34,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:34,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ab2214054febe382a6 HTTP/1.1" 200 None 2026-04-06 08:49:34,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:34,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:49:34,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:34,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372ab2214054febe382a6 HTTP/1.1" 200 None 2026-04-06 08:49:34,143 - lava_callback - INFO - Completed processing callback for node 69d372ab2214054febe382a6 INFO: 172.19.0.1:48806 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:49:40,693 - lava_callback - INFO - Received callback for node 69d372af2214054febe382b2 INFO: 172.19.0.1:57668 - "POST /node/69d372af2214054febe382b2 HTTP/1.0" 202 Accepted 2026-04-06 08:49:40,704 - lava_callback - INFO - Starting async job submit for node 69d372af2214054febe382b2 2026-04-06 08:49:40,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:40,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372af2214054febe382b2 HTTP/1.1" 200 None 2026-04-06 08:49:40,768 - lava_callback - DEBUG - Processing node 69d372af2214054febe382b2: ltp-input 2026-04-06 08:49:41,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:41,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:41,590 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69d372af2214054febe382b2/log.txt.gz 2026-04-06 08:49:41,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:42,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:42,163 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69d372af2214054febe382b2/lava-logs.yaml 2026-04-06 08:49:42,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:42,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:42,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:42,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69d372af2214054febe382b2/lava_callback.json.gz 2026-04-06 08:49:42,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:42,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 08:49:42,450 - lava_callback - INFO - Received callback for node 69d372b92214054febe382c7 INFO: 172.19.0.1:57676 - "POST /node/69d372b92214054febe382c7 HTTP/1.0" 202 Accepted 2026-04-06 08:49:42,458 - lava_callback - INFO - Starting async job submit for node 69d372b92214054febe382c7 2026-04-06 08:49:42,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:42,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372af2214054febe382b2 HTTP/1.1" 200 None 2026-04-06 08:49:42,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:42,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372b92214054febe382c7 HTTP/1.1" 200 None 2026-04-06 08:49:42,524 - lava_callback - DEBUG - Processing node 69d372b92214054febe382c7: ltp-syscalls 2026-04-06 08:49:42,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:49:42,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:42,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372af2214054febe382b2 HTTP/1.1" 200 None 2026-04-06 08:49:42,641 - lava_callback - INFO - Completed processing callback for node 69d372af2214054febe382b2 2026-04-06 08:49:43,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:43,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:43,987 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d372b92214054febe382c7/log.txt.gz 2026-04-06 08:49:44,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:44,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:44,912 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d372b92214054febe382c7/lava-logs.yaml 2026-04-06 08:49:44,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:49:45,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:49:45,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d372b92214054febe382c7/lava_callback.json.gz 2026-04-06 08:49:45,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:45,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372b92214054febe382c7 HTTP/1.1" 200 None 2026-04-06 08:49:45,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:45,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:49:45,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:49:45,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372b92214054febe382c7 HTTP/1.1" 200 None 2026-04-06 08:49:45,272 - lava_callback - INFO - Completed processing callback for node 69d372b92214054febe382c7 INFO: 172.19.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46030 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:50:02,668 - lava_callback - INFO - Received callback for node 69d0d0a8691bac272b3236cd INFO: 172.19.0.1:36528 - "POST /node/69d0d0a8691bac272b3236cd HTTP/1.0" 202 Accepted 2026-04-06 08:50:02,676 - lava_callback - INFO - Starting async job submit for node 69d0d0a8691bac272b3236cd 2026-04-06 08:50:02,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:02,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d0a8691bac272b3236cd HTTP/1.1" 200 None 2026-04-06 08:50:02,705 - lava_callback - DEBUG - Processing node 69d0d0a8691bac272b3236cd: baseline-arm-clabbe 2026-04-06 08:50:02,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d0a8691bac272b3236cd 2026-04-06 08:50:02,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:02,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d0a8691bac272b3236cd HTTP/1.1" 200 None 2026-04-06 08:50:02,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:02,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 08:50:02,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:02,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d0a8691bac272b3236cd HTTP/1.1" 200 None 2026-04-06 08:50:02,813 - lava_callback - ERROR - Error processing callback for node 69d0d0a8691bac272b3236cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:50:04,245 - lava_callback - INFO - Received callback for node 69d370002214054febe37f8e INFO: 172.19.0.1:36534 - "POST /node/69d370002214054febe37f8e HTTP/1.0" 202 Accepted 2026-04-06 08:50:04,261 - lava_callback - INFO - Starting async job submit for node 69d370002214054febe37f8e 2026-04-06 08:50:04,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:04,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d370002214054febe37f8e HTTP/1.1" 200 None 2026-04-06 08:50:04,417 - lava_callback - DEBUG - Processing node 69d370002214054febe37f8e: baseline-x86 2026-04-06 08:50:05,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:05,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:05,998 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d370002214054febe37f8e/log.txt.gz INFO: 172.19.0.1:36546 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:50:06,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:07,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:07,234 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d370002214054febe37f8e/lava-logs.yaml 2026-04-06 08:50:07,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:08,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:08,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d370002214054febe37f8e/lava_callback.json.gz DEBUG: Setup failed for 69d370002214054febe37f8e. Transitting job node result: incomplete -> fail 2026-04-06 08:50:08,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:08,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d370002214054febe37f8e HTTP/1.1" 200 None 2026-04-06 08:50:08,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:08,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c3f2214054febe37d8c HTTP/1.1" 200 None 2026-04-06 08:50:08,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:08,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d370002214054febe37f8e HTTP/1.1" 200 None 2026-04-06 08:50:08,512 - lava_callback - INFO - Completed processing callback for node 69d370002214054febe37f8e 2026-04-06 08:50:12,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:12,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57440 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:50:20,739 - lava_callback - INFO - Received callback for node 69d372b12214054febe382b5 INFO: 172.19.0.1:40654 - "POST /node/69d372b12214054febe382b5 HTTP/1.0" 202 Accepted 2026-04-06 08:50:20,751 - lava_callback - INFO - Starting async job submit for node 69d372b12214054febe382b5 2026-04-06 08:50:20,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:20,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372b12214054febe382b5 HTTP/1.1" 200 None 2026-04-06 08:50:20,831 - lava_callback - DEBUG - Processing node 69d372b12214054febe382b5: ltp-ipc 2026-04-06 08:50:21,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:22,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:22,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69d372b12214054febe382b5/log.txt.gz 2026-04-06 08:50:22,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:22,673 - lava_callback - INFO - Received callback for node 69d0d0cc691bac272b323706 INFO: 172.19.0.1:40666 - "POST /node/69d0d0cc691bac272b323706 HTTP/1.0" 202 Accepted 2026-04-06 08:50:22,685 - lava_callback - INFO - Starting async job submit for node 69d0d0cc691bac272b323706 2026-04-06 08:50:22,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:22,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d0cc691bac272b323706 HTTP/1.1" 200 None 2026-04-06 08:50:22,719 - lava_callback - DEBUG - Processing node 69d0d0cc691bac272b323706: baseline-arm-clabbe 2026-04-06 08:50:22,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d0cc691bac272b323706 2026-04-06 08:50:22,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:22,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d0cc691bac272b323706 HTTP/1.1" 200 None 2026-04-06 08:50:22,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:22,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 08:50:22,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:22,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d0cc691bac272b323706 HTTP/1.1" 200 None 2026-04-06 08:50:22,827 - lava_callback - ERROR - Error processing callback for node 69d0d0cc691bac272b323706: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 08:50:23,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:23,749 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69d372b12214054febe382b5/lava-logs.yaml 2026-04-06 08:50:23,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:24,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:24,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69d372b12214054febe382b5/lava_callback.json.gz 2026-04-06 08:50:24,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:24,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372b12214054febe382b5 HTTP/1.1" 200 None 2026-04-06 08:50:24,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:24,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:50:24,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:24,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372b12214054febe382b5 HTTP/1.1" 200 None 2026-04-06 08:50:24,378 - lava_callback - INFO - Completed processing callback for node 69d372b12214054febe382b5 INFO: 172.19.0.1:40682 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:50:30,834 - lava_callback - INFO - Received callback for node 69d372f32214054febe383ae INFO: 172.19.0.1:54036 - "POST /node/69d372f32214054febe383ae HTTP/1.0" 202 Accepted 2026-04-06 08:50:30,844 - lava_callback - INFO - Starting async job submit for node 69d372f32214054febe383ae 2026-04-06 08:50:30,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:30,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f32214054febe383ae HTTP/1.1" 200 None 2026-04-06 08:50:30,900 - lava_callback - DEBUG - Processing node 69d372f32214054febe383ae: baseline-arm64 2026-04-06 08:50:31,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:32,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:32,289 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f32214054febe383ae/log.txt.gz 2026-04-06 08:50:32,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:33,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:33,486 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f32214054febe383ae/lava-logs.yaml 2026-04-06 08:50:33,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:34,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:34,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f32214054febe383ae/lava_callback.json.gz 2026-04-06 08:50:34,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:34,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f32214054febe383ae HTTP/1.1" 200 None 2026-04-06 08:50:34,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:34,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:50:34,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:34,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372f32214054febe383ae HTTP/1.1" 200 None 2026-04-06 08:50:34,142 - lava_callback - INFO - Completed processing callback for node 69d372f32214054febe383ae INFO: 172.19.0.1:54050 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:50:41,056 - lava_callback - INFO - Received callback for node 69d372b32214054febe382b8 INFO: 172.19.0.1:38168 - "POST /node/69d372b32214054febe382b8 HTTP/1.0" 202 Accepted 2026-04-06 08:50:41,068 - lava_callback - INFO - Starting async job submit for node 69d372b32214054febe382b8 2026-04-06 08:50:41,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:41,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372b32214054febe382b8 HTTP/1.1" 200 None 2026-04-06 08:50:41,180 - lava_callback - DEBUG - Processing node 69d372b32214054febe382b8: ltp-pty 2026-04-06 08:50:41,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:41,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:41,935 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69d372b32214054febe382b8/log.txt.gz 2026-04-06 08:50:42,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:42,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:42,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 08:50:42,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:42,704 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69d372b32214054febe382b8/lava-logs.yaml 2026-04-06 08:50:42,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:43,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:43,178 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69d372b32214054febe382b8/lava_callback.json.gz 2026-04-06 08:50:43,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:43,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372b32214054febe382b8 HTTP/1.1" 200 None 2026-04-06 08:50:43,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:43,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:50:43,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:43,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372b32214054febe382b8 HTTP/1.1" 200 None 2026-04-06 08:50:43,333 - lava_callback - INFO - Completed processing callback for node 69d372b32214054febe382b8 INFO: 172.19.0.1:38172 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:50:55,207 - lava_callback - INFO - Received callback for node 69d0d0ec691bac272b323720 INFO: 172.19.0.1:50394 - "POST /node/69d0d0ec691bac272b323720 HTTP/1.0" 202 Accepted 2026-04-06 08:50:55,216 - lava_callback - INFO - Starting async job submit for node 69d0d0ec691bac272b323720 2026-04-06 08:50:55,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:55,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d0ec691bac272b323720 HTTP/1.1" 200 None 2026-04-06 08:50:55,248 - lava_callback - DEBUG - Processing node 69d0d0ec691bac272b323720: baseline-arm-baylibre 2026-04-06 08:50:55,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d0ec691bac272b323720 2026-04-06 08:50:55,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:55,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d0ec691bac272b323720 HTTP/1.1" 200 None 2026-04-06 08:50:55,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:55,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 08:50:55,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:55,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d0ec691bac272b323720 HTTP/1.1" 200 None 2026-04-06 08:50:55,336 - lava_callback - ERROR - Error processing callback for node 69d0d0ec691bac272b323720: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50404 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:50:58,890 - lava_callback - INFO - Received callback for node 69d373032214054febe3840a INFO: 172.19.0.1:50408 - "POST /node/69d373032214054febe3840a HTTP/1.0" 202 Accepted 2026-04-06 08:50:58,900 - lava_callback - INFO - Starting async job submit for node 69d373032214054febe3840a 2026-04-06 08:50:58,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:50:58,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373032214054febe3840a HTTP/1.1" 200 None 2026-04-06 08:50:58,966 - lava_callback - DEBUG - Processing node 69d373032214054febe3840a: baseline-nfs-arm64 2026-04-06 08:50:59,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:50:59,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:50:59,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373032214054febe3840a/log.txt.gz 2026-04-06 08:51:00,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:51:00,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:51:00,588 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373032214054febe3840a/lava-logs.yaml 2026-04-06 08:51:00,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:51:01,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:51:01,164 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373032214054febe3840a/lava_callback.json.gz 2026-04-06 08:51:01,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:01,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373032214054febe3840a HTTP/1.1" 200 None 2026-04-06 08:51:01,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:01,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:51:01,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:01,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373032214054febe3840a HTTP/1.1" 200 None 2026-04-06 08:51:01,293 - lava_callback - INFO - Completed processing callback for node 69d373032214054febe3840a INFO: 172.19.0.1:38950 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:51:12,060 - lava_callback - INFO - Received callback for node 69d373202214054febe384ab INFO: 172.19.0.1:41154 - "POST /node/69d373202214054febe384ab HTTP/1.0" 202 Accepted 2026-04-06 08:51:12,070 - lava_callback - INFO - Starting async job submit for node 69d373202214054febe384ab 2026-04-06 08:51:12,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:12,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373202214054febe384ab HTTP/1.1" 200 None 2026-04-06 08:51:12,140 - lava_callback - DEBUG - Processing node 69d373202214054febe384ab: baseline-arm64-broonie 2026-04-06 08:51:12,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:12,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 08:51:12,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:51:13,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:51:13,169 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d373202214054febe384ab/log.txt.gz 2026-04-06 08:51:13,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:51:14,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:51:14,116 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d373202214054febe384ab/lava-logs.yaml 2026-04-06 08:51:14,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:51:14,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:51:14,723 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d373202214054febe384ab/lava_callback.json.gz 2026-04-06 08:51:14,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:14,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373202214054febe384ab HTTP/1.1" 200 None 2026-04-06 08:51:14,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:14,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:51:14,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:14,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373202214054febe384ab HTTP/1.1" 200 None 2026-04-06 08:51:14,920 - lava_callback - INFO - Completed processing callback for node 69d373202214054febe384ab INFO: 172.19.0.1:41160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41170 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:51:20,770 - lava_callback - INFO - Received callback for node 69d372ad2214054febe382ad INFO: 172.19.0.1:60174 - "POST /node/69d372ad2214054febe382ad HTTP/1.0" 202 Accepted 2026-04-06 08:51:20,777 - lava_callback - INFO - Starting async job submit for node 69d372ad2214054febe382ad 2026-04-06 08:51:20,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:20,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ad2214054febe382ad HTTP/1.1" 200 None 2026-04-06 08:51:20,841 - lava_callback - DEBUG - Processing node 69d372ad2214054febe382ad: ltp-fsx 2026-04-06 08:51:21,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:51:21,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:51:21,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69d372ad2214054febe382ad/log.txt.gz 2026-04-06 08:51:22,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:51:22,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:51:22,724 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69d372ad2214054febe382ad/lava-logs.yaml 2026-04-06 08:51:22,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:51:23,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:51:23,187 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69d372ad2214054febe382ad/lava_callback.json.gz 2026-04-06 08:51:23,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:23,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372ad2214054febe382ad HTTP/1.1" 200 None 2026-04-06 08:51:23,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:23,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:51:23,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:23,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372ad2214054febe382ad HTTP/1.1" 200 None 2026-04-06 08:51:23,335 - lava_callback - INFO - Completed processing callback for node 69d372ad2214054febe382ad INFO: 172.19.0.1:60180 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:51:36,162 - lava_callback - INFO - Received callback for node 69d3730d2214054febe3842a INFO: 172.19.0.1:40268 - "POST /node/69d3730d2214054febe3842a HTTP/1.0" 202 Accepted 2026-04-06 08:51:36,169 - lava_callback - INFO - Starting async job submit for node 69d3730d2214054febe3842a 2026-04-06 08:51:36,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:36,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3730d2214054febe3842a HTTP/1.1" 200 None 2026-04-06 08:51:36,216 - lava_callback - DEBUG - Processing node 69d3730d2214054febe3842a: baseline-nfs-arm64 INFO: 172.19.0.1:40272 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:51:36,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:51:36,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:51:36,912 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730d2214054febe3842a/log.txt.gz 2026-04-06 08:51:37,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:51:37,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:51:37,339 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730d2214054febe3842a/lava-logs.yaml 2026-04-06 08:51:37,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:51:37,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:51:37,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730d2214054febe3842a/lava_callback.json.gz 2026-04-06 08:51:37,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:37,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3730d2214054febe3842a HTTP/1.1" 200 None 2026-04-06 08:51:37,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:37,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:51:37,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:37,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3730d2214054febe3842a HTTP/1.1" 200 None 2026-04-06 08:51:37,580 - lava_callback - INFO - Completed processing callback for node 69d3730d2214054febe3842a 2026-04-06 08:51:42,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:51:42,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38772 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:52:20,316 - lava_callback - INFO - Received callback for node 69d372f52214054febe383b5 INFO: 172.19.0.1:40000 - "POST /node/69d372f52214054febe383b5 HTTP/1.0" 202 Accepted 2026-04-06 08:52:20,323 - lava_callback - INFO - Starting async job submit for node 69d372f52214054febe383b5 2026-04-06 08:52:20,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:52:20,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f52214054febe383b5 HTTP/1.1" 200 None 2026-04-06 08:52:20,368 - lava_callback - DEBUG - Processing node 69d372f52214054febe383b5: baseline-arm64 2026-04-06 08:52:20,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:52:20,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:52:20,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f52214054febe383b5/log.txt.gz 2026-04-06 08:52:21,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:52:21,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:52:21,348 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f52214054febe383b5/lava-logs.yaml 2026-04-06 08:52:21,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:52:21,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:52:21,496 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372f52214054febe383b5/lava_callback.json.gz 2026-04-06 08:52:21,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:52:21,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372f52214054febe383b5 HTTP/1.1" 200 None 2026-04-06 08:52:21,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:52:21,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:52:21,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:52:21,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372f52214054febe383b5 HTTP/1.1" 200 None 2026-04-06 08:52:21,601 - lava_callback - INFO - Completed processing callback for node 69d372f52214054febe383b5 INFO: 172.19.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49090 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:52:42,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:52:42,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49428 - "GET /node/69840be3969566dcb0d2bc4e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:49430 - "GET /node/6998f954d17b46e99fad262b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:49446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42650 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:53:40,875 - lava_callback - INFO - Received callback for node 69d372b72214054febe382c4 INFO: 172.19.0.1:59884 - "POST /node/69d372b72214054febe382c4 HTTP/1.0" 202 Accepted 2026-04-06 08:53:40,883 - lava_callback - INFO - Starting async job submit for node 69d372b72214054febe382c4 2026-04-06 08:53:40,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:40,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372b72214054febe382c4 HTTP/1.1" 200 None 2026-04-06 08:53:40,924 - lava_callback - DEBUG - Processing node 69d372b72214054febe382c4: ltp-smoke 2026-04-06 08:53:41,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:53:41,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:53:41,448 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d372b72214054febe382c4/log.txt.gz 2026-04-06 08:53:41,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:53:41,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:53:41,882 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d372b72214054febe382c4/lava-logs.yaml 2026-04-06 08:53:41,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:53:42,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:53:42,094 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d372b72214054febe382c4/lava_callback.json.gz 2026-04-06 08:53:42,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:42,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372b72214054febe382c4 HTTP/1.1" 200 None 2026-04-06 08:53:42,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:42,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:53:42,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:42,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372b72214054febe382c4 HTTP/1.1" 200 None 2026-04-06 08:53:42,211 - lava_callback - INFO - Completed processing callback for node 69d372b72214054febe382c4 2026-04-06 08:53:42,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:42,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59890 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:53:52,283 - lava_callback - INFO - Received callback for node 69d3704c2214054febe37fc0 INFO: 172.19.0.1:51150 - "POST /node/69d3704c2214054febe37fc0 HTTP/1.0" 202 Accepted 2026-04-06 08:53:52,290 - lava_callback - INFO - Starting async job submit for node 69d3704c2214054febe37fc0 2026-04-06 08:53:52,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:52,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3704c2214054febe37fc0 HTTP/1.1" 200 None 2026-04-06 08:53:52,365 - lava_callback - DEBUG - Processing node 69d3704c2214054febe37fc0: ltp-smoke 2026-04-06 08:53:52,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:53:53,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:53:53,076 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d3704c2214054febe37fc0/log.txt.gz 2026-04-06 08:53:53,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:53:53,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:53:53,717 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d3704c2214054febe37fc0/lava-logs.yaml 2026-04-06 08:53:53,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:53:53,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:53:53,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d3704c2214054febe37fc0/lava_callback.json.gz 2026-04-06 08:53:53,966 - lava_callback - INFO - Received callback for node 69d372b52214054febe382bb INFO: 172.19.0.1:51154 - "POST /node/69d372b52214054febe382bb HTTP/1.0" 202 Accepted 2026-04-06 08:53:53,995 - lava_callback - INFO - Starting async job submit for node 69d372b52214054febe382bb 2026-04-06 08:53:54,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:54,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:54,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372b52214054febe382bb HTTP/1.1" 200 None 2026-04-06 08:53:54,115 - lava_callback - DEBUG - Processing node 69d372b52214054febe382bb: ltp-sched 2026-04-06 08:53:54,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3704c2214054febe37fc0 HTTP/1.1" 200 None 2026-04-06 08:53:54,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:54,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c272214054febe37d68 HTTP/1.1" 200 None 2026-04-06 08:53:54,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:54,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3704c2214054febe37fc0 HTTP/1.1" 200 None 2026-04-06 08:53:54,571 - lava_callback - INFO - Completed processing callback for node 69d3704c2214054febe37fc0 2026-04-06 08:53:54,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:53:54,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:53:54,791 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69d372b52214054febe382bb/log.txt.gz 2026-04-06 08:53:54,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:53:55,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:53:55,199 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69d372b52214054febe382bb/lava-logs.yaml 2026-04-06 08:53:55,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:53:55,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:53:55,375 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69d372b52214054febe382bb/lava_callback.json.gz 2026-04-06 08:53:55,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:55,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372b52214054febe382bb HTTP/1.1" 200 None 2026-04-06 08:53:55,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:55,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:53:55,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:53:55,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372b52214054febe382bb HTTP/1.1" 200 None 2026-04-06 08:53:55,468 - lava_callback - INFO - Completed processing callback for node 69d372b52214054febe382bb INFO: 172.19.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49876 - "GET /node/699368b7cebe99dd8e0665a6%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-06 08:54:11,182 - lava_callback - INFO - Received callback for node 69d373022214054febe38407 INFO: 172.19.0.1:49884 - "POST /node/69d373022214054febe38407 HTTP/1.0" 202 Accepted 2026-04-06 08:54:11,189 - lava_callback - INFO - Starting async job submit for node 69d373022214054febe38407 2026-04-06 08:54:11,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:11,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373022214054febe38407 HTTP/1.1" 200 None 2026-04-06 08:54:11,239 - lava_callback - DEBUG - Processing node 69d373022214054febe38407: baseline-nfs-arm64 2026-04-06 08:54:11,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:54:11,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:54:11,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373022214054febe38407/log.txt.gz 2026-04-06 08:54:12,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:54:12,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:54:12,214 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373022214054febe38407/lava-logs.yaml 2026-04-06 08:54:12,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:54:12,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:54:12,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373022214054febe38407/lava_callback.json.gz 2026-04-06 08:54:12,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:12,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373022214054febe38407 HTTP/1.1" 200 None 2026-04-06 08:54:12,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:12,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:54:12,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:12,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373022214054febe38407 HTTP/1.1" 200 None 2026-04-06 08:54:12,470 - lava_callback - INFO - Completed processing callback for node 69d373022214054febe38407 2026-04-06 08:54:12,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:12,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:49888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51308 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:54:33,592 - lava_callback - INFO - Received callback for node 69d373012214054febe38404 INFO: 172.19.0.1:36738 - "POST /node/69d373012214054febe38404 HTTP/1.0" 202 Accepted 2026-04-06 08:54:33,599 - lava_callback - INFO - Starting async job submit for node 69d373012214054febe38404 2026-04-06 08:54:33,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:33,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373012214054febe38404 HTTP/1.1" 200 None 2026-04-06 08:54:33,650 - lava_callback - DEBUG - Processing node 69d373012214054febe38404: baseline-arm64 2026-04-06 08:54:34,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:54:34,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:54:34,261 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d373012214054febe38404/log.txt.gz 2026-04-06 08:54:34,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:54:34,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:54:34,697 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d373012214054febe38404/lava-logs.yaml 2026-04-06 08:54:34,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:54:34,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:54:34,891 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d373012214054febe38404/lava_callback.json.gz DEBUG: Setup failed for 69d373012214054febe38404. Transitting job node result: incomplete -> fail 2026-04-06 08:54:34,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:34,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373012214054febe38404 HTTP/1.1" 200 None 2026-04-06 08:54:34,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:35,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:54:35,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:35,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373012214054febe38404 HTTP/1.1" 200 None 2026-04-06 08:54:35,109 - lava_callback - INFO - Completed processing callback for node 69d373012214054febe38404 INFO: 172.19.0.1:36748 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:54:41,033 - lava_callback - INFO - Received callback for node 69d373bc2214054febe386aa INFO: 172.19.0.1:38502 - "POST /node/69d373bc2214054febe386aa HTTP/1.0" 202 Accepted 2026-04-06 08:54:41,039 - lava_callback - INFO - Starting async job submit for node 69d373bc2214054febe386aa 2026-04-06 08:54:41,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:41,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373bc2214054febe386aa HTTP/1.1" 200 None 2026-04-06 08:54:41,094 - lava_callback - DEBUG - Processing node 69d373bc2214054febe386aa: ltp-cap_bounds 2026-04-06 08:54:41,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:54:41,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:54:41,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d373bc2214054febe386aa/log.txt.gz 2026-04-06 08:54:41,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:54:42,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:54:42,068 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d373bc2214054febe386aa/lava-logs.yaml 2026-04-06 08:54:42,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:54:42,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:54:42,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d373bc2214054febe386aa/lava_callback.json.gz 2026-04-06 08:54:42,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:42,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373bc2214054febe386aa HTTP/1.1" 200 None 2026-04-06 08:54:42,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:42,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:54:42,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:42,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373bc2214054febe386aa HTTP/1.1" 200 None 2026-04-06 08:54:42,403 - lava_callback - INFO - Completed processing callback for node 69d373bc2214054febe386aa 2026-04-06 08:54:42,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:54:42,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49344 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:56:35,592 - lava_callback - INFO - Received callback for node 69d0d230691bac272b323874 INFO: 172.19.0.1:59250 - "POST /node/69d0d230691bac272b323874 HTTP/1.0" 202 Accepted 2026-04-06 08:56:35,600 - lava_callback - INFO - Starting async job submit for node 69d0d230691bac272b323874 2026-04-06 08:56:35,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:56:35,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d230691bac272b323874 HTTP/1.1" 200 None 2026-04-06 08:56:35,626 - lava_callback - DEBUG - Processing node 69d0d230691bac272b323874: baseline-arm-baylibre 2026-04-06 08:56:35,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d230691bac272b323874 2026-04-06 08:56:35,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:56:35,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d230691bac272b323874 HTTP/1.1" 200 None 2026-04-06 08:56:35,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:56:35,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 08:56:35,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:56:35,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d230691bac272b323874 HTTP/1.1" 200 None 2026-04-06 08:56:35,725 - lava_callback - ERROR - Error processing callback for node 69d0d230691bac272b323874: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54976 - "GET /node/6984c9933ff18e47df61184a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:54984 - "GET /node/6918b52a9c0fefc40758147d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:54994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53160 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:57:30,798 - lava_callback - INFO - Received callback for node 69d3730c2214054febe38427 INFO: 172.19.0.1:39258 - "POST /node/69d3730c2214054febe38427 HTTP/1.0" 202 Accepted 2026-04-06 08:57:30,813 - lava_callback - INFO - Starting async job submit for node 69d3730c2214054febe38427 2026-04-06 08:57:30,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:30,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3730c2214054febe38427 HTTP/1.1" 200 None 2026-04-06 08:57:30,905 - lava_callback - DEBUG - Processing node 69d3730c2214054febe38427: baseline-nfs-arm64 2026-04-06 08:57:31,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:31,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:31,843 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730c2214054febe38427/log.txt.gz 2026-04-06 08:57:32,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:32,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:32,308 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730c2214054febe38427/lava-logs.yaml 2026-04-06 08:57:32,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:32,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:32,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d3730c2214054febe38427/lava_callback.json.gz 2026-04-06 08:57:32,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:32,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3730c2214054febe38427 HTTP/1.1" 200 None 2026-04-06 08:57:32,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:32,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:57:32,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:32,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3730c2214054febe38427 HTTP/1.1" 200 None 2026-04-06 08:57:32,678 - lava_callback - INFO - Completed processing callback for node 69d3730c2214054febe38427 INFO: 172.19.0.1:39260 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:57:41,253 - lava_callback - INFO - Received callback for node 69d374222214054febe38750 INFO: 172.19.0.1:37792 - "POST /node/69d374222214054febe38750 HTTP/1.0" 202 Accepted 2026-04-06 08:57:41,260 - lava_callback - INFO - Starting async job submit for node 69d374222214054febe38750 2026-04-06 08:57:41,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:41,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d374222214054febe38750 HTTP/1.1" 200 None 2026-04-06 08:57:41,300 - lava_callback - DEBUG - Processing node 69d374222214054febe38750: ltp-cve 2026-04-06 08:57:41,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:41,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:41,817 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69d374222214054febe38750/log.txt.gz 2026-04-06 08:57:42,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:42,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:42,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69d374222214054febe38750/lava-logs.yaml 2026-04-06 08:57:42,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:42,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:42,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69d374222214054febe38750/lava_callback.json.gz 2026-04-06 08:57:42,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:42,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d374222214054febe38750 HTTP/1.1" 200 None 2026-04-06 08:57:42,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:42,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:57:42,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:42,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d374222214054febe38750 HTTP/1.1" 200 None 2026-04-06 08:57:42,510 - lava_callback - INFO - Completed processing callback for node 69d374222214054febe38750 2026-04-06 08:57:42,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:42,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37796 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:57:50,649 - lava_callback - INFO - Received callback for node 69d372fc2214054febe383d1 INFO: 172.19.0.1:38028 - "POST /node/69d372fc2214054febe383d1 HTTP/1.0" 202 Accepted 2026-04-06 08:57:50,655 - lava_callback - INFO - Starting async job submit for node 69d372fc2214054febe383d1 2026-04-06 08:57:50,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:50,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372fc2214054febe383d1 HTTP/1.1" 200 None 2026-04-06 08:57:50,695 - lava_callback - DEBUG - Processing node 69d372fc2214054febe383d1: baseline-arm64 2026-04-06 08:57:51,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:51,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:51,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fc2214054febe383d1/log.txt.gz 2026-04-06 08:57:51,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:51,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:51,796 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fc2214054febe383d1/lava-logs.yaml 2026-04-06 08:57:51,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:51,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:51,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d372fc2214054febe383d1/lava_callback.json.gz 2026-04-06 08:57:51,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:52,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372fc2214054febe383d1 HTTP/1.1" 200 None 2026-04-06 08:57:52,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:52,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 08:57:52,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:52,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372fc2214054febe383d1 HTTP/1.1" 200 None 2026-04-06 08:57:52,128 - lava_callback - INFO - Completed processing callback for node 69d372fc2214054febe383d1 2026-04-06 08:57:52,366 - lava_callback - INFO - Received callback for node 69d374612214054febe38798 INFO: 172.19.0.1:38032 - "POST /node/69d374612214054febe38798 HTTP/1.0" 202 Accepted 2026-04-06 08:57:52,372 - lava_callback - INFO - Starting async job submit for node 69d374612214054febe38798 2026-04-06 08:57:52,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:52,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d374612214054febe38798 HTTP/1.1" 200 None 2026-04-06 08:57:52,413 - lava_callback - DEBUG - Processing node 69d374612214054febe38798: ltp-timers 2026-04-06 08:57:52,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:52,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:52,864 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69d374612214054febe38798/log.txt.gz 2026-04-06 08:57:53,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:53,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:53,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69d374612214054febe38798/lava-logs.yaml 2026-04-06 08:57:53,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:57:53,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:57:53,467 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69d374612214054febe38798/lava_callback.json.gz 2026-04-06 08:57:53,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:53,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d374612214054febe38798 HTTP/1.1" 200 None 2026-04-06 08:57:53,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:53,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:57:53,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:57:53,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d374612214054febe38798 HTTP/1.1" 200 None 2026-04-06 08:57:53,556 - lava_callback - INFO - Completed processing callback for node 69d374612214054febe38798 INFO: 172.19.0.1:38048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56164 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:58:12,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:12,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57662 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:58:21,067 - lava_callback - INFO - Received callback for node 69d372bb2214054febe382ca INFO: 172.19.0.1:33748 - "POST /node/69d372bb2214054febe382ca HTTP/1.0" 202 Accepted 2026-04-06 08:58:21,073 - lava_callback - INFO - Starting async job submit for node 69d372bb2214054febe382ca 2026-04-06 08:58:21,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:21,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372bb2214054febe382ca HTTP/1.1" 200 None 2026-04-06 08:58:21,124 - lava_callback - DEBUG - Processing node 69d372bb2214054febe382ca: ltp-syscalls-ipc 2026-04-06 08:58:21,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:58:21,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:58:21,681 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d372bb2214054febe382ca/log.txt.gz 2026-04-06 08:58:21,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:58:22,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:58:22,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d372bb2214054febe382ca/lava-logs.yaml 2026-04-06 08:58:22,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:58:22,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:58:22,598 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d372bb2214054febe382ca/lava_callback.json.gz 2026-04-06 08:58:22,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:22,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372bb2214054febe382ca HTTP/1.1" 200 None 2026-04-06 08:58:22,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:22,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:58:22,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:22,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372bb2214054febe382ca HTTP/1.1" 200 None 2026-04-06 08:58:22,708 - lava_callback - INFO - Completed processing callback for node 69d372bb2214054febe382ca INFO: 172.19.0.1:33754 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:58:35,585 - lava_callback - INFO - Received callback for node 69d0d2b4691bac272b323925 INFO: 172.19.0.1:38700 - "POST /node/69d0d2b4691bac272b323925 HTTP/1.0" 202 Accepted 2026-04-06 08:58:35,590 - lava_callback - INFO - Starting async job submit for node 69d0d2b4691bac272b323925 2026-04-06 08:58:35,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:35,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d2b4691bac272b323925 HTTP/1.1" 200 None 2026-04-06 08:58:35,611 - lava_callback - DEBUG - Processing node 69d0d2b4691bac272b323925: baseline-arm-baylibre 2026-04-06 08:58:35,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d2b4691bac272b323925 2026-04-06 08:58:35,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:35,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d2b4691bac272b323925 HTTP/1.1" 200 None 2026-04-06 08:58:35,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:35,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 08:58:35,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:35,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d2b4691bac272b323925 HTTP/1.1" 200 None 2026-04-06 08:58:35,664 - lava_callback - ERROR - Error processing callback for node 69d0d2b4691bac272b323925: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38714 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:58:41,084 - lava_callback - INFO - Received callback for node 69d374822214054febe387c2 INFO: 172.19.0.1:39118 - "POST /node/69d374822214054febe387c2 HTTP/1.0" 202 Accepted 2026-04-06 08:58:41,090 - lava_callback - INFO - Starting async job submit for node 69d374822214054febe387c2 2026-04-06 08:58:41,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:41,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d374822214054febe387c2 HTTP/1.1" 200 None 2026-04-06 08:58:41,132 - lava_callback - DEBUG - Processing node 69d374822214054febe387c2: ltp-watchqueue 2026-04-06 08:58:41,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:58:41,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:58:41,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d374822214054febe387c2/log.txt.gz 2026-04-06 08:58:41,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:58:42,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:58:42,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d374822214054febe387c2/lava-logs.yaml 2026-04-06 08:58:42,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 08:58:42,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 08:58:42,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d374822214054febe387c2/lava_callback.json.gz 2026-04-06 08:58:42,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:42,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d374822214054febe387c2 HTTP/1.1" 200 None 2026-04-06 08:58:42,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:42,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 08:58:42,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:42,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d374822214054febe387c2 HTTP/1.1" 200 None 2026-04-06 08:58:42,337 - lava_callback - INFO - Completed processing callback for node 69d374822214054febe387c2 2026-04-06 08:58:42,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:58:42,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39138 - "GET /node/698a0e5e22b4cc0f227ad856%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55852 - "GET / HTTP/1.0" 200 OK 2026-04-06 08:59:43,126 - lava_callback - INFO - Received callback for node 69d0d2f7691bac272b32397b INFO: 172.19.0.1:58388 - "POST /node/69d0d2f7691bac272b32397b HTTP/1.0" 202 Accepted 2026-04-06 08:59:43,132 - lava_callback - INFO - Starting async job submit for node 69d0d2f7691bac272b32397b 2026-04-06 08:59:43,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:59:43,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d2f7691bac272b32397b HTTP/1.1" 200 None 2026-04-06 08:59:43,159 - lava_callback - DEBUG - Processing node 69d0d2f7691bac272b32397b: baseline-arm-clabbe 2026-04-06 08:59:43,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d2f7691bac272b32397b 2026-04-06 08:59:43,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:59:43,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d2f7691bac272b32397b HTTP/1.1" 200 None 2026-04-06 08:59:43,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:59:43,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 08:59:43,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 08:59:43,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d2f7691bac272b32397b HTTP/1.1" 200 None 2026-04-06 08:59:43,217 - lava_callback - ERROR - Error processing callback for node 69d0d2f7691bac272b32397b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60036 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:00:43,196 - lava_callback - INFO - Received callback for node 69d0d337691bac272b3239cf INFO: 172.19.0.1:55946 - "POST /node/69d0d337691bac272b3239cf HTTP/1.0" 202 Accepted 2026-04-06 09:00:43,202 - lava_callback - INFO - Starting async job submit for node 69d0d337691bac272b3239cf 2026-04-06 09:00:43,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:00:43,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d337691bac272b3239cf HTTP/1.1" 200 None 2026-04-06 09:00:43,218 - lava_callback - DEBUG - Processing node 69d0d337691bac272b3239cf: baseline-arm-clabbe 2026-04-06 09:00:43,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d337691bac272b3239cf 2026-04-06 09:00:43,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:00:43,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d337691bac272b3239cf HTTP/1.1" 200 None 2026-04-06 09:00:43,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:00:43,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 09:00:43,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:00:43,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d337691bac272b3239cf HTTP/1.1" 200 None 2026-04-06 09:00:43,276 - lava_callback - ERROR - Error processing callback for node 69d0d337691bac272b3239cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40964 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:01:06,256 - lava_callback - INFO - Received callback for node 69d372532214054febe38170 INFO: 172.19.0.1:59798 - "POST /node/69d372532214054febe38170 HTTP/1.0" 202 Accepted 2026-04-06 09:01:06,263 - lava_callback - INFO - Starting async job submit for node 69d372532214054febe38170 2026-04-06 09:01:06,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:01:06,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372532214054febe38170 HTTP/1.1" 200 None 2026-04-06 09:01:06,334 - lava_callback - DEBUG - Processing node 69d372532214054febe38170: baseline-arm INFO: 172.19.0.1:59802 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:01:06,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:01:07,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:01:07,127 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d372532214054febe38170/log.txt.gz 2026-04-06 09:01:07,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:01:07,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:01:07,796 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d372532214054febe38170/lava-logs.yaml 2026-04-06 09:01:07,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:01:07,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:01:07,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d372532214054febe38170/lava_callback.json.gz DEBUG: Setup failed for 69d372532214054febe38170. Transitting job node result: incomplete -> fail 2026-04-06 09:01:08,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:01:08,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d372532214054febe38170 HTTP/1.1" 200 None 2026-04-06 09:01:08,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:01:08,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 09:01:08,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:01:08,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d372532214054febe38170 HTTP/1.1" 200 None 2026-04-06 09:01:08,244 - lava_callback - INFO - Completed processing callback for node 69d372532214054febe38170 INFO: 172.19.0.1:47928 - "GET /node/6985bc0171989fb1414974fb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:47940 - "GET /node/693a110a78d7681e6b48fa9b%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-06 09:01:12,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:01:12,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43114 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:02:03,261 - lava_callback - INFO - Received callback for node 69d0d37e691bac272b3239f6 INFO: 172.19.0.1:37252 - "POST /node/69d0d37e691bac272b3239f6 HTTP/1.0" 202 Accepted 2026-04-06 09:02:03,267 - lava_callback - INFO - Starting async job submit for node 69d0d37e691bac272b3239f6 2026-04-06 09:02:03,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:02:03,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d37e691bac272b3239f6 HTTP/1.1" 200 None 2026-04-06 09:02:03,305 - lava_callback - DEBUG - Processing node 69d0d37e691bac272b3239f6: baseline-arm-clabbe 2026-04-06 09:02:03,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d37e691bac272b3239f6 2026-04-06 09:02:03,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:02:03,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d37e691bac272b3239f6 HTTP/1.1" 200 None 2026-04-06 09:02:03,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:02:03,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 09:02:03,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:02:03,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d37e691bac272b3239f6 HTTP/1.1" 200 None 2026-04-06 09:02:03,362 - lava_callback - ERROR - Error processing callback for node 69d0d37e691bac272b3239f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34632 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:03:43,332 - lava_callback - INFO - Received callback for node 69d0d3e4691bac272b323a4e INFO: 172.19.0.1:42098 - "POST /node/69d0d3e4691bac272b323a4e HTTP/1.0" 202 Accepted 2026-04-06 09:03:43,337 - lava_callback - INFO - Starting async job submit for node 69d0d3e4691bac272b323a4e 2026-04-06 09:03:43,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:03:43,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d3e4691bac272b323a4e HTTP/1.1" 200 None 2026-04-06 09:03:43,354 - lava_callback - DEBUG - Processing node 69d0d3e4691bac272b323a4e: baseline-arm-clabbe 2026-04-06 09:03:43,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d3e4691bac272b323a4e 2026-04-06 09:03:43,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:03:43,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d3e4691bac272b323a4e HTTP/1.1" 200 None 2026-04-06 09:03:43,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:03:43,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 09:03:43,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:03:43,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d3e4691bac272b323a4e HTTP/1.1" 200 None 2026-04-06 09:03:43,445 - lava_callback - ERROR - Error processing callback for node 69d0d3e4691bac272b323a4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59152 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:04:23,310 - lava_callback - INFO - Received callback for node 69d0d407691bac272b323a5b INFO: 172.19.0.1:49254 - "POST /node/69d0d407691bac272b323a5b HTTP/1.0" 202 Accepted 2026-04-06 09:04:23,316 - lava_callback - INFO - Starting async job submit for node 69d0d407691bac272b323a5b 2026-04-06 09:04:23,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:04:23,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d407691bac272b323a5b HTTP/1.1" 200 None 2026-04-06 09:04:23,331 - lava_callback - DEBUG - Processing node 69d0d407691bac272b323a5b: baseline-arm-clabbe 2026-04-06 09:04:23,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d407691bac272b323a5b 2026-04-06 09:04:23,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:04:23,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d407691bac272b323a5b HTTP/1.1" 200 None 2026-04-06 09:04:23,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:04:23,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 09:04:23,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:04:23,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d407691bac272b323a5b HTTP/1.1" 200 None 2026-04-06 09:04:23,384 - lava_callback - ERROR - Error processing callback for node 69d0d407691bac272b323a5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39578 - "GET /node/69861999177ca0f097bd0de0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:39584 - "GET /node/698bda951e517752bab8bb49%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58052 - "GET /favicon.ico HTTP/1.0" 404 Not Found 2026-04-06 09:06:54,734 - lava_callback - INFO - Received callback for node 69d373062214054febe38410 INFO: 172.19.0.1:46974 - "POST /node/69d373062214054febe38410 HTTP/1.0" 202 Accepted 2026-04-06 09:06:54,743 - lava_callback - INFO - Starting async job submit for node 69d373062214054febe38410 2026-04-06 09:06:54,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:06:54,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373062214054febe38410 HTTP/1.1" 200 None 2026-04-06 09:06:54,811 - lava_callback - DEBUG - Processing node 69d373062214054febe38410: baseline-nfs-arm64 2026-04-06 09:06:55,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:06:56,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:06:56,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373062214054febe38410/log.txt.gz INFO: 172.19.0.1:46984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46996 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:06:56,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:06:56,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:06:56,903 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373062214054febe38410/lava-logs.yaml 2026-04-06 09:06:56,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:06:57,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:06:57,156 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d373062214054febe38410/lava_callback.json.gz DEBUG: Setup failed for 69d373062214054febe38410. Transitting job node result: incomplete -> fail 2026-04-06 09:06:57,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:06:57,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373062214054febe38410 HTTP/1.1" 200 None 2026-04-06 09:06:57,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:06:57,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:06:57,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:06:57,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373062214054febe38410 HTTP/1.1" 200 None 2026-04-06 09:06:57,409 - lava_callback - INFO - Completed processing callback for node 69d373062214054febe38410 INFO: 172.19.0.1:38808 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:07:12,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:07:12,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33996 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:09:08,594 - lava_callback - INFO - Received callback for node 69d3782e2214054febe38ada INFO: 172.19.0.1:34006 - "POST /node/69d3782e2214054febe38ada HTTP/1.0" 202 Accepted 2026-04-06 09:09:08,600 - lava_callback - INFO - Starting async job submit for node 69d3782e2214054febe38ada 2026-04-06 09:09:08,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:09:08,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3782e2214054febe38ada HTTP/1.1" 200 None 2026-04-06 09:09:08,617 - lava_callback - DEBUG - Processing node 69d3782e2214054febe38ada: baseline-arm 2026-04-06 09:09:08,623 - lava_callback - WARNING - Failed to upload log 2026-04-06 09:09:08,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:09:08,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:09:08,779 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d3782e2214054febe38ada/lava-logs.yaml 2026-04-06 09:09:08,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:09:08,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:09:08,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d3782e2214054febe38ada/lava_callback.json.gz 2026-04-06 09:09:08,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:09:08,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3782e2214054febe38ada HTTP/1.1" 200 None 2026-04-06 09:09:08,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:09:08,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 09:09:08,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:09:08,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3782e2214054febe38ada HTTP/1.1" 200 None 2026-04-06 09:09:09,005 - lava_callback - INFO - Completed processing callback for node 69d3782e2214054febe38ada 2026-04-06 09:09:12,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:09:12,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:56614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34926 - "GET /node/69499112d45a0a86fbe25dc7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:34936 - "GET /node/693afc32fee8383e92b6d82b%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-06 09:13:21,228 - lava_callback - INFO - Received callback for node 69d373df2214054febe386da INFO: 172.19.0.1:34942 - "POST /node/69d373df2214054febe386da HTTP/1.0" 202 Accepted 2026-04-06 09:13:21,280 - lava_callback - INFO - Starting async job submit for node 69d373df2214054febe386da 2026-04-06 09:13:21,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:13:21,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373df2214054febe386da HTTP/1.1" 200 None 2026-04-06 09:13:21,320 - lava_callback - DEBUG - Processing node 69d373df2214054febe386da: ltp-containers 2026-04-06 09:13:21,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:13:21,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:13:21,566 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69d373df2214054febe386da/log.txt.gz 2026-04-06 09:13:21,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:13:21,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:13:21,979 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69d373df2214054febe386da/lava-logs.yaml 2026-04-06 09:13:21,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:13:22,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:13:22,100 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69d373df2214054febe386da/lava_callback.json.gz 2026-04-06 09:13:22,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:13:22,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d373df2214054febe386da HTTP/1.1" 200 None 2026-04-06 09:13:22,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:13:22,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 09:13:22,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:13:22,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d373df2214054febe386da HTTP/1.1" 200 None 2026-04-06 09:13:22,255 - lava_callback - INFO - Completed processing callback for node 69d373df2214054febe386da 2026-04-06 09:13:25,636 - lava_callback - INFO - Received callback for node 69d379202214054febe38b8d INFO: 172.19.0.1:34948 - "POST /node/69d379202214054febe38b8d HTTP/1.0" 202 Accepted 2026-04-06 09:13:25,642 - lava_callback - INFO - Starting async job submit for node 69d379202214054febe38b8d 2026-04-06 09:13:25,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:13:25,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d379202214054febe38b8d HTTP/1.1" 200 None 2026-04-06 09:13:25,658 - lava_callback - DEBUG - Processing node 69d379202214054febe38b8d: baseline-nfs-arm64 2026-04-06 09:13:25,659 - lava_callback - WARNING - Failed to upload log 2026-04-06 09:13:25,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:13:25,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:13:25,810 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d379202214054febe38b8d/lava-logs.yaml 2026-04-06 09:13:25,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:13:25,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:13:25,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d379202214054febe38b8d/lava_callback.json.gz 2026-04-06 09:13:25,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:13:25,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d379202214054febe38b8d HTTP/1.1" 200 None 2026-04-06 09:13:25,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:13:26,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:13:26,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:13:26,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d379202214054febe38b8d HTTP/1.1" 200 None 2026-04-06 09:13:26,034 - lava_callback - INFO - Completed processing callback for node 69d379202214054febe38b8d INFO: 172.19.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34958 - "GET /node/6986ab282de8e2dea3667dfc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:37512 - "GET /node/698f5cd63013abef95cf8c01%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:37520 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:13:42,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:13:42,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37490 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:14:03,912 - lava_callback - INFO - Received callback for node 69d0d649691bac272b323c5e INFO: 172.19.0.1:58270 - "POST /node/69d0d649691bac272b323c5e HTTP/1.0" 202 Accepted 2026-04-06 09:14:03,918 - lava_callback - INFO - Starting async job submit for node 69d0d649691bac272b323c5e 2026-04-06 09:14:03,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:14:03,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d649691bac272b323c5e HTTP/1.1" 200 None 2026-04-06 09:14:03,937 - lava_callback - DEBUG - Processing node 69d0d649691bac272b323c5e: baseline-arm-clabbe 2026-04-06 09:14:03,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d649691bac272b323c5e 2026-04-06 09:14:03,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:14:03,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d649691bac272b323c5e HTTP/1.1" 200 None 2026-04-06 09:14:03,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:14:03,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-06 09:14:03,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:14:03,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d649691bac272b323c5e HTTP/1.1" 200 None 2026-04-06 09:14:03,991 - lava_callback - ERROR - Error processing callback for node 69d0d649691bac272b323c5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49280 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:14:36,492 - lava_callback - INFO - Received callback for node 69d0d669691bac272b323c8e INFO: 172.19.0.1:49294 - "POST /node/69d0d669691bac272b323c8e HTTP/1.0" 202 Accepted 2026-04-06 09:14:36,497 - lava_callback - INFO - Starting async job submit for node 69d0d669691bac272b323c8e 2026-04-06 09:14:36,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:14:36,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d669691bac272b323c8e HTTP/1.1" 200 None 2026-04-06 09:14:36,524 - lava_callback - DEBUG - Processing node 69d0d669691bac272b323c8e: baseline-arm-baylibre 2026-04-06 09:14:36,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d669691bac272b323c8e 2026-04-06 09:14:36,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:14:36,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d669691bac272b323c8e HTTP/1.1" 200 None 2026-04-06 09:14:36,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:14:36,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-06 09:14:36,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:14:36,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d669691bac272b323c8e HTTP/1.1" 200 None 2026-04-06 09:14:36,577 - lava_callback - ERROR - Error processing callback for node 69d0d669691bac272b323c8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40068 - "GET /node/694f980e9ef0dab8356ff7b1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35912 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:16:24,207 - lava_callback - INFO - Received callback for node 69d0d6d5691bac272b323cd0 INFO: 172.19.0.1:45868 - "POST /node/69d0d6d5691bac272b323cd0 HTTP/1.0" 202 Accepted 2026-04-06 09:16:24,212 - lava_callback - INFO - Starting async job submit for node 69d0d6d5691bac272b323cd0 2026-04-06 09:16:24,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:16:24,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d6d5691bac272b323cd0 HTTP/1.1" 200 None 2026-04-06 09:16:24,228 - lava_callback - DEBUG - Processing node 69d0d6d5691bac272b323cd0: baseline-arm-clabbe 2026-04-06 09:16:24,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d6d5691bac272b323cd0 2026-04-06 09:16:24,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:16:24,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d6d5691bac272b323cd0 HTTP/1.1" 200 None 2026-04-06 09:16:24,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:16:24,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-06 09:16:24,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:16:24,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d6d5691bac272b323cd0 HTTP/1.1" 200 None 2026-04-06 09:16:24,292 - lava_callback - ERROR - Error processing callback for node 69d0d6d5691bac272b323cd0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34220 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:17:53,063 - lava_callback - INFO - Received callback for node 69d379b62214054febe38bed INFO: 172.19.0.1:60116 - "POST /node/69d379b62214054febe38bed HTTP/1.0" 202 Accepted 2026-04-06 09:17:53,069 - lava_callback - INFO - Starting async job submit for node 69d379b62214054febe38bed 2026-04-06 09:17:53,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:17:53,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d379b62214054febe38bed HTTP/1.1" 200 None 2026-04-06 09:17:53,118 - lava_callback - DEBUG - Processing node 69d379b62214054febe38bed: baseline-arm64-broonie 2026-04-06 09:17:53,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:17:53,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:17:53,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d379b62214054febe38bed/log.txt.gz 2026-04-06 09:17:53,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:17:54,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:17:54,033 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d379b62214054febe38bed/lava-logs.yaml 2026-04-06 09:17:54,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:17:54,218 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:17:54,220 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d379b62214054febe38bed/lava_callback.json.gz 2026-04-06 09:17:54,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:17:54,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d379b62214054febe38bed HTTP/1.1" 200 None 2026-04-06 09:17:54,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:17:54,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:17:54,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:17:54,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d379b62214054febe38bed HTTP/1.1" 200 None 2026-04-06 09:17:54,322 - lava_callback - INFO - Completed processing callback for node 69d379b62214054febe38bed INFO: 172.19.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39318 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:18:12,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:18:12,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57556 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:18:16,784 - lava_callback - INFO - Received callback for node 69d0d757691bac272b323d47 INFO: 172.19.0.1:57564 - "POST /node/69d0d757691bac272b323d47 HTTP/1.0" 202 Accepted 2026-04-06 09:18:16,790 - lava_callback - INFO - Starting async job submit for node 69d0d757691bac272b323d47 2026-04-06 09:18:16,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:18:16,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d757691bac272b323d47 HTTP/1.1" 200 None 2026-04-06 09:18:16,806 - lava_callback - DEBUG - Processing node 69d0d757691bac272b323d47: baseline-arm-baylibre 2026-04-06 09:18:16,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d757691bac272b323d47 2026-04-06 09:18:16,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:18:16,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d757691bac272b323d47 HTTP/1.1" 200 None 2026-04-06 09:18:16,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:18:16,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-06 09:18:16,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:18:16,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d757691bac272b323d47 HTTP/1.1" 200 None 2026-04-06 09:18:16,889 - lava_callback - ERROR - Error processing callback for node 69d0d757691bac272b323d47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44412 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:19:01,797 - lava_callback - INFO - Received callback for node 69d379ff2214054febe38c07 INFO: 172.19.0.1:39358 - "POST /node/69d379ff2214054febe38c07 HTTP/1.0" 202 Accepted 2026-04-06 09:19:01,803 - lava_callback - INFO - Starting async job submit for node 69d379ff2214054febe38c07 2026-04-06 09:19:01,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:19:01,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d379ff2214054febe38c07 HTTP/1.1" 200 None 2026-04-06 09:19:01,845 - lava_callback - DEBUG - Processing node 69d379ff2214054febe38c07: baseline-arm64-broonie 2026-04-06 09:19:02,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:19:02,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:19:02,271 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d379ff2214054febe38c07/log.txt.gz 2026-04-06 09:19:02,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:19:02,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:19:02,671 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d379ff2214054febe38c07/lava-logs.yaml 2026-04-06 09:19:02,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:19:02,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:19:02,833 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d379ff2214054febe38c07/lava_callback.json.gz 2026-04-06 09:19:02,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:19:02,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d379ff2214054febe38c07 HTTP/1.1" 200 None 2026-04-06 09:19:02,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:19:02,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:19:02,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:19:02,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d379ff2214054febe38c07 HTTP/1.1" 200 None 2026-04-06 09:19:02,916 - lava_callback - INFO - Completed processing callback for node 69d379ff2214054febe38c07 INFO: 172.19.0.1:39372 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:19:12,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:19:12,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33904 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:19:24,229 - lava_callback - INFO - Received callback for node 69d0d797691bac272b323d77 INFO: 172.19.0.1:34210 - "POST /node/69d0d797691bac272b323d77 HTTP/1.0" 202 Accepted 2026-04-06 09:19:24,234 - lava_callback - INFO - Starting async job submit for node 69d0d797691bac272b323d77 2026-04-06 09:19:24,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:19:24,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d797691bac272b323d77 HTTP/1.1" 200 None 2026-04-06 09:19:24,251 - lava_callback - DEBUG - Processing node 69d0d797691bac272b323d77: baseline-arm-clabbe 2026-04-06 09:19:24,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d797691bac272b323d77 2026-04-06 09:19:24,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:19:24,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d797691bac272b323d77 HTTP/1.1" 200 None 2026-04-06 09:19:24,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:19:24,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-06 09:19:24,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:19:24,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d797691bac272b323d77 HTTP/1.1" 200 None 2026-04-06 09:19:24,312 - lava_callback - ERROR - Error processing callback for node 69d0d797691bac272b323d77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55808 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:21:04,260 - lava_callback - INFO - Received callback for node 69d0d7fb691bac272b323e13 INFO: 172.19.0.1:60078 - "POST /node/69d0d7fb691bac272b323e13 HTTP/1.0" 202 Accepted 2026-04-06 09:21:04,265 - lava_callback - INFO - Starting async job submit for node 69d0d7fb691bac272b323e13 2026-04-06 09:21:04,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:21:04,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d7fb691bac272b323e13 HTTP/1.1" 200 None 2026-04-06 09:21:04,287 - lava_callback - DEBUG - Processing node 69d0d7fb691bac272b323e13: baseline-arm-clabbe 2026-04-06 09:21:04,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d7fb691bac272b323e13 2026-04-06 09:21:04,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:21:04,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d7fb691bac272b323e13 HTTP/1.1" 200 None 2026-04-06 09:21:04,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:21:04,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-06 09:21:04,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:21:04,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d7fb691bac272b323e13 HTTP/1.1" 200 None 2026-04-06 09:21:04,348 - lava_callback - ERROR - Error processing callback for node 69d0d7fb691bac272b323e13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37856 - "GET /node/69936fdacebe99dd8e068b37%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:37868 - "GET /node/69878344e31b58f834f1b6ad%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58444 - "GET /node/694cde85cb0ae69445cb2c52%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:58446 - "GET /node/693b7e2641fb4c9509763dbc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34582 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:23:24,318 - lava_callback - INFO - Received callback for node 69d0d87b691bac272b323eba INFO: 172.19.0.1:53070 - "POST /node/69d0d87b691bac272b323eba HTTP/1.0" 202 Accepted 2026-04-06 09:23:24,324 - lava_callback - INFO - Starting async job submit for node 69d0d87b691bac272b323eba 2026-04-06 09:23:24,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:23:24,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d87b691bac272b323eba HTTP/1.1" 200 None 2026-04-06 09:23:24,348 - lava_callback - DEBUG - Processing node 69d0d87b691bac272b323eba: baseline-arm-clabbe 2026-04-06 09:23:24,349 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0d87b691bac272b323eba 2026-04-06 09:23:24,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:23:24,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0d87b691bac272b323eba HTTP/1.1" 200 None 2026-04-06 09:23:24,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:23:24,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-06 09:23:24,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:23:24,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0d87b691bac272b323eba HTTP/1.1" 200 None 2026-04-06 09:23:24,422 - lava_callback - ERROR - Error processing callback for node 69d0d87b691bac272b323eba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53198 - "GET /node/698ef406f0e3ffbba67d2d04%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:53202 - "GET /node/6940ac031e3c24e95681a834%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34058 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:24:44,559 - lava_callback - INFO - Received callback for node 69d37ba52214054febe38d71 INFO: 172.19.0.1:38916 - "POST /node/69d37ba52214054febe38d71 HTTP/1.0" 202 Accepted 2026-04-06 09:24:44,566 - lava_callback - INFO - Starting async job submit for node 69d37ba52214054febe38d71 2026-04-06 09:24:44,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:24:44,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37ba52214054febe38d71 HTTP/1.1" 200 None 2026-04-06 09:24:44,612 - lava_callback - DEBUG - Processing node 69d37ba52214054febe38d71: baseline-arm64 2026-04-06 09:24:44,751 - lava_callback - WARNING - Failed to upload log 2026-04-06 09:24:44,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:24:45,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:24:45,052 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37ba52214054febe38d71/lava-logs.yaml 2026-04-06 09:24:45,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:24:45,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:24:45,217 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37ba52214054febe38d71/lava_callback.json.gz 2026-04-06 09:24:45,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:24:45,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37ba52214054febe38d71 HTTP/1.1" 200 None 2026-04-06 09:24:45,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:24:45,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:24:45,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:24:45,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d37ba52214054febe38d71 HTTP/1.1" 200 None 2026-04-06 09:24:45,385 - lava_callback - INFO - Completed processing callback for node 69d37ba52214054febe38d71 INFO: 172.19.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44704 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:25:12,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:25:12,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41316 - "GET /node/695069c8f6f7bccce5e51433%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55700 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:26:42,332 - lava_callback - INFO - Received callback for node 69d37c0c2214054febe38dbd INFO: 172.19.0.1:58950 - "POST /node/69d37c0c2214054febe38dbd HTTP/1.0" 202 Accepted 2026-04-06 09:26:42,343 - lava_callback - INFO - Starting async job submit for node 69d37c0c2214054febe38dbd 2026-04-06 09:26:42,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:26:42,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37c0c2214054febe38dbd HTTP/1.1" 200 None 2026-04-06 09:26:42,414 - lava_callback - DEBUG - Processing node 69d37c0c2214054febe38dbd: baseline-arm64 2026-04-06 09:26:42,585 - lava_callback - WARNING - Failed to upload log 2026-04-06 09:26:42,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:26:42,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:26:42,834 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37c0c2214054febe38dbd/lava-logs.yaml 2026-04-06 09:26:42,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:26:43,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:26:43,003 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37c0c2214054febe38dbd/lava_callback.json.gz 2026-04-06 09:26:43,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:26:43,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37c0c2214054febe38dbd HTTP/1.1" 200 None 2026-04-06 09:26:43,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:26:43,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:26:43,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:26:43,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d37c0c2214054febe38dbd HTTP/1.1" 200 None 2026-04-06 09:26:43,216 - lava_callback - INFO - Completed processing callback for node 69d37c0c2214054febe38dbd INFO: 172.19.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34526 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:27:12,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:27:12,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:56012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38880 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:28:06,905 - lava_callback - INFO - Received callback for node 69d37c762214054febe38e0a INFO: 172.19.0.1:38886 - "POST /node/69d37c762214054febe38e0a HTTP/1.0" 202 Accepted 2026-04-06 09:28:06,912 - lava_callback - INFO - Starting async job submit for node 69d37c762214054febe38e0a 2026-04-06 09:28:06,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:28:06,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37c762214054febe38e0a HTTP/1.1" 200 None 2026-04-06 09:28:06,949 - lava_callback - DEBUG - Processing node 69d37c762214054febe38e0a: baseline-arm64 2026-04-06 09:28:07,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:28:07,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:28:07,654 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37c762214054febe38e0a/log.txt.gz 2026-04-06 09:28:07,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:28:08,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:28:08,086 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37c762214054febe38e0a/lava-logs.yaml 2026-04-06 09:28:08,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:28:08,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:28:08,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37c762214054febe38e0a/lava_callback.json.gz 2026-04-06 09:28:08,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:28:08,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37c762214054febe38e0a HTTP/1.1" 200 None 2026-04-06 09:28:08,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:28:08,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:28:08,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:28:08,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d37c762214054febe38e0a HTTP/1.1" 200 None 2026-04-06 09:28:08,317 - lava_callback - INFO - Completed processing callback for node 69d37c762214054febe38e0a 2026-04-06 09:28:12,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:28:13,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56786 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:30:13,323 - lava_callback - INFO - Received callback for node 69d37cdd2214054febe38e6f INFO: 172.19.0.1:48386 - "POST /node/69d37cdd2214054febe38e6f HTTP/1.0" 202 Accepted 2026-04-06 09:30:13,330 - lava_callback - INFO - Starting async job submit for node 69d37cdd2214054febe38e6f 2026-04-06 09:30:13,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:30:13,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37cdd2214054febe38e6f HTTP/1.1" 200 None 2026-04-06 09:30:13,367 - lava_callback - DEBUG - Processing node 69d37cdd2214054febe38e6f: baseline-arm64 2026-04-06 09:30:13,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:30:13,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:30:13,942 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37cdd2214054febe38e6f/log.txt.gz 2026-04-06 09:30:14,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:30:14,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:30:14,396 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37cdd2214054febe38e6f/lava-logs.yaml 2026-04-06 09:30:14,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:30:14,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:30:14,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37cdd2214054febe38e6f/lava_callback.json.gz 2026-04-06 09:30:14,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:30:14,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37cdd2214054febe38e6f HTTP/1.1" 200 None 2026-04-06 09:30:14,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:30:14,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:30:14,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:30:14,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d37cdd2214054febe38e6f HTTP/1.1" 200 None 2026-04-06 09:30:14,738 - lava_callback - INFO - Completed processing callback for node 69d37cdd2214054febe38e6f INFO: 172.19.0.1:48402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54900 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:30:43,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:30:43,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59464 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:31:36,020 - lava_callback - INFO - Received callback for node 69d37d292214054febe38ea6 INFO: 172.19.0.1:38954 - "POST /node/69d37d292214054febe38ea6 HTTP/1.0" 202 Accepted 2026-04-06 09:31:36,026 - lava_callback - INFO - Starting async job submit for node 69d37d292214054febe38ea6 2026-04-06 09:31:36,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:31:36,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37d292214054febe38ea6 HTTP/1.1" 200 None 2026-04-06 09:31:36,064 - lava_callback - DEBUG - Processing node 69d37d292214054febe38ea6: baseline-arm64 2026-04-06 09:31:36,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:38960 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:31:36,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:31:36,515 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37d292214054febe38ea6/log.txt.gz 2026-04-06 09:31:36,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:31:36,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:31:36,958 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37d292214054febe38ea6/lava-logs.yaml 2026-04-06 09:31:36,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:31:37,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:31:37,139 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37d292214054febe38ea6/lava_callback.json.gz 2026-04-06 09:31:37,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:31:37,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37d292214054febe38ea6 HTTP/1.1" 200 None 2026-04-06 09:31:37,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:31:37,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:31:37,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:31:37,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d37d292214054febe38ea6 HTTP/1.1" 200 None 2026-04-06 09:31:37,225 - lava_callback - INFO - Completed processing callback for node 69d37d292214054febe38ea6 2026-04-06 09:31:43,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:31:43,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33896 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:33:37,581 - lava_callback - INFO - Received callback for node 69d0dade691bac272b324090 INFO: 172.19.0.1:33908 - "POST /node/69d0dade691bac272b324090 HTTP/1.0" 202 Accepted 2026-04-06 09:33:37,587 - lava_callback - INFO - Starting async job submit for node 69d0dade691bac272b324090 2026-04-06 09:33:37,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:33:37,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dade691bac272b324090 HTTP/1.1" 200 None 2026-04-06 09:33:37,602 - lava_callback - DEBUG - Processing node 69d0dade691bac272b324090: baseline-arm64-baylibre 2026-04-06 09:33:37,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0dade691bac272b324090 2026-04-06 09:33:37,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:33:37,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dade691bac272b324090 HTTP/1.1" 200 None 2026-04-06 09:33:37,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:33:37,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 09:33:37,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:33:37,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0dade691bac272b324090 HTTP/1.1" 200 None 2026-04-06 09:33:37,677 - lava_callback - ERROR - Error processing callback for node 69d0dade691bac272b324090: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36244 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:35:37,588 - lava_callback - INFO - Received callback for node 69d0db61691bac272b32413b INFO: 172.19.0.1:36256 - "POST /node/69d0db61691bac272b32413b HTTP/1.0" 202 Accepted 2026-04-06 09:35:37,595 - lava_callback - INFO - Starting async job submit for node 69d0db61691bac272b32413b 2026-04-06 09:35:37,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:35:37,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0db61691bac272b32413b HTTP/1.1" 200 None 2026-04-06 09:35:37,611 - lava_callback - DEBUG - Processing node 69d0db61691bac272b32413b: baseline-arm64-baylibre 2026-04-06 09:35:37,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0db61691bac272b32413b 2026-04-06 09:35:37,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:35:37,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0db61691bac272b32413b HTTP/1.1" 200 None 2026-04-06 09:35:37,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:35:37,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 09:35:37,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:35:37,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0db61691bac272b32413b HTTP/1.1" 200 None 2026-04-06 09:35:37,670 - lava_callback - ERROR - Error processing callback for node 69d0db61691bac272b32413b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46838 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:36:34,408 - lava_callback - INFO - Received callback for node 69d37e502214054febe38f94 INFO: 172.19.0.1:51782 - "POST /node/69d37e502214054febe38f94 HTTP/1.0" 202 Accepted 2026-04-06 09:36:34,414 - lava_callback - INFO - Starting async job submit for node 69d37e502214054febe38f94 2026-04-06 09:36:34,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:36:34,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37e502214054febe38f94 HTTP/1.1" 200 None 2026-04-06 09:36:34,458 - lava_callback - DEBUG - Processing node 69d37e502214054febe38f94: baseline-x86 2026-04-06 09:36:34,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:36:34,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:36:34,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d37e502214054febe38f94/log.txt.gz 2026-04-06 09:36:35,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:36:35,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:36:35,231 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d37e502214054febe38f94/lava-logs.yaml 2026-04-06 09:36:35,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:36:35,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:36:35,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d37e502214054febe38f94/lava_callback.json.gz 2026-04-06 09:36:35,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:36:35,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37e502214054febe38f94 HTTP/1.1" 200 None 2026-04-06 09:36:35,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:36:35,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c3f2214054febe37d8c HTTP/1.1" 200 None 2026-04-06 09:36:35,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:36:35,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d37e502214054febe38f94 HTTP/1.1" 200 None 2026-04-06 09:36:35,528 - lava_callback - INFO - Completed processing callback for node 69d37e502214054febe38f94 INFO: 172.19.0.1:51798 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:36:43,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:36:43,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40604 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:37:57,703 - lava_callback - INFO - Received callback for node 69d0dbf1691bac272b324181 INFO: 172.19.0.1:40606 - "POST /node/69d0dbf1691bac272b324181 HTTP/1.0" 202 Accepted 2026-04-06 09:37:57,708 - lava_callback - INFO - Starting async job submit for node 69d0dbf1691bac272b324181 2026-04-06 09:37:57,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:37:57,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dbf1691bac272b324181 HTTP/1.1" 200 None 2026-04-06 09:37:57,729 - lava_callback - DEBUG - Processing node 69d0dbf1691bac272b324181: baseline-arm64-baylibre 2026-04-06 09:37:57,729 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0dbf1691bac272b324181 2026-04-06 09:37:57,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:37:57,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dbf1691bac272b324181 HTTP/1.1" 200 None 2026-04-06 09:37:57,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:37:57,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 09:37:57,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:37:57,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0dbf1691bac272b324181 HTTP/1.1" 200 None 2026-04-06 09:37:57,791 - lava_callback - ERROR - Error processing callback for node 69d0dbf1691bac272b324181: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36852 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:40:17,860 - lava_callback - INFO - Received callback for node 69d0dc75691bac272b3241fb INFO: 172.19.0.1:36854 - "POST /node/69d0dc75691bac272b3241fb HTTP/1.0" 202 Accepted 2026-04-06 09:40:17,865 - lava_callback - INFO - Starting async job submit for node 69d0dc75691bac272b3241fb 2026-04-06 09:40:17,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:40:17,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dc75691bac272b3241fb HTTP/1.1" 200 None 2026-04-06 09:40:17,882 - lava_callback - DEBUG - Processing node 69d0dc75691bac272b3241fb: baseline-arm64-baylibre 2026-04-06 09:40:17,882 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0dc75691bac272b3241fb 2026-04-06 09:40:17,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:40:17,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dc75691bac272b3241fb HTTP/1.1" 200 None 2026-04-06 09:40:17,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:40:17,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 09:40:17,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:40:17,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0dc75691bac272b3241fb HTTP/1.1" 200 None 2026-04-06 09:40:17,946 - lava_callback - ERROR - Error processing callback for node 69d0dc75691bac272b3241fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45966 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:41:17,878 - lava_callback - INFO - Received callback for node 69d0dcb7691bac272b32423b INFO: 172.19.0.1:45968 - "POST /node/69d0dcb7691bac272b32423b HTTP/1.0" 202 Accepted 2026-04-06 09:41:17,884 - lava_callback - INFO - Starting async job submit for node 69d0dcb7691bac272b32423b 2026-04-06 09:41:17,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:41:17,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dcb7691bac272b32423b HTTP/1.1" 200 None 2026-04-06 09:41:17,901 - lava_callback - DEBUG - Processing node 69d0dcb7691bac272b32423b: baseline-arm64-baylibre 2026-04-06 09:41:17,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0dcb7691bac272b32423b 2026-04-06 09:41:17,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:41:17,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dcb7691bac272b32423b HTTP/1.1" 200 None 2026-04-06 09:41:17,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:41:17,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 09:41:17,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:41:17,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0dcb7691bac272b32423b HTTP/1.1" 200 None 2026-04-06 09:41:17,955 - lava_callback - ERROR - Error processing callback for node 69d0dcb7691bac272b32423b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34150 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:43:37,982 - lava_callback - INFO - Received callback for node 69d0dd37691bac272b3242da INFO: 172.19.0.1:34166 - "POST /node/69d0dd37691bac272b3242da HTTP/1.0" 202 Accepted 2026-04-06 09:43:37,988 - lava_callback - INFO - Starting async job submit for node 69d0dd37691bac272b3242da 2026-04-06 09:43:37,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:43:38,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dd37691bac272b3242da HTTP/1.1" 200 None 2026-04-06 09:43:38,007 - lava_callback - DEBUG - Processing node 69d0dd37691bac272b3242da: baseline-arm64-baylibre 2026-04-06 09:43:38,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0dd37691bac272b3242da 2026-04-06 09:43:38,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:43:38,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dd37691bac272b3242da HTTP/1.1" 200 None 2026-04-06 09:43:38,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:43:38,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 09:43:38,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:43:38,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0dd37691bac272b3242da HTTP/1.1" 200 None 2026-04-06 09:43:38,066 - lava_callback - ERROR - Error processing callback for node 69d0dd37691bac272b3242da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36390 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:44:45,322 - lava_callback - INFO - Received callback for node 69d0dd7d691bac272b32432f INFO: 172.19.0.1:53912 - "POST /node/69d0dd7d691bac272b32432f HTTP/1.0" 202 Accepted 2026-04-06 09:44:45,328 - lava_callback - INFO - Starting async job submit for node 69d0dd7d691bac272b32432f 2026-04-06 09:44:45,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:44:45,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dd7d691bac272b32432f HTTP/1.1" 200 None 2026-04-06 09:44:45,349 - lava_callback - DEBUG - Processing node 69d0dd7d691bac272b32432f: baseline-arm64-clabbe 2026-04-06 09:44:45,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0dd7d691bac272b32432f 2026-04-06 09:44:45,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:44:45,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dd7d691bac272b32432f HTTP/1.1" 200 None 2026-04-06 09:44:45,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:44:45,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 09:44:45,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:44:45,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0dd7d691bac272b32432f HTTP/1.1" 200 None 2026-04-06 09:44:45,424 - lava_callback - ERROR - Error processing callback for node 69d0dd7d691bac272b32432f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35388 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:45:05,621 - lava_callback - INFO - Received callback for node 69d37ee72214054febe39010 INFO: 172.19.0.1:49378 - "POST /node/69d37ee72214054febe39010 HTTP/1.0" 202 Accepted 2026-04-06 09:45:05,633 - lava_callback - INFO - Starting async job submit for node 69d37ee72214054febe39010 2026-04-06 09:45:05,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:45:05,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37ee72214054febe39010 HTTP/1.1" 200 None 2026-04-06 09:45:05,709 - lava_callback - DEBUG - Processing node 69d37ee72214054febe39010: baseline-arm64 2026-04-06 09:45:06,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:45:06,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:45:06,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37ee72214054febe39010/log.txt.gz INFO: 172.19.0.1:49392 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:45:06,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:45:06,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:45:06,842 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37ee72214054febe39010/lava-logs.yaml 2026-04-06 09:45:06,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:45:07,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:45:07,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37ee72214054febe39010/lava_callback.json.gz DEBUG: Setup failed for 69d37ee72214054febe39010. Transitting job node result: incomplete -> fail 2026-04-06 09:45:07,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:45:07,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37ee72214054febe39010 HTTP/1.1" 200 None 2026-04-06 09:45:07,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:45:07,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:45:07,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:45:07,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d37ee72214054febe39010 HTTP/1.1" 200 None 2026-04-06 09:45:07,257 - lava_callback - INFO - Completed processing callback for node 69d37ee72214054febe39010 2026-04-06 09:45:13,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:45:13,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37220 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:45:45,324 - lava_callback - INFO - Received callback for node 69d0ddbe691bac272b32438b INFO: 172.19.0.1:55134 - "POST /node/69d0ddbe691bac272b32438b HTTP/1.0" 202 Accepted 2026-04-06 09:45:45,330 - lava_callback - INFO - Starting async job submit for node 69d0ddbe691bac272b32438b 2026-04-06 09:45:45,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:45:45,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ddbe691bac272b32438b HTTP/1.1" 200 None 2026-04-06 09:45:45,347 - lava_callback - DEBUG - Processing node 69d0ddbe691bac272b32438b: baseline-arm64-clabbe 2026-04-06 09:45:45,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0ddbe691bac272b32438b 2026-04-06 09:45:45,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:45:45,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0ddbe691bac272b32438b HTTP/1.1" 200 None 2026-04-06 09:45:45,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:45:45,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 09:45:45,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:45:45,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0ddbe691bac272b32438b HTTP/1.1" 200 None 2026-04-06 09:45:45,403 - lava_callback - ERROR - Error processing callback for node 69d0ddbe691bac272b32438b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44392 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:47:05,382 - lava_callback - INFO - Received callback for node 69d0de0a691bac272b32439e INFO: 172.19.0.1:51824 - "POST /node/69d0de0a691bac272b32439e HTTP/1.0" 202 Accepted 2026-04-06 09:47:05,388 - lava_callback - INFO - Starting async job submit for node 69d0de0a691bac272b32439e 2026-04-06 09:47:05,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:05,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0de0a691bac272b32439e HTTP/1.1" 200 None 2026-04-06 09:47:05,408 - lava_callback - DEBUG - Processing node 69d0de0a691bac272b32439e: baseline-arm64-clabbe 2026-04-06 09:47:05,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0de0a691bac272b32439e 2026-04-06 09:47:05,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:05,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0de0a691bac272b32439e HTTP/1.1" 200 None 2026-04-06 09:47:05,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:05,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 09:47:05,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:05,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0de0a691bac272b32439e HTTP/1.1" 200 None 2026-04-06 09:47:05,474 - lava_callback - ERROR - Error processing callback for node 69d0de0a691bac272b32439e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51836 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:47:07,934 - lava_callback - INFO - Received callback for node 69d381012214054febe391e3 INFO: 172.19.0.1:51846 - "POST /node/69d381012214054febe391e3 HTTP/1.0" 202 Accepted 2026-04-06 09:47:07,943 - lava_callback - INFO - Starting async job submit for node 69d381012214054febe391e3 2026-04-06 09:47:07,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:07,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d381012214054febe391e3 HTTP/1.1" 200 None 2026-04-06 09:47:07,971 - lava_callback - DEBUG - Processing node 69d381012214054febe391e3: baseline-arm 2026-04-06 09:47:07,977 - lava_callback - WARNING - Failed to upload log 2026-04-06 09:47:07,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:47:08,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:47:08,141 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d381012214054febe391e3/lava-logs.yaml 2026-04-06 09:47:08,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:47:08,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:47:08,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d381012214054febe391e3/lava_callback.json.gz 2026-04-06 09:47:08,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:08,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d381012214054febe391e3 HTTP/1.1" 200 None 2026-04-06 09:47:08,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:08,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 09:47:08,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:08,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d381012214054febe391e3 HTTP/1.1" 200 None 2026-04-06 09:47:08,379 - lava_callback - INFO - Completed processing callback for node 69d381012214054febe391e3 2026-04-06 09:47:13,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:13,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60710 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:47:22,849 - lava_callback - INFO - Received callback for node 69d37eb42214054febe38fd4 INFO: 172.19.0.1:42310 - "POST /node/69d37eb42214054febe38fd4 HTTP/1.0" 202 Accepted 2026-04-06 09:47:22,856 - lava_callback - INFO - Starting async job submit for node 69d37eb42214054febe38fd4 2026-04-06 09:47:22,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:22,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37eb42214054febe38fd4 HTTP/1.1" 200 None 2026-04-06 09:47:22,904 - lava_callback - DEBUG - Processing node 69d37eb42214054febe38fd4: ltp-controllers 2026-04-06 09:47:23,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:47:23,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:47:23,634 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69d37eb42214054febe38fd4/log.txt.gz 2026-04-06 09:47:23,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:47:24,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:47:24,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69d37eb42214054febe38fd4/lava-logs.yaml 2026-04-06 09:47:24,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:47:24,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:47:24,413 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69d37eb42214054febe38fd4/lava_callback.json.gz 2026-04-06 09:47:24,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:24,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37eb42214054febe38fd4 HTTP/1.1" 200 None 2026-04-06 09:47:24,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:24,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 09:47:24,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:24,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d37eb42214054febe38fd4 HTTP/1.1" 200 None 2026-04-06 09:47:24,496 - lava_callback - INFO - Completed processing callback for node 69d37eb42214054febe38fd4 INFO: 172.19.0.1:42314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34456 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:47:43,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:47:43,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:38088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44458 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:49:45,526 - lava_callback - INFO - Received callback for node 69d0deb4691bac272b32442f INFO: 172.19.0.1:47504 - "POST /node/69d0deb4691bac272b32442f HTTP/1.0" 202 Accepted 2026-04-06 09:49:45,532 - lava_callback - INFO - Starting async job submit for node 69d0deb4691bac272b32442f 2026-04-06 09:49:45,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:49:45,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0deb4691bac272b32442f HTTP/1.1" 200 None 2026-04-06 09:49:45,553 - lava_callback - DEBUG - Processing node 69d0deb4691bac272b32442f: baseline-arm64-clabbe 2026-04-06 09:49:45,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0deb4691bac272b32442f 2026-04-06 09:49:45,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:49:45,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0deb4691bac272b32442f HTTP/1.1" 200 None 2026-04-06 09:49:45,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:49:45,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 09:49:45,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:49:45,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0deb4691bac272b32442f HTTP/1.1" 200 None 2026-04-06 09:49:45,608 - lava_callback - ERROR - Error processing callback for node 69d0deb4691bac272b32442f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45234 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:50:11,967 - lava_callback - INFO - Received callback for node 69d37f4d2214054febe39069 INFO: 172.19.0.1:57500 - "POST /node/69d37f4d2214054febe39069 HTTP/1.0" 202 Accepted 2026-04-06 09:50:11,974 - lava_callback - INFO - Starting async job submit for node 69d37f4d2214054febe39069 2026-04-06 09:50:12,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:12,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37f4d2214054febe39069 HTTP/1.1" 200 None 2026-04-06 09:50:12,032 - lava_callback - DEBUG - Processing node 69d37f4d2214054febe39069: baseline-nfs-arm64 2026-04-06 09:50:12,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:50:12,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:50:12,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d37f4d2214054febe39069/log.txt.gz 2026-04-06 09:50:13,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:50:13,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:50:13,277 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d37f4d2214054febe39069/lava-logs.yaml 2026-04-06 09:50:13,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:50:13,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:50:13,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d37f4d2214054febe39069/lava_callback.json.gz 2026-04-06 09:50:13,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:13,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37f4d2214054febe39069 HTTP/1.1" 200 None 2026-04-06 09:50:13,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:13,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:50:13,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:13,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d37f4d2214054febe39069 HTTP/1.1" 200 None 2026-04-06 09:50:13,636 - lava_callback - INFO - Completed processing callback for node 69d37f4d2214054febe39069 INFO: 172.19.0.1:57506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43476 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:50:43,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:43,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52304 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:50:57,395 - lava_callback - INFO - Received callback for node 69d381f82214054febe392ac INFO: 172.19.0.1:52308 - "POST /node/69d381f82214054febe392ac HTTP/1.0" 202 Accepted 2026-04-06 09:50:57,401 - lava_callback - INFO - Starting async job submit for node 69d381f82214054febe392ac 2026-04-06 09:50:57,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:57,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d381f82214054febe392ac HTTP/1.1" 200 None 2026-04-06 09:50:57,418 - lava_callback - DEBUG - Processing node 69d381f82214054febe392ac: baseline-nfs-arm64 2026-04-06 09:50:57,420 - lava_callback - WARNING - Failed to upload log 2026-04-06 09:50:57,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:50:57,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:50:57,553 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d381f82214054febe392ac/lava-logs.yaml 2026-04-06 09:50:57,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:50:57,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:50:57,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d381f82214054febe392ac/lava_callback.json.gz 2026-04-06 09:50:57,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:57,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d381f82214054febe392ac HTTP/1.1" 200 None 2026-04-06 09:50:57,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:57,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:50:57,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:57,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d381f82214054febe392ac HTTP/1.1" 200 None 2026-04-06 09:50:57,762 - lava_callback - INFO - Completed processing callback for node 69d381f82214054febe392ac 2026-04-06 09:50:58,453 - lava_callback - INFO - Received callback for node 69d0def6691bac272b324466 INFO: 172.19.0.1:52316 - "POST /node/69d0def6691bac272b324466 HTTP/1.0" 202 Accepted 2026-04-06 09:50:58,459 - lava_callback - INFO - Starting async job submit for node 69d0def6691bac272b324466 2026-04-06 09:50:58,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:58,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0def6691bac272b324466 HTTP/1.1" 200 None 2026-04-06 09:50:58,474 - lava_callback - DEBUG - Processing node 69d0def6691bac272b324466: baseline-arm64-baylibre 2026-04-06 09:50:58,474 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0def6691bac272b324466 2026-04-06 09:50:58,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:58,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0def6691bac272b324466 HTTP/1.1" 200 None 2026-04-06 09:50:58,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:58,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 09:50:58,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:50:58,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0def6691bac272b324466 HTTP/1.1" 200 None 2026-04-06 09:50:58,535 - lava_callback - ERROR - Error processing callback for node 69d0def6691bac272b324466: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38252 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:51:13,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:51:13,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44898 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:51:28,976 - lava_callback - INFO - Received callback for node 69d37f902214054febe3909f INFO: 172.19.0.1:44914 - "POST /node/69d37f902214054febe3909f HTTP/1.0" 202 Accepted 2026-04-06 09:51:28,982 - lava_callback - INFO - Starting async job submit for node 69d37f902214054febe3909f 2026-04-06 09:51:29,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:51:29,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37f902214054febe3909f HTTP/1.1" 200 None 2026-04-06 09:51:29,021 - lava_callback - DEBUG - Processing node 69d37f902214054febe3909f: baseline-arm64 2026-04-06 09:51:29,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:51:29,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:51:29,682 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37f902214054febe3909f/log.txt.gz 2026-04-06 09:51:29,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:51:30,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:51:30,237 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37f902214054febe3909f/lava-logs.yaml 2026-04-06 09:51:30,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:51:30,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:51:30,445 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d37f902214054febe3909f/lava_callback.json.gz 2026-04-06 09:51:30,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:51:30,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37f902214054febe3909f HTTP/1.1" 200 None 2026-04-06 09:51:30,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:51:30,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:51:30,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:51:30,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d37f902214054febe3909f HTTP/1.1" 200 None 2026-04-06 09:51:30,622 - lava_callback - INFO - Completed processing callback for node 69d37f902214054febe3909f INFO: 172.19.0.1:39706 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:51:43,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:51:43,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44612 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:52:18,509 - lava_callback - INFO - Received callback for node 69d0df3f691bac272b324487 INFO: 172.19.0.1:44614 - "POST /node/69d0df3f691bac272b324487 HTTP/1.0" 202 Accepted 2026-04-06 09:52:18,514 - lava_callback - INFO - Starting async job submit for node 69d0df3f691bac272b324487 2026-04-06 09:52:18,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:52:18,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0df3f691bac272b324487 HTTP/1.1" 200 None 2026-04-06 09:52:18,530 - lava_callback - DEBUG - Processing node 69d0df3f691bac272b324487: baseline-arm64-baylibre 2026-04-06 09:52:18,531 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0df3f691bac272b324487 2026-04-06 09:52:18,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:52:18,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0df3f691bac272b324487 HTTP/1.1" 200 None 2026-04-06 09:52:18,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:52:18,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 09:52:18,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:52:18,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0df3f691bac272b324487 HTTP/1.1" 200 None 2026-04-06 09:52:18,588 - lava_callback - ERROR - Error processing callback for node 69d0df3f691bac272b324487: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45512 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:53:18,497 - lava_callback - INFO - Received callback for node 69d0df81691bac272b3244c3 INFO: 172.19.0.1:45528 - "POST /node/69d0df81691bac272b3244c3 HTTP/1.0" 202 Accepted 2026-04-06 09:53:18,503 - lava_callback - INFO - Starting async job submit for node 69d0df81691bac272b3244c3 2026-04-06 09:53:18,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:53:18,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0df81691bac272b3244c3 HTTP/1.1" 200 None 2026-04-06 09:53:18,522 - lava_callback - DEBUG - Processing node 69d0df81691bac272b3244c3: baseline-arm64-baylibre 2026-04-06 09:53:18,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0df81691bac272b3244c3 2026-04-06 09:53:18,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:53:18,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0df81691bac272b3244c3 HTTP/1.1" 200 None 2026-04-06 09:53:18,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:53:18,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 09:53:18,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:53:18,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0df81691bac272b3244c3 HTTP/1.1" 200 None 2026-04-06 09:53:18,594 - lava_callback - ERROR - Error processing callback for node 69d0df81691bac272b3244c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60878 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:54:18,586 - lava_callback - INFO - Received callback for node 69d0dfc4691bac272b324508 INFO: 172.19.0.1:60890 - "POST /node/69d0dfc4691bac272b324508 HTTP/1.0" 202 Accepted 2026-04-06 09:54:18,593 - lava_callback - INFO - Starting async job submit for node 69d0dfc4691bac272b324508 2026-04-06 09:54:18,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:54:18,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dfc4691bac272b324508 HTTP/1.1" 200 None 2026-04-06 09:54:18,609 - lava_callback - DEBUG - Processing node 69d0dfc4691bac272b324508: baseline-arm64-baylibre 2026-04-06 09:54:18,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0dfc4691bac272b324508 2026-04-06 09:54:18,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:54:18,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0dfc4691bac272b324508 HTTP/1.1" 200 None 2026-04-06 09:54:18,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:54:18,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 09:54:18,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:54:18,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0dfc4691bac272b324508 HTTP/1.1" 200 None 2026-04-06 09:54:18,698 - lava_callback - ERROR - Error processing callback for node 69d0dfc4691bac272b324508: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58862 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:55:04,467 - lava_callback - INFO - Received callback for node 69d381e72214054febe392a8 INFO: 172.19.0.1:45138 - "POST /node/69d381e72214054febe392a8 HTTP/1.0" 202 Accepted 2026-04-06 09:55:04,473 - lava_callback - INFO - Starting async job submit for node 69d381e72214054febe392a8 2026-04-06 09:55:04,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:04,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d381e72214054febe392a8 HTTP/1.1" 200 None 2026-04-06 09:55:04,516 - lava_callback - DEBUG - Processing node 69d381e72214054febe392a8: ltp-containers 2026-04-06 09:55:04,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:55:05,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:55:05,063 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69d381e72214054febe392a8/log.txt.gz 2026-04-06 09:55:05,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:55:05,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:55:05,548 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69d381e72214054febe392a8/lava-logs.yaml 2026-04-06 09:55:05,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:55:05,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:55:05,752 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69d381e72214054febe392a8/lava_callback.json.gz 2026-04-06 09:55:05,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:05,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d381e72214054febe392a8 HTTP/1.1" 200 None 2026-04-06 09:55:05,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:05,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 09:55:05,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:05,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d381e72214054febe392a8 HTTP/1.1" 200 None 2026-04-06 09:55:05,919 - lava_callback - INFO - Completed processing callback for node 69d381e72214054febe392a8 INFO: 172.19.0.1:45152 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:55:13,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:13,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 09:55:14,623 - lava_callback - INFO - Received callback for node 69d37edf2214054febe3900d INFO: 172.19.0.1:45506 - "POST /node/69d37edf2214054febe3900d HTTP/1.0" 202 Accepted 2026-04-06 09:55:14,630 - lava_callback - INFO - Starting async job submit for node 69d37edf2214054febe3900d 2026-04-06 09:55:14,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:14,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37edf2214054febe3900d HTTP/1.1" 200 None 2026-04-06 09:55:14,708 - lava_callback - DEBUG - Processing node 69d37edf2214054febe3900d: ltp-smoke INFO: 172.19.0.1:45520 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 09:55:15,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:55:15,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:55:15,352 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d37edf2214054febe3900d/log.txt.gz 2026-04-06 09:55:15,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:55:15,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:55:15,871 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d37edf2214054febe3900d/lava-logs.yaml 2026-04-06 09:55:15,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:55:16,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:55:16,037 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d37edf2214054febe3900d/lava_callback.json.gz 2026-04-06 09:55:16,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:16,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d37edf2214054febe3900d HTTP/1.1" 200 None 2026-04-06 09:55:16,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:16,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c272214054febe37d68 HTTP/1.1" 200 None 2026-04-06 09:55:16,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:16,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d37edf2214054febe3900d HTTP/1.1" 200 None 2026-04-06 09:55:16,350 - lava_callback - INFO - Completed processing callback for node 69d37edf2214054febe3900d INFO: 172.19.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45900 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:55:38,680 - lava_callback - INFO - Received callback for node 69d0e006691bac272b324547 INFO: 172.19.0.1:45908 - "POST /node/69d0e006691bac272b324547 HTTP/1.0" 202 Accepted 2026-04-06 09:55:38,686 - lava_callback - INFO - Starting async job submit for node 69d0e006691bac272b324547 2026-04-06 09:55:38,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:38,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e006691bac272b324547 HTTP/1.1" 200 None 2026-04-06 09:55:38,703 - lava_callback - DEBUG - Processing node 69d0e006691bac272b324547: baseline-arm64-baylibre 2026-04-06 09:55:38,704 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e006691bac272b324547 2026-04-06 09:55:38,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:38,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e006691bac272b324547 HTTP/1.1" 200 None 2026-04-06 09:55:38,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:38,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 09:55:38,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:38,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e006691bac272b324547 HTTP/1.1" 200 None 2026-04-06 09:55:38,776 - lava_callback - ERROR - Error processing callback for node 69d0e006691bac272b324547: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 09:55:43,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:55:43,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:38590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50652 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:56:38,874 - lava_callback - INFO - Received callback for node 69d0e047691bac272b324599 INFO: 172.19.0.1:50656 - "POST /node/69d0e047691bac272b324599 HTTP/1.0" 202 Accepted 2026-04-06 09:56:38,884 - lava_callback - INFO - Starting async job submit for node 69d0e047691bac272b324599 2026-04-06 09:56:38,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:56:38,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e047691bac272b324599 HTTP/1.1" 200 None 2026-04-06 09:56:38,899 - lava_callback - DEBUG - Processing node 69d0e047691bac272b324599: baseline-arm64-baylibre 2026-04-06 09:56:38,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e047691bac272b324599 2026-04-06 09:56:38,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:56:38,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e047691bac272b324599 HTTP/1.1" 200 None 2026-04-06 09:56:38,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:56:38,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 09:56:38,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:56:38,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e047691bac272b324599 HTTP/1.1" 200 None 2026-04-06 09:56:38,952 - lava_callback - ERROR - Error processing callback for node 69d0e047691bac272b324599: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 09:56:43,009 - lava_callback - INFO - Received callback for node 69d382d82214054febe3935b INFO: 172.19.0.1:49270 - "POST /node/69d382d82214054febe3935b HTTP/1.0" 202 Accepted 2026-04-06 09:56:43,019 - lava_callback - INFO - Starting async job submit for node 69d382d82214054febe3935b 2026-04-06 09:56:43,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:56:43,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d382d82214054febe3935b HTTP/1.1" 200 None 2026-04-06 09:56:43,066 - lava_callback - DEBUG - Processing node 69d382d82214054febe3935b: baseline-arm64-broonie 2026-04-06 09:56:43,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:56:43,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:56:43,564 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d382d82214054febe3935b/log.txt.gz 2026-04-06 09:56:43,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:56:43,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:56:43,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d382d82214054febe3935b/lava-logs.yaml 2026-04-06 09:56:43,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:56:44,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:56:44,163 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d382d82214054febe3935b/lava_callback.json.gz 2026-04-06 09:56:44,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:56:44,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d382d82214054febe3935b HTTP/1.1" 200 None 2026-04-06 09:56:44,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:56:44,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:56:44,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:56:44,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d382d82214054febe3935b HTTP/1.1" 200 None 2026-04-06 09:56:44,271 - lava_callback - INFO - Completed processing callback for node 69d382d82214054febe3935b INFO: 172.19.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34084 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:57:13,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:57:13,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43570 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:57:45,915 - lava_callback - INFO - Received callback for node 69d0e094691bac272b3245b8 INFO: 172.19.0.1:48850 - "POST /node/69d0e094691bac272b3245b8 HTTP/1.0" 202 Accepted 2026-04-06 09:57:45,921 - lava_callback - INFO - Starting async job submit for node 69d0e094691bac272b3245b8 2026-04-06 09:57:45,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:57:45,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e094691bac272b3245b8 HTTP/1.1" 200 None 2026-04-06 09:57:45,937 - lava_callback - DEBUG - Processing node 69d0e094691bac272b3245b8: baseline-arm64-clabbe 2026-04-06 09:57:45,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e094691bac272b3245b8 2026-04-06 09:57:45,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:57:45,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e094691bac272b3245b8 HTTP/1.1" 200 None 2026-04-06 09:57:45,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:57:45,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 09:57:45,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:57:45,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e094691bac272b3245b8 HTTP/1.1" 200 None 2026-04-06 09:57:45,992 - lava_callback - ERROR - Error processing callback for node 69d0e094691bac272b3245b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55274 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:58:03,129 - lava_callback - INFO - Received callback for node 69d3828c2214054febe3933d INFO: 172.19.0.1:37726 - "POST /node/69d3828c2214054febe3933d HTTP/1.0" 202 Accepted 2026-04-06 09:58:03,135 - lava_callback - INFO - Starting async job submit for node 69d3828c2214054febe3933d 2026-04-06 09:58:03,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:58:03,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3828c2214054febe3933d HTTP/1.1" 200 None 2026-04-06 09:58:03,195 - lava_callback - DEBUG - Processing node 69d3828c2214054febe3933d: baseline-arm64-broonie 2026-04-06 09:58:03,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:58:03,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:58:03,657 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3828c2214054febe3933d/log.txt.gz 2026-04-06 09:58:03,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:58:04,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:58:04,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3828c2214054febe3933d/lava-logs.yaml 2026-04-06 09:58:04,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:58:04,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:58:04,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3828c2214054febe3933d/lava_callback.json.gz 2026-04-06 09:58:04,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:58:04,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3828c2214054febe3933d HTTP/1.1" 200 None 2026-04-06 09:58:04,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:58:04,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:58:04,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:58:04,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3828c2214054febe3933d HTTP/1.1" 200 None 2026-04-06 09:58:04,305 - lava_callback - INFO - Completed processing callback for node 69d3828c2214054febe3933d INFO: 172.19.0.1:37734 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:58:13,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:58:13,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38788 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:59:06,009 - lava_callback - INFO - Received callback for node 69d0e0d5691bac272b3245f9 INFO: 172.19.0.1:54798 - "POST /node/69d0e0d5691bac272b3245f9 HTTP/1.0" 202 Accepted 2026-04-06 09:59:06,015 - lava_callback - INFO - Starting async job submit for node 69d0e0d5691bac272b3245f9 2026-04-06 09:59:06,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:06,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e0d5691bac272b3245f9 HTTP/1.1" 200 None 2026-04-06 09:59:06,040 - lava_callback - DEBUG - Processing node 69d0e0d5691bac272b3245f9: baseline-arm64-clabbe 2026-04-06 09:59:06,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e0d5691bac272b3245f9 2026-04-06 09:59:06,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:06,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e0d5691bac272b3245f9 HTTP/1.1" 200 None 2026-04-06 09:59:06,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:06,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 09:59:06,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:06,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e0d5691bac272b3245f9 HTTP/1.1" 200 None 2026-04-06 09:59:06,110 - lava_callback - ERROR - Error processing callback for node 69d0e0d5691bac272b3245f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54804 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:59:14,873 - lava_callback - INFO - Received callback for node 69d3838f2214054febe393b0 INFO: 172.19.0.1:54262 - "POST /node/69d3838f2214054febe393b0 HTTP/1.0" 202 Accepted 2026-04-06 09:59:14,879 - lava_callback - INFO - Starting async job submit for node 69d3838f2214054febe393b0 2026-04-06 09:59:14,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:14,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3838f2214054febe393b0 HTTP/1.1" 200 None 2026-04-06 09:59:14,934 - lava_callback - DEBUG - Processing node 69d3838f2214054febe393b0: baseline-arm64-broonie INFO: 172.19.0.1:54264 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 09:59:15,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:59:15,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:59:15,349 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3838f2214054febe393b0/log.txt.gz 2026-04-06 09:59:15,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:59:15,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:59:15,710 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3838f2214054febe393b0/lava-logs.yaml 2026-04-06 09:59:15,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:59:15,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:59:15,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d3838f2214054febe393b0/lava_callback.json.gz 2026-04-06 09:59:15,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:15,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3838f2214054febe393b0 HTTP/1.1" 200 None 2026-04-06 09:59:15,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:15,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:59:15,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:15,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3838f2214054febe393b0 HTTP/1.1" 200 None 2026-04-06 09:59:15,953 - lava_callback - INFO - Completed processing callback for node 69d3838f2214054febe393b0 INFO: 172.19.0.1:54274 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:59:18,800 - lava_callback - INFO - Received callback for node 69d383c12214054febe393c5 INFO: 172.19.0.1:54276 - "POST /node/69d383c12214054febe393c5 HTTP/1.0" 202 Accepted 2026-04-06 09:59:18,807 - lava_callback - INFO - Starting async job submit for node 69d383c12214054febe393c5 2026-04-06 09:59:18,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:18,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d383c12214054febe393c5 HTTP/1.1" 200 None 2026-04-06 09:59:18,862 - lava_callback - DEBUG - Processing node 69d383c12214054febe393c5: baseline-arm64 2026-04-06 09:59:19,108 - lava_callback - WARNING - Failed to upload log 2026-04-06 09:59:19,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:59:19,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:59:19,460 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d383c12214054febe393c5/lava-logs.yaml 2026-04-06 09:59:19,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 09:59:19,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 09:59:19,609 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d383c12214054febe393c5/lava_callback.json.gz 2026-04-06 09:59:19,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:19,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d383c12214054febe393c5 HTTP/1.1" 200 None 2026-04-06 09:59:19,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:19,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 09:59:19,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:19,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d383c12214054febe393c5 HTTP/1.1" 200 None 2026-04-06 09:59:19,810 - lava_callback - INFO - Completed processing callback for node 69d383c12214054febe393c5 INFO: 172.19.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60002 - "GET / HTTP/1.0" 200 OK 2026-04-06 09:59:43,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 09:59:43,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41504 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:00:06,158 - lava_callback - INFO - Received callback for node 69d0e119691bac272b32463a INFO: 172.19.0.1:50378 - "POST /node/69d0e119691bac272b32463a HTTP/1.0" 202 Accepted 2026-04-06 10:00:06,164 - lava_callback - INFO - Starting async job submit for node 69d0e119691bac272b32463a 2026-04-06 10:00:06,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:00:06,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e119691bac272b32463a HTTP/1.1" 200 None 2026-04-06 10:00:06,180 - lava_callback - DEBUG - Processing node 69d0e119691bac272b32463a: baseline-arm64-clabbe 2026-04-06 10:00:06,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e119691bac272b32463a 2026-04-06 10:00:06,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:00:06,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e119691bac272b32463a HTTP/1.1" 200 None 2026-04-06 10:00:06,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:00:06,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 10:00:06,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:00:06,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e119691bac272b32463a HTTP/1.1" 200 None 2026-04-06 10:00:06,253 - lava_callback - ERROR - Error processing callback for node 69d0e119691bac272b32463a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39858 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:00:40,022 - lava_callback - INFO - Received callback for node 69d384062214054febe39424 INFO: 172.19.0.1:37704 - "POST /node/69d384062214054febe39424 HTTP/1.0" 202 Accepted 2026-04-06 10:00:40,032 - lava_callback - INFO - Starting async job submit for node 69d384062214054febe39424 2026-04-06 10:00:40,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:00:40,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d384062214054febe39424 HTTP/1.1" 200 None 2026-04-06 10:00:40,096 - lava_callback - DEBUG - Processing node 69d384062214054febe39424: baseline-arm64 2026-04-06 10:00:40,264 - lava_callback - WARNING - Failed to upload log 2026-04-06 10:00:40,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:00:40,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:00:40,578 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d384062214054febe39424/lava-logs.yaml 2026-04-06 10:00:40,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:00:40,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:00:40,726 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d384062214054febe39424/lava_callback.json.gz 2026-04-06 10:00:40,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:00:40,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d384062214054febe39424 HTTP/1.1" 200 None 2026-04-06 10:00:40,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:00:40,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:00:40,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:00:40,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d384062214054febe39424 HTTP/1.1" 200 None 2026-04-06 10:00:40,922 - lava_callback - INFO - Completed processing callback for node 69d384062214054febe39424 2026-04-06 10:00:43,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:00:43,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45574 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:01:23,372 - lava_callback - INFO - Received callback for node 69d380352214054febe39129 INFO: 172.19.0.1:35314 - "POST /node/69d380352214054febe39129 HTTP/1.0" 202 Accepted 2026-04-06 10:01:23,379 - lava_callback - INFO - Starting async job submit for node 69d380352214054febe39129 2026-04-06 10:01:23,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:01:23,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d380352214054febe39129 HTTP/1.1" 200 None 2026-04-06 10:01:23,448 - lava_callback - DEBUG - Processing node 69d380352214054febe39129: baseline-arm 2026-04-06 10:01:24,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:01:24,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:01:24,224 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d380352214054febe39129/log.txt.gz 2026-04-06 10:01:24,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:01:24,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:01:24,874 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d380352214054febe39129/lava-logs.yaml 2026-04-06 10:01:24,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:01:25,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:01:25,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d380352214054febe39129/lava_callback.json.gz DEBUG: Setup failed for 69d380352214054febe39129. Transitting job node result: incomplete -> fail 2026-04-06 10:01:25,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:01:25,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d380352214054febe39129 HTTP/1.1" 200 None 2026-04-06 10:01:25,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:01:25,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 10:01:25,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:01:25,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d380352214054febe39129 HTTP/1.1" 200 None 2026-04-06 10:01:25,377 - lava_callback - INFO - Completed processing callback for node 69d380352214054febe39129 2026-04-06 10:01:26,041 - lava_callback - INFO - Received callback for node 69d0e160691bac272b324666 INFO: 172.19.0.1:35320 - "POST /node/69d0e160691bac272b324666 HTTP/1.0" 202 Accepted 2026-04-06 10:01:26,047 - lava_callback - INFO - Starting async job submit for node 69d0e160691bac272b324666 2026-04-06 10:01:26,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:01:26,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e160691bac272b324666 HTTP/1.1" 200 None 2026-04-06 10:01:26,064 - lava_callback - DEBUG - Processing node 69d0e160691bac272b324666: baseline-arm64-clabbe 2026-04-06 10:01:26,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e160691bac272b324666 2026-04-06 10:01:26,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:01:26,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e160691bac272b324666 HTTP/1.1" 200 None 2026-04-06 10:01:26,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:01:26,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 10:01:26,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:01:26,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e160691bac272b324666 HTTP/1.1" 200 None 2026-04-06 10:01:26,120 - lava_callback - ERROR - Error processing callback for node 69d0e160691bac272b324666: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59868 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:01:43,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:01:43,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35292 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:02:26,172 - lava_callback - INFO - Received callback for node 69d0e1a5691bac272b32469c INFO: 172.19.0.1:59752 - "POST /node/69d0e1a5691bac272b32469c HTTP/1.0" 202 Accepted 2026-04-06 10:02:26,178 - lava_callback - INFO - Starting async job submit for node 69d0e1a5691bac272b32469c 2026-04-06 10:02:26,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:02:26,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e1a5691bac272b32469c HTTP/1.1" 200 None 2026-04-06 10:02:26,196 - lava_callback - DEBUG - Processing node 69d0e1a5691bac272b32469c: baseline-arm64-clabbe 2026-04-06 10:02:26,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e1a5691bac272b32469c 2026-04-06 10:02:26,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:02:26,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e1a5691bac272b32469c HTTP/1.1" 200 None 2026-04-06 10:02:26,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:02:26,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 10:02:26,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:02:26,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e1a5691bac272b32469c HTTP/1.1" 200 None 2026-04-06 10:02:26,269 - lava_callback - ERROR - Error processing callback for node 69d0e1a5691bac272b32469c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38046 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:02:40,556 - lava_callback - INFO - Received callback for node 69d3846d2214054febe39484 INFO: 172.19.0.1:40612 - "POST /node/69d3846d2214054febe39484 HTTP/1.0" 202 Accepted 2026-04-06 10:02:40,563 - lava_callback - INFO - Starting async job submit for node 69d3846d2214054febe39484 2026-04-06 10:02:40,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:02:40,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3846d2214054febe39484 HTTP/1.1" 200 None 2026-04-06 10:02:40,627 - lava_callback - DEBUG - Processing node 69d3846d2214054febe39484: baseline-arm64 2026-04-06 10:02:41,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:02:41,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:02:41,156 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3846d2214054febe39484/log.txt.gz 2026-04-06 10:02:41,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:02:41,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:02:41,576 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3846d2214054febe39484/lava-logs.yaml 2026-04-06 10:02:41,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:02:41,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:02:41,768 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d3846d2214054febe39484/lava_callback.json.gz 2026-04-06 10:02:41,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:02:41,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3846d2214054febe39484 HTTP/1.1" 200 None 2026-04-06 10:02:41,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:02:41,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:02:41,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:02:41,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3846d2214054febe39484 HTTP/1.1" 200 None 2026-04-06 10:02:41,918 - lava_callback - INFO - Completed processing callback for node 69d3846d2214054febe39484 2026-04-06 10:02:43,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:02:43,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:40622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50092 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:03:26,196 - lava_callback - INFO - Received callback for node 69d0e1ea691bac272b3246c4 INFO: 172.19.0.1:43510 - "POST /node/69d0e1ea691bac272b3246c4 HTTP/1.0" 202 Accepted 2026-04-06 10:03:26,202 - lava_callback - INFO - Starting async job submit for node 69d0e1ea691bac272b3246c4 2026-04-06 10:03:26,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:03:26,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e1ea691bac272b3246c4 HTTP/1.1" 200 None 2026-04-06 10:03:26,218 - lava_callback - DEBUG - Processing node 69d0e1ea691bac272b3246c4: baseline-arm64-clabbe 2026-04-06 10:03:26,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e1ea691bac272b3246c4 2026-04-06 10:03:26,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:03:26,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e1ea691bac272b3246c4 HTTP/1.1" 200 None 2026-04-06 10:03:26,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:03:26,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 10:03:26,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:03:26,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e1ea691bac272b3246c4 HTTP/1.1" 200 None 2026-04-06 10:03:26,271 - lava_callback - ERROR - Error processing callback for node 69d0e1ea691bac272b3246c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48168 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:04:43,320 - lava_callback - INFO - Received callback for node 69d383222214054febe39389 INFO: 172.19.0.1:39708 - "POST /node/69d383222214054febe39389 HTTP/1.0" 202 Accepted 2026-04-06 10:04:43,326 - lava_callback - INFO - Starting async job submit for node 69d383222214054febe39389 2026-04-06 10:04:43,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:04:43,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d383222214054febe39389 HTTP/1.1" 200 None 2026-04-06 10:04:43,363 - lava_callback - DEBUG - Processing node 69d383222214054febe39389: baseline-arm64-broonie 2026-04-06 10:04:43,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:04:43,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:04:43,746 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d383222214054febe39389/log.txt.gz 2026-04-06 10:04:43,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:04:44,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:04:44,124 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d383222214054febe39389/lava-logs.yaml 2026-04-06 10:04:44,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:04:44,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:04:44,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d383222214054febe39389/lava_callback.json.gz 2026-04-06 10:04:44,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:04:44,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d383222214054febe39389 HTTP/1.1" 200 None 2026-04-06 10:04:44,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:04:44,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:04:44,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:04:44,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d383222214054febe39389 HTTP/1.1" 200 None 2026-04-06 10:04:44,401 - lava_callback - INFO - Completed processing callback for node 69d383222214054febe39389 2026-04-06 10:04:46,247 - lava_callback - INFO - Received callback for node 69d0e22b691bac272b324710 INFO: 172.19.0.1:39716 - "POST /node/69d0e22b691bac272b324710 HTTP/1.0" 202 Accepted 2026-04-06 10:04:46,252 - lava_callback - INFO - Starting async job submit for node 69d0e22b691bac272b324710 2026-04-06 10:04:46,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:04:46,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e22b691bac272b324710 HTTP/1.1" 200 None 2026-04-06 10:04:46,268 - lava_callback - DEBUG - Processing node 69d0e22b691bac272b324710: baseline-arm64-clabbe 2026-04-06 10:04:46,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e22b691bac272b324710 2026-04-06 10:04:46,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:04:46,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e22b691bac272b324710 HTTP/1.1" 200 None 2026-04-06 10:04:46,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:04:46,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 10:04:46,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:04:46,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e22b691bac272b324710 HTTP/1.1" 200 None 2026-04-06 10:04:46,324 - lava_callback - ERROR - Error processing callback for node 69d0e22b691bac272b324710: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38642 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:05:13,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:05:13,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:48816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39690 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:05:27,341 - lava_callback - INFO - Received callback for node 69d380c32214054febe391b1 INFO: 172.19.0.1:39700 - "POST /node/69d380c32214054febe391b1 HTTP/1.0" 202 Accepted 2026-04-06 10:05:27,349 - lava_callback - INFO - Starting async job submit for node 69d380c32214054febe391b1 2026-04-06 10:05:27,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:05:27,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d380c32214054febe391b1 HTTP/1.1" 200 None 2026-04-06 10:05:27,407 - lava_callback - DEBUG - Processing node 69d380c32214054febe391b1: baseline-nfs-arm64 2026-04-06 10:05:28,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:05:28,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:05:28,859 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d380c32214054febe391b1/log.txt.gz 2026-04-06 10:05:29,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:05:29,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:05:29,784 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d380c32214054febe391b1/lava-logs.yaml 2026-04-06 10:05:29,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:05:30,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:05:30,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d380c32214054febe391b1/lava_callback.json.gz DEBUG: Setup failed for 69d380c32214054febe391b1. Transitting job node result: incomplete -> fail 2026-04-06 10:05:30,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:05:30,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d380c32214054febe391b1 HTTP/1.1" 200 None 2026-04-06 10:05:30,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:05:30,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:05:30,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:05:30,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d380c32214054febe391b1 HTTP/1.1" 200 None 2026-04-06 10:05:30,245 - lava_callback - INFO - Completed processing callback for node 69d380c32214054febe391b1 INFO: 172.19.0.1:50224 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:05:43,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:05:43,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-06 10:05:46,261 - lava_callback - INFO - Received callback for node 69d0e26d691bac272b324754 INFO: 172.19.0.1:38852 - "POST /node/69d0e26d691bac272b324754 HTTP/1.0" 202 Accepted 2026-04-06 10:05:46,267 - lava_callback - INFO - Starting async job submit for node 69d0e26d691bac272b324754 2026-04-06 10:05:46,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:05:46,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e26d691bac272b324754 HTTP/1.1" 200 None 2026-04-06 10:05:46,285 - lava_callback - DEBUG - Processing node 69d0e26d691bac272b324754: baseline-arm64-clabbe 2026-04-06 10:05:46,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e26d691bac272b324754 2026-04-06 10:05:46,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:05:46,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e26d691bac272b324754 HTTP/1.1" 200 None 2026-04-06 10:05:46,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:05:46,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 10:05:46,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:05:46,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e26d691bac272b324754 HTTP/1.1" 200 None 2026-04-06 10:05:46,345 - lava_callback - ERROR - Error processing callback for node 69d0e26d691bac272b324754: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48944 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:08:59,464 - lava_callback - INFO - Received callback for node 69d0e32d691bac272b3247f1 INFO: 172.19.0.1:48958 - "POST /node/69d0e32d691bac272b3247f1 HTTP/1.0" 202 Accepted 2026-04-06 10:08:59,469 - lava_callback - INFO - Starting async job submit for node 69d0e32d691bac272b3247f1 2026-04-06 10:08:59,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:08:59,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e32d691bac272b3247f1 HTTP/1.1" 200 None 2026-04-06 10:08:59,488 - lava_callback - DEBUG - Processing node 69d0e32d691bac272b3247f1: baseline-arm64-baylibre 2026-04-06 10:08:59,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e32d691bac272b3247f1 2026-04-06 10:08:59,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:08:59,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e32d691bac272b3247f1 HTTP/1.1" 200 None 2026-04-06 10:08:59,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:08:59,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-06 10:08:59,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:08:59,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e32d691bac272b3247f1 HTTP/1.1" 200 None 2026-04-06 10:08:59,539 - lava_callback - ERROR - Error processing callback for node 69d0e32d691bac272b3247f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48546 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:11:39,611 - lava_callback - INFO - Received callback for node 69d0e3d9691bac272b32488f INFO: 172.19.0.1:48552 - "POST /node/69d0e3d9691bac272b32488f HTTP/1.0" 202 Accepted 2026-04-06 10:11:39,620 - lava_callback - INFO - Starting async job submit for node 69d0e3d9691bac272b32488f 2026-04-06 10:11:39,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:11:39,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e3d9691bac272b32488f HTTP/1.1" 200 None 2026-04-06 10:11:39,637 - lava_callback - DEBUG - Processing node 69d0e3d9691bac272b32488f: baseline-arm64-baylibre 2026-04-06 10:11:39,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e3d9691bac272b32488f 2026-04-06 10:11:39,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:11:39,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e3d9691bac272b32488f HTTP/1.1" 200 None 2026-04-06 10:11:39,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:11:39,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-06 10:11:39,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:11:39,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e3d9691bac272b32488f HTTP/1.1" 200 None 2026-04-06 10:11:39,710 - lava_callback - ERROR - Error processing callback for node 69d0e3d9691bac272b32488f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51276 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:14:19,800 - lava_callback - INFO - Received callback for node 69d0e469691bac272b3248db INFO: 172.19.0.1:57614 - "POST /node/69d0e469691bac272b3248db HTTP/1.0" 202 Accepted 2026-04-06 10:14:19,806 - lava_callback - INFO - Starting async job submit for node 69d0e469691bac272b3248db 2026-04-06 10:14:19,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:14:19,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e469691bac272b3248db HTTP/1.1" 200 None 2026-04-06 10:14:19,821 - lava_callback - DEBUG - Processing node 69d0e469691bac272b3248db: baseline-arm64-baylibre 2026-04-06 10:14:19,822 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e469691bac272b3248db 2026-04-06 10:14:19,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:14:19,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e469691bac272b3248db HTTP/1.1" 200 None 2026-04-06 10:14:19,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:14:19,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-06 10:14:19,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:14:19,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e469691bac272b3248db HTTP/1.1" 200 None 2026-04-06 10:14:19,882 - lava_callback - ERROR - Error processing callback for node 69d0e469691bac272b3248db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49752 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:17:06,759 - lava_callback - INFO - Received callback for node 69d386df2214054febe39666 INFO: 172.19.0.1:49764 - "POST /node/69d386df2214054febe39666 HTTP/1.0" 202 Accepted 2026-04-06 10:17:06,766 - lava_callback - INFO - Starting async job submit for node 69d386df2214054febe39666 2026-04-06 10:17:06,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:17:06,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d386df2214054febe39666 HTTP/1.1" 200 None 2026-04-06 10:17:06,818 - lava_callback - DEBUG - Processing node 69d386df2214054febe39666: baseline-arm64 2026-04-06 10:17:07,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:17:07,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:17:07,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d386df2214054febe39666/log.txt.gz 2026-04-06 10:17:07,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:17:07,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:17:07,783 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d386df2214054febe39666/lava-logs.yaml 2026-04-06 10:17:07,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:17:07,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:17:07,960 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d386df2214054febe39666/lava_callback.json.gz DEBUG: Setup failed for 69d386df2214054febe39666. Transitting job node result: incomplete -> fail 2026-04-06 10:17:08,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:17:08,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d386df2214054febe39666 HTTP/1.1" 200 None 2026-04-06 10:17:08,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:17:08,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:17:08,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:17:08,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d386df2214054febe39666 HTTP/1.1" 200 None 2026-04-06 10:17:08,164 - lava_callback - INFO - Completed processing callback for node 69d386df2214054febe39666 2026-04-06 10:17:13,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:17:13,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:49982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45038 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:17:40,040 - lava_callback - INFO - Received callback for node 69d0e534691bac272b3249a3 INFO: 172.19.0.1:45974 - "POST /node/69d0e534691bac272b3249a3 HTTP/1.0" 202 Accepted 2026-04-06 10:17:40,046 - lava_callback - INFO - Starting async job submit for node 69d0e534691bac272b3249a3 2026-04-06 10:17:40,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:17:40,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e534691bac272b3249a3 HTTP/1.1" 200 None 2026-04-06 10:17:40,062 - lava_callback - DEBUG - Processing node 69d0e534691bac272b3249a3: baseline-arm64-baylibre 2026-04-06 10:17:40,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e534691bac272b3249a3 2026-04-06 10:17:40,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:17:40,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e534691bac272b3249a3 HTTP/1.1" 200 None 2026-04-06 10:17:40,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:17:40,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-06 10:17:40,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:17:40,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e534691bac272b3249a3 HTTP/1.1" 200 None 2026-04-06 10:17:40,126 - lava_callback - ERROR - Error processing callback for node 69d0e534691bac272b3249a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42332 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:20:00,081 - lava_callback - INFO - Received callback for node 69d0e5c5691bac272b3249e1 INFO: 172.19.0.1:33494 - "POST /node/69d0e5c5691bac272b3249e1 HTTP/1.0" 202 Accepted 2026-04-06 10:20:00,086 - lava_callback - INFO - Starting async job submit for node 69d0e5c5691bac272b3249e1 2026-04-06 10:20:00,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:20:00,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e5c5691bac272b3249e1 HTTP/1.1" 200 None 2026-04-06 10:20:00,102 - lava_callback - DEBUG - Processing node 69d0e5c5691bac272b3249e1: baseline-arm64-baylibre 2026-04-06 10:20:00,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e5c5691bac272b3249e1 2026-04-06 10:20:00,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:20:00,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e5c5691bac272b3249e1 HTTP/1.1" 200 None 2026-04-06 10:20:00,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:20:00,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-06 10:20:00,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:20:00,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e5c5691bac272b3249e1 HTTP/1.1" 200 None 2026-04-06 10:20:00,155 - lava_callback - ERROR - Error processing callback for node 69d0e5c5691bac272b3249e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33506 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:20:08,100 - lava_callback - INFO - Received callback for node 69d388c52214054febe397bb INFO: 172.19.0.1:33520 - "POST /node/69d388c52214054febe397bb HTTP/1.0" 202 Accepted 2026-04-06 10:20:08,106 - lava_callback - INFO - Starting async job submit for node 69d388c52214054febe397bb 2026-04-06 10:20:08,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:20:08,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d388c52214054febe397bb HTTP/1.1" 200 None 2026-04-06 10:20:08,123 - lava_callback - DEBUG - Processing node 69d388c52214054febe397bb: baseline-nfs-arm64 2026-04-06 10:20:08,125 - lava_callback - WARNING - Failed to upload log 2026-04-06 10:20:08,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:20:08,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:20:08,255 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d388c52214054febe397bb/lava-logs.yaml 2026-04-06 10:20:08,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:20:08,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:20:08,380 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d388c52214054febe397bb/lava_callback.json.gz 2026-04-06 10:20:08,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:20:08,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d388c52214054febe397bb HTTP/1.1" 200 None 2026-04-06 10:20:08,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:20:08,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:20:08,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:20:08,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d388c52214054febe397bb HTTP/1.1" 200 None 2026-04-06 10:20:08,471 - lava_callback - INFO - Completed processing callback for node 69d388c52214054febe397bb 2026-04-06 10:20:13,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:20:13,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38782 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:22:27,193 - lava_callback - INFO - Received callback for node 69d0e656691bac272b324a48 INFO: 172.19.0.1:38786 - "POST /node/69d0e656691bac272b324a48 HTTP/1.0" 202 Accepted 2026-04-06 10:22:27,199 - lava_callback - INFO - Starting async job submit for node 69d0e656691bac272b324a48 2026-04-06 10:22:27,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:22:27,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e656691bac272b324a48 HTTP/1.1" 200 None 2026-04-06 10:22:27,215 - lava_callback - DEBUG - Processing node 69d0e656691bac272b324a48: baseline-arm64-clabbe 2026-04-06 10:22:27,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e656691bac272b324a48 2026-04-06 10:22:27,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:22:27,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e656691bac272b324a48 HTTP/1.1" 200 None 2026-04-06 10:22:27,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:22:27,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-06 10:22:27,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:22:27,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e656691bac272b324a48 HTTP/1.1" 200 None 2026-04-06 10:22:27,271 - lava_callback - ERROR - Error processing callback for node 69d0e656691bac272b324a48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48640 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:23:27,206 - lava_callback - INFO - Received callback for node 69d0e694691bac272b324aa2 INFO: 172.19.0.1:48652 - "POST /node/69d0e694691bac272b324aa2 HTTP/1.0" 202 Accepted 2026-04-06 10:23:27,212 - lava_callback - INFO - Starting async job submit for node 69d0e694691bac272b324aa2 2026-04-06 10:23:27,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:23:27,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e694691bac272b324aa2 HTTP/1.1" 200 None 2026-04-06 10:23:27,228 - lava_callback - DEBUG - Processing node 69d0e694691bac272b324aa2: baseline-arm64-clabbe 2026-04-06 10:23:27,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e694691bac272b324aa2 2026-04-06 10:23:27,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:23:27,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e694691bac272b324aa2 HTTP/1.1" 200 None 2026-04-06 10:23:27,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:23:27,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-06 10:23:27,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:23:27,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e694691bac272b324aa2 HTTP/1.1" 200 None 2026-04-06 10:23:27,284 - lava_callback - ERROR - Error processing callback for node 69d0e694691bac272b324aa2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35420 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:24:27,266 - lava_callback - INFO - Received callback for node 69d0e6d4691bac272b324aef INFO: 172.19.0.1:35432 - "POST /node/69d0e6d4691bac272b324aef HTTP/1.0" 202 Accepted 2026-04-06 10:24:27,271 - lava_callback - INFO - Starting async job submit for node 69d0e6d4691bac272b324aef 2026-04-06 10:24:27,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:24:27,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e6d4691bac272b324aef HTTP/1.1" 200 None 2026-04-06 10:24:27,289 - lava_callback - DEBUG - Processing node 69d0e6d4691bac272b324aef: baseline-arm64-clabbe 2026-04-06 10:24:27,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e6d4691bac272b324aef 2026-04-06 10:24:27,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:24:27,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e6d4691bac272b324aef HTTP/1.1" 200 None 2026-04-06 10:24:27,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:24:27,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-06 10:24:27,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:24:27,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e6d4691bac272b324aef HTTP/1.1" 200 None 2026-04-06 10:24:27,366 - lava_callback - ERROR - Error processing callback for node 69d0e6d4691bac272b324aef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37588 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:27:27,364 - lava_callback - INFO - Received callback for node 69d0e78a691bac272b324b4a INFO: 172.19.0.1:37598 - "POST /node/69d0e78a691bac272b324b4a HTTP/1.0" 202 Accepted 2026-04-06 10:27:27,370 - lava_callback - INFO - Starting async job submit for node 69d0e78a691bac272b324b4a 2026-04-06 10:27:27,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:27:27,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e78a691bac272b324b4a HTTP/1.1" 200 None 2026-04-06 10:27:27,385 - lava_callback - DEBUG - Processing node 69d0e78a691bac272b324b4a: baseline-arm64-clabbe 2026-04-06 10:27:27,386 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e78a691bac272b324b4a 2026-04-06 10:27:27,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:27:27,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e78a691bac272b324b4a HTTP/1.1" 200 None 2026-04-06 10:27:27,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:27:27,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-06 10:27:27,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:27:27,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e78a691bac272b324b4a HTTP/1.1" 200 None 2026-04-06 10:27:27,437 - lava_callback - ERROR - Error processing callback for node 69d0e78a691bac272b324b4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44674 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:28:46,571 - lava_callback - INFO - Received callback for node 69d388812214054febe39796 INFO: 172.19.0.1:44682 - "POST /node/69d388812214054febe39796 HTTP/1.0" 202 Accepted 2026-04-06 10:28:46,578 - lava_callback - INFO - Starting async job submit for node 69d388812214054febe39796 2026-04-06 10:28:46,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:28:46,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d388812214054febe39796 HTTP/1.1" 200 None 2026-04-06 10:28:46,617 - lava_callback - DEBUG - Processing node 69d388812214054febe39796: baseline-nfs-arm64 2026-04-06 10:28:47,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:28:47,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:28:47,322 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d388812214054febe39796/log.txt.gz 2026-04-06 10:28:47,547 - lava_callback - INFO - Received callback for node 69d0e7d0691bac272b324b72 INFO: 172.19.0.1:44698 - "POST /node/69d0e7d0691bac272b324b72 HTTP/1.0" 202 Accepted 2026-04-06 10:28:47,568 - lava_callback - INFO - Starting async job submit for node 69d0e7d0691bac272b324b72 2026-04-06 10:28:47,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:28:47,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:28:47,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e7d0691bac272b324b72 HTTP/1.1" 200 None 2026-04-06 10:28:47,607 - lava_callback - DEBUG - Processing node 69d0e7d0691bac272b324b72: baseline-arm64-clabbe 2026-04-06 10:28:47,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e7d0691bac272b324b72 2026-04-06 10:28:47,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:28:47,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e7d0691bac272b324b72 HTTP/1.1" 200 None 2026-04-06 10:28:47,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:28:47,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-06 10:28:47,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:28:47,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e7d0691bac272b324b72 HTTP/1.1" 200 None 2026-04-06 10:28:47,667 - lava_callback - ERROR - Error processing callback for node 69d0e7d0691bac272b324b72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-06 10:28:47,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:28:47,877 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d388812214054febe39796/lava-logs.yaml 2026-04-06 10:28:47,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:28:48,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:28:48,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d388812214054febe39796/lava_callback.json.gz 2026-04-06 10:28:48,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:28:48,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d388812214054febe39796 HTTP/1.1" 200 None 2026-04-06 10:28:48,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:28:48,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:28:48,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:28:48,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d388812214054febe39796 HTTP/1.1" 200 None 2026-04-06 10:28:48,227 - lava_callback - INFO - Completed processing callback for node 69d388812214054febe39796 INFO: 172.19.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55870 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:29:13,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:29:13,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:46040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52778 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:29:47,491 - lava_callback - INFO - Received callback for node 69d0e811691bac272b324bb6 INFO: 172.19.0.1:52786 - "POST /node/69d0e811691bac272b324bb6 HTTP/1.0" 202 Accepted 2026-04-06 10:29:47,497 - lava_callback - INFO - Starting async job submit for node 69d0e811691bac272b324bb6 2026-04-06 10:29:47,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:29:47,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e811691bac272b324bb6 HTTP/1.1" 200 None 2026-04-06 10:29:47,512 - lava_callback - DEBUG - Processing node 69d0e811691bac272b324bb6: baseline-arm64-clabbe 2026-04-06 10:29:47,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d0e811691bac272b324bb6 2026-04-06 10:29:47,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:29:47,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0e811691bac272b324bb6 HTTP/1.1" 200 None 2026-04-06 10:29:47,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:29:47,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-06 10:29:47,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:29:47,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d0e811691bac272b324bb6 HTTP/1.1" 200 None 2026-04-06 10:29:47,565 - lava_callback - ERROR - Error processing callback for node 69d0e811691bac272b324bb6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57166 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:32:42,109 - lava_callback - INFO - Received callback for node 69d389452214054febe39826 INFO: 172.19.0.1:42736 - "POST /node/69d389452214054febe39826 HTTP/1.0" 202 Accepted 2026-04-06 10:32:42,115 - lava_callback - INFO - Starting async job submit for node 69d389452214054febe39826 2026-04-06 10:32:42,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:32:42,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d389452214054febe39826 HTTP/1.1" 200 None 2026-04-06 10:32:42,160 - lava_callback - DEBUG - Processing node 69d389452214054febe39826: baseline-arm64 2026-04-06 10:32:42,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:32:42,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:32:42,991 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d389452214054febe39826/log.txt.gz 2026-04-06 10:32:43,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:32:43,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:32:43,485 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d389452214054febe39826/lava-logs.yaml 2026-04-06 10:32:43,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:32:43,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:32:43,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d389452214054febe39826/lava_callback.json.gz 2026-04-06 10:32:43,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:32:43,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d389452214054febe39826 HTTP/1.1" 200 None 2026-04-06 10:32:43,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:32:43,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:32:43,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:32:43,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d389452214054febe39826 HTTP/1.1" 200 None 2026-04-06 10:32:43,833 - lava_callback - INFO - Completed processing callback for node 69d389452214054febe39826 INFO: 172.19.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39580 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:33:13,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:33:13,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:40614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40628 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:33:20,266 - lava_callback - INFO - Received callback for node 69d38bbf2214054febe399d1 INFO: 172.19.0.1:37554 - "POST /node/69d38bbf2214054febe399d1 HTTP/1.0" 202 Accepted 2026-04-06 10:33:20,273 - lava_callback - INFO - Starting async job submit for node 69d38bbf2214054febe399d1 2026-04-06 10:33:20,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:33:20,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38bbf2214054febe399d1 HTTP/1.1" 200 None 2026-04-06 10:33:20,335 - lava_callback - DEBUG - Processing node 69d38bbf2214054febe399d1: baseline-arm64 2026-04-06 10:33:20,540 - lava_callback - WARNING - Failed to upload log 2026-04-06 10:33:20,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:33:20,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:33:20,845 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38bbf2214054febe399d1/lava-logs.yaml 2026-04-06 10:33:20,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:33:20,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:33:20,968 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38bbf2214054febe399d1/lava_callback.json.gz 2026-04-06 10:33:20,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:33:21,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38bbf2214054febe399d1 HTTP/1.1" 200 None 2026-04-06 10:33:21,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:33:21,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:33:21,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:33:21,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d38bbf2214054febe399d1 HTTP/1.1" 200 None 2026-04-06 10:33:21,130 - lava_callback - INFO - Completed processing callback for node 69d38bbf2214054febe399d1 INFO: 172.19.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44754 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:33:43,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:33:43,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43492 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:35:47,880 - lava_callback - INFO - Received callback for node 69d38c4c2214054febe39a1c INFO: 172.19.0.1:43506 - "POST /node/69d38c4c2214054febe39a1c HTTP/1.0" 202 Accepted 2026-04-06 10:35:47,887 - lava_callback - INFO - Starting async job submit for node 69d38c4c2214054febe39a1c 2026-04-06 10:35:47,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:35:47,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38c4c2214054febe39a1c HTTP/1.1" 200 None 2026-04-06 10:35:47,940 - lava_callback - DEBUG - Processing node 69d38c4c2214054febe39a1c: baseline-arm64 2026-04-06 10:35:48,074 - lava_callback - WARNING - Failed to upload log 2026-04-06 10:35:48,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:35:48,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:35:48,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38c4c2214054febe39a1c/lava-logs.yaml 2026-04-06 10:35:48,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:35:48,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:35:48,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38c4c2214054febe39a1c/lava_callback.json.gz 2026-04-06 10:35:48,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:35:48,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38c4c2214054febe39a1c HTTP/1.1" 200 None 2026-04-06 10:35:48,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:35:48,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:35:48,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:35:48,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d38c4c2214054febe39a1c HTTP/1.1" 200 None 2026-04-06 10:35:48,813 - lava_callback - INFO - Completed processing callback for node 69d38c4c2214054febe39a1c INFO: 172.19.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46934 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:36:13,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:36:13,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:35964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51942 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:40:05,062 - lava_callback - INFO - Received callback for node 69d38d3f2214054febe39ad7 INFO: 172.19.0.1:56292 - "POST /node/69d38d3f2214054febe39ad7 HTTP/1.0" 202 Accepted 2026-04-06 10:40:05,068 - lava_callback - INFO - Starting async job submit for node 69d38d3f2214054febe39ad7 2026-04-06 10:40:05,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:40:05,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38d3f2214054febe39ad7 HTTP/1.1" 200 None 2026-04-06 10:40:05,105 - lava_callback - DEBUG - Processing node 69d38d3f2214054febe39ad7: baseline-arm64 2026-04-06 10:40:05,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:40:05,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:40:05,717 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38d3f2214054febe39ad7/log.txt.gz 2026-04-06 10:40:05,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:40:06,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:40:06,172 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38d3f2214054febe39ad7/lava-logs.yaml 2026-04-06 10:40:06,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:40:06,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:40:06,340 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38d3f2214054febe39ad7/lava_callback.json.gz 2026-04-06 10:40:06,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:40:06,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38d3f2214054febe39ad7 HTTP/1.1" 200 None 2026-04-06 10:40:06,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:40:06,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:40:06,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:40:06,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d38d3f2214054febe39ad7 HTTP/1.1" 200 None 2026-04-06 10:40:06,429 - lava_callback - INFO - Completed processing callback for node 69d38d3f2214054febe39ad7 INFO: 172.19.0.1:56306 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:40:13,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:40:13,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41938 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:45:16,560 - lava_callback - INFO - Received callback for node 69d38aa42214054febe3990b INFO: 172.19.0.1:41942 - "POST /node/69d38aa42214054febe3990b HTTP/1.0" 202 Accepted 2026-04-06 10:45:16,566 - lava_callback - INFO - Starting async job submit for node 69d38aa42214054febe3990b 2026-04-06 10:45:16,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:45:16,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38aa42214054febe3990b HTTP/1.1" 200 None 2026-04-06 10:45:16,638 - lava_callback - DEBUG - Processing node 69d38aa42214054febe3990b: ltp-smoke 2026-04-06 10:45:17,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:45:17,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:45:17,282 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d38aa42214054febe3990b/log.txt.gz 2026-04-06 10:45:17,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:45:17,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:45:17,802 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d38aa42214054febe3990b/lava-logs.yaml 2026-04-06 10:45:17,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:45:17,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:45:17,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d38aa42214054febe3990b/lava_callback.json.gz 2026-04-06 10:45:18,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:45:18,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38aa42214054febe3990b HTTP/1.1" 200 None 2026-04-06 10:45:18,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:45:18,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c272214054febe37d68 HTTP/1.1" 200 None 2026-04-06 10:45:18,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:45:18,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d38aa42214054febe3990b HTTP/1.1" 200 None 2026-04-06 10:45:18,290 - lava_callback - INFO - Completed processing callback for node 69d38aa42214054febe3990b INFO: 172.19.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41512 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:45:43,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:45:43,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49744 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:51:53,497 - lava_callback - INFO - Received callback for node 69d38ea12214054febe39bbc INFO: 172.19.0.1:55240 - "POST /node/69d38ea12214054febe39bbc HTTP/1.0" 202 Accepted 2026-04-06 10:51:53,505 - lava_callback - INFO - Starting async job submit for node 69d38ea12214054febe39bbc 2026-04-06 10:51:53,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:51:53,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38ea12214054febe39bbc HTTP/1.1" 200 None 2026-04-06 10:51:53,581 - lava_callback - DEBUG - Processing node 69d38ea12214054febe39bbc: baseline-arm64 2026-04-06 10:51:53,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:51:54,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:51:54,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38ea12214054febe39bbc/log.txt.gz 2026-04-06 10:51:54,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:51:54,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:51:54,792 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38ea12214054febe39bbc/lava-logs.yaml 2026-04-06 10:51:54,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:51:54,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:51:54,984 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38ea12214054febe39bbc/lava_callback.json.gz DEBUG: Setup failed for 69d38ea12214054febe39bbc. Transitting job node result: incomplete -> fail 2026-04-06 10:51:55,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:51:55,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38ea12214054febe39bbc HTTP/1.1" 200 None 2026-04-06 10:51:55,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:51:55,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:51:55,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:51:55,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d38ea12214054febe39bbc HTTP/1.1" 200 None 2026-04-06 10:51:55,208 - lava_callback - INFO - Completed processing callback for node 69d38ea12214054febe39bbc INFO: 172.19.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45930 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:52:13,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:52:13,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:32784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53900 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:52:44,567 - lava_callback - INFO - Received callback for node 69d38c932214054febe39a47 INFO: 172.19.0.1:60912 - "POST /node/69d38c932214054febe39a47 HTTP/1.0" 202 Accepted 2026-04-06 10:52:44,574 - lava_callback - INFO - Starting async job submit for node 69d38c932214054febe39a47 2026-04-06 10:52:44,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:52:44,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38c932214054febe39a47 HTTP/1.1" 200 None 2026-04-06 10:52:44,641 - lava_callback - DEBUG - Processing node 69d38c932214054febe39a47: baseline-arm 2026-04-06 10:52:45,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:52:45,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:52:45,395 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d38c932214054febe39a47/log.txt.gz 2026-04-06 10:52:45,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:52:46,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:52:46,099 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d38c932214054febe39a47/lava-logs.yaml 2026-04-06 10:52:46,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:52:46,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:52:46,278 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d38c932214054febe39a47/lava_callback.json.gz DEBUG: Setup failed for 69d38c932214054febe39a47. Transitting job node result: incomplete -> fail 2026-04-06 10:52:46,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:52:46,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38c932214054febe39a47 HTTP/1.1" 200 None 2026-04-06 10:52:46,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:52:46,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 10:52:46,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:52:46,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d38c932214054febe39a47 HTTP/1.1" 200 None INFO: 172.19.0.1:60924 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:52:46,557 - lava_callback - INFO - Completed processing callback for node 69d38c932214054febe39a47 INFO: 172.19.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52064 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:53:13,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:53:13,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:51356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50874 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:56:54,948 - lava_callback - INFO - Received callback for node 69d38eec2214054febe39c08 INFO: 172.19.0.1:38026 - "POST /node/69d38eec2214054febe39c08 HTTP/1.0" 202 Accepted 2026-04-06 10:56:54,954 - lava_callback - INFO - Starting async job submit for node 69d38eec2214054febe39c08 2026-04-06 10:56:54,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:56:55,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38eec2214054febe39c08 HTTP/1.1" 200 None 2026-04-06 10:56:55,008 - lava_callback - DEBUG - Processing node 69d38eec2214054febe39c08: baseline-nfs-arm64 2026-04-06 10:56:55,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:56:55,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:56:55,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d38eec2214054febe39c08/log.txt.gz 2026-04-06 10:56:56,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:56:56,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:56:56,251 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d38eec2214054febe39c08/lava-logs.yaml 2026-04-06 10:56:56,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:56:56,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:56:56,414 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d38eec2214054febe39c08/lava_callback.json.gz 2026-04-06 10:56:56,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:56:56,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38eec2214054febe39c08 HTTP/1.1" 200 None 2026-04-06 10:56:56,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:56:56,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:56:56,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:56:56,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d38eec2214054febe39c08 HTTP/1.1" 200 None INFO: 172.19.0.1:38030 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:56:56,559 - lava_callback - INFO - Completed processing callback for node 69d38eec2214054febe39c08 INFO: 172.19.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55948 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:57:13,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:57:13,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58568 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:58:03,006 - lava_callback - INFO - Received callback for node 69d38f312214054febe39c18 INFO: 172.19.0.1:54220 - "POST /node/69d38f312214054febe39c18 HTTP/1.0" 202 Accepted 2026-04-06 10:58:03,012 - lava_callback - INFO - Starting async job submit for node 69d38f312214054febe39c18 2026-04-06 10:58:03,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:58:03,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38f312214054febe39c18 HTTP/1.1" 200 None 2026-04-06 10:58:03,052 - lava_callback - DEBUG - Processing node 69d38f312214054febe39c18: baseline-arm64 2026-04-06 10:58:03,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:58:03,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:58:03,779 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38f312214054febe39c18/log.txt.gz 2026-04-06 10:58:04,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:58:04,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:58:04,315 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38f312214054febe39c18/lava-logs.yaml 2026-04-06 10:58:04,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 10:58:04,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 10:58:04,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d38f312214054febe39c18/lava_callback.json.gz 2026-04-06 10:58:04,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:58:04,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38f312214054febe39c18 HTTP/1.1" 200 None 2026-04-06 10:58:04,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:58:04,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 10:58:04,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:58:04,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d38f312214054febe39c18 HTTP/1.1" 200 None 2026-04-06 10:58:04,620 - lava_callback - INFO - Completed processing callback for node 69d38f312214054febe39c18 INFO: 172.19.0.1:54236 - "GET / HTTP/1.0" 200 OK 2026-04-06 10:58:13,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 10:58:13,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58710 - "GET / HTTP/1.0" 200 OK 2026-04-06 11:02:35,970 - lava_callback - INFO - Received callback for node 69d38e1f2214054febe39b4d INFO: 172.19.0.1:35584 - "POST /node/69d38e1f2214054febe39b4d HTTP/1.0" 202 Accepted 2026-04-06 11:02:35,977 - lava_callback - INFO - Starting async job submit for node 69d38e1f2214054febe39b4d 2026-04-06 11:02:36,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:02:36,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38e1f2214054febe39b4d HTTP/1.1" 200 None 2026-04-06 11:02:36,041 - lava_callback - DEBUG - Processing node 69d38e1f2214054febe39b4d: baseline-nfs-arm64 INFO: 172.19.0.1:35586 - "GET / HTTP/1.0" 200 OK 2026-04-06 11:02:37,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:02:37,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:02:37,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d38e1f2214054febe39b4d/log.txt.gz 2026-04-06 11:02:37,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:02:38,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:02:38,403 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d38e1f2214054febe39b4d/lava-logs.yaml 2026-04-06 11:02:38,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:02:38,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:02:38,603 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d38e1f2214054febe39b4d/lava_callback.json.gz DEBUG: Setup failed for 69d38e1f2214054febe39b4d. Transitting job node result: incomplete -> fail 2026-04-06 11:02:38,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:02:38,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d38e1f2214054febe39b4d HTTP/1.1" 200 None 2026-04-06 11:02:38,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:02:38,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 11:02:38,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:02:38,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d38e1f2214054febe39b4d HTTP/1.1" 200 None 2026-04-06 11:02:38,841 - lava_callback - INFO - Completed processing callback for node 69d38e1f2214054febe39b4d 2026-04-06 11:02:43,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:02:43,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46864 - "GET / HTTP/1.0" 200 OK 2026-04-06 11:09:18,267 - lava_callback - INFO - Received callback for node 69d3907f2214054febe39c4d INFO: 172.19.0.1:46866 - "POST /node/69d3907f2214054febe39c4d HTTP/1.0" 202 Accepted 2026-04-06 11:09:18,277 - lava_callback - INFO - Starting async job submit for node 69d3907f2214054febe39c4d 2026-04-06 11:09:18,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:09:18,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3907f2214054febe39c4d HTTP/1.1" 200 None 2026-04-06 11:09:18,356 - lava_callback - DEBUG - Processing node 69d3907f2214054febe39c4d: baseline-arm 2026-04-06 11:09:18,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:09:19,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:09:19,115 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d3907f2214054febe39c4d/log.txt.gz 2026-04-06 11:09:19,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:09:19,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:09:19,700 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d3907f2214054febe39c4d/lava-logs.yaml 2026-04-06 11:09:19,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:09:19,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:09:19,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d3907f2214054febe39c4d/lava_callback.json.gz DEBUG: Setup failed for 69d3907f2214054febe39c4d. Transitting job node result: incomplete -> fail 2026-04-06 11:09:20,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:09:20,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d3907f2214054febe39c4d HTTP/1.1" 200 None 2026-04-06 11:09:20,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:09:20,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c222214054febe37d62 HTTP/1.1" 200 None 2026-04-06 11:09:20,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:09:20,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d3907f2214054febe39c4d HTTP/1.1" 200 None 2026-04-06 11:09:20,191 - lava_callback - INFO - Completed processing callback for node 69d3907f2214054febe39c4d INFO: 172.19.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34782 - "GET / HTTP/1.0" 200 OK 2026-04-06 11:09:43,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:09:43,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:58942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48702 - "GET /node/68fb402d5818c913a1e19d75%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:48716 - "GET /node/693afc0cfee8383e92b6d770%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49376 - "GET /node/69840ce1969566dcb0d2bd0c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:49386 - "GET /node/69280d9cb1b5e06bf6c04d29%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50320 - "GET /node/698af4933b3beb19e7616a54%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48226 - "GET /node/69936409cebe99dd8e0642a0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:48238 - "GET /node/698ba1ef0a16aea5a0dc9556%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:60290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53402 - "GET /node/693b44e44b47c3f87266f6ca%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:53408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39578 - "GET / HTTP/1.0" 200 OK 2026-04-06 11:22:36,590 - lava_callback - INFO - Received callback for node 69d392d72214054febe39c91 INFO: 172.19.0.1:39588 - "POST /node/69d392d72214054febe39c91 HTTP/1.0" 202 Accepted 2026-04-06 11:22:36,601 - lava_callback - INFO - Starting async job submit for node 69d392d72214054febe39c91 2026-04-06 11:22:36,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:22:36,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d392d72214054febe39c91 HTTP/1.1" 200 None 2026-04-06 11:22:36,663 - lava_callback - DEBUG - Processing node 69d392d72214054febe39c91: baseline-nfs-arm64 2026-04-06 11:22:37,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:22:37,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:22:37,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d392d72214054febe39c91/log.txt.gz 2026-04-06 11:22:38,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:22:38,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:22:38,879 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d392d72214054febe39c91/lava-logs.yaml 2026-04-06 11:22:38,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:22:39,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:22:39,086 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d392d72214054febe39c91/lava_callback.json.gz DEBUG: Setup failed for 69d392d72214054febe39c91. Transitting job node result: incomplete -> fail 2026-04-06 11:22:39,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:22:39,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d392d72214054febe39c91 HTTP/1.1" 200 None 2026-04-06 11:22:39,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:22:39,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c2e2214054febe37d71 HTTP/1.1" 200 None 2026-04-06 11:22:39,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:22:39,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d392d72214054febe39c91 HTTP/1.1" 200 None 2026-04-06 11:22:39,316 - lava_callback - INFO - Completed processing callback for node 69d392d72214054febe39c91 2026-04-06 11:22:43,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:22:43,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53268 - "GET /node/693fd2c9575bc060ce14bea5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:53278 - "GET /node/693b0e32fee8383e92b72530%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37812 - "GET /node/69876b99e31b58f834f19838%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35854 - "GET /node/69b3ccc91727ff69d6f22235%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55822 - "GET /node/69863cd2177ca0f097bd2e06%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:55834 - "GET /node/698af4923b3beb19e7616a51%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:55836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58538 - "GET /node/6952375d5318368af0c49abf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:58552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48986 - "GET /node/698937b785773790cd34ce48%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:48988 - "GET /node/699e9e38d2d5ed2e75fdd36d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46016 - "GET / HTTP/1.0" 200 OK 2026-04-06 11:53:27,053 - lava_callback - INFO - Received callback for node 69d370032214054febe37f94 INFO: 172.19.0.1:46028 - "POST /node/69d370032214054febe37f94 HTTP/1.0" 202 Accepted 2026-04-06 11:53:27,059 - lava_callback - INFO - Starting async job submit for node 69d370032214054febe37f94 2026-04-06 11:53:27,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:53:27,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d370032214054febe37f94 HTTP/1.1" 200 None 2026-04-06 11:53:27,091 - lava_callback - DEBUG - Processing node 69d370032214054febe37f94: baseline-x86 2026-04-06 11:53:27,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:53:27,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:53:27,723 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d370032214054febe37f94/log.txt.gz 2026-04-06 11:53:27,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:53:28,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:53:28,106 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d370032214054febe37f94/lava-logs.yaml 2026-04-06 11:53:28,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-06 11:53:28,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-06 11:53:28,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d370032214054febe37f94/lava_callback.json.gz 2026-04-06 11:53:28,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:53:28,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d370032214054febe37f94 HTTP/1.1" 200 None 2026-04-06 11:53:28,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:53:28,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d36c3f2214054febe37d8c HTTP/1.1" 200 None 2026-04-06 11:53:28,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:53:28,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d370032214054febe37f94 HTTP/1.1" 200 None 2026-04-06 11:53:28,336 - lava_callback - INFO - Completed processing callback for node 69d370032214054febe37f94 INFO: 172.19.0.1:50642 - "GET / HTTP/1.0" 200 OK 2026-04-06 11:53:43,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 11:53:43,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57250 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:45:48,212 - lava_callback - INFO - Received callback for node 69d107f7691bac272b324dd7 INFO: 172.19.0.1:57256 - "POST /node/69d107f7691bac272b324dd7 HTTP/1.0" 202 Accepted 2026-04-06 12:45:48,217 - lava_callback - INFO - Starting async job submit for node 69d107f7691bac272b324dd7 2026-04-06 12:45:48,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:45:48,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d107f7691bac272b324dd7 HTTP/1.1" 200 None 2026-04-06 12:45:48,232 - lava_callback - DEBUG - Processing node 69d107f7691bac272b324dd7: baseline-arm-baylibre 2026-04-06 12:45:48,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d107f7691bac272b324dd7 2026-04-06 12:45:48,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:45:48,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d107f7691bac272b324dd7 HTTP/1.1" 200 None 2026-04-06 12:45:48,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:45:48,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:45:48,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:45:48,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d107f7691bac272b324dd7 HTTP/1.1" 200 None 2026-04-06 12:45:48,295 - lava_callback - ERROR - Error processing callback for node 69d107f7691bac272b324dd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32876 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:46:48,124 - lava_callback - INFO - Received callback for node 69d10830691bac272b324e29 INFO: 172.19.0.1:32884 - "POST /node/69d10830691bac272b324e29 HTTP/1.0" 202 Accepted 2026-04-06 12:46:48,130 - lava_callback - INFO - Starting async job submit for node 69d10830691bac272b324e29 2026-04-06 12:46:48,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:46:48,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10830691bac272b324e29 HTTP/1.1" 200 None 2026-04-06 12:46:48,145 - lava_callback - DEBUG - Processing node 69d10830691bac272b324e29: baseline-arm-baylibre 2026-04-06 12:46:48,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10830691bac272b324e29 2026-04-06 12:46:48,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:46:48,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10830691bac272b324e29 HTTP/1.1" 200 None 2026-04-06 12:46:48,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:46:48,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:46:48,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:46:48,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10830691bac272b324e29 HTTP/1.1" 200 None 2026-04-06 12:46:48,200 - lava_callback - ERROR - Error processing callback for node 69d10830691bac272b324e29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52188 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:47:28,229 - lava_callback - INFO - Received callback for node 69d10854691bac272b324e35 INFO: 172.19.0.1:52196 - "POST /node/69d10854691bac272b324e35 HTTP/1.0" 202 Accepted 2026-04-06 12:47:28,235 - lava_callback - INFO - Starting async job submit for node 69d10854691bac272b324e35 2026-04-06 12:47:28,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:47:28,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10854691bac272b324e35 HTTP/1.1" 200 None 2026-04-06 12:47:28,251 - lava_callback - DEBUG - Processing node 69d10854691bac272b324e35: baseline-arm-baylibre 2026-04-06 12:47:28,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10854691bac272b324e35 2026-04-06 12:47:28,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:47:28,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10854691bac272b324e35 HTTP/1.1" 200 None 2026-04-06 12:47:28,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:47:28,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:47:28,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:47:28,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10854691bac272b324e35 HTTP/1.1" 200 None 2026-04-06 12:47:28,307 - lava_callback - ERROR - Error processing callback for node 69d10854691bac272b324e35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37750 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:48:08,220 - lava_callback - INFO - Received callback for node 69d10877691bac272b324e4c INFO: 172.19.0.1:37764 - "POST /node/69d10877691bac272b324e4c HTTP/1.0" 202 Accepted 2026-04-06 12:48:08,225 - lava_callback - INFO - Starting async job submit for node 69d10877691bac272b324e4c 2026-04-06 12:48:08,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:48:08,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10877691bac272b324e4c HTTP/1.1" 200 None 2026-04-06 12:48:08,241 - lava_callback - DEBUG - Processing node 69d10877691bac272b324e4c: baseline-arm-baylibre 2026-04-06 12:48:08,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10877691bac272b324e4c 2026-04-06 12:48:08,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:48:08,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10877691bac272b324e4c HTTP/1.1" 200 None 2026-04-06 12:48:08,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:48:08,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:48:08,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:48:08,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10877691bac272b324e4c HTTP/1.1" 200 None 2026-04-06 12:48:08,324 - lava_callback - ERROR - Error processing callback for node 69d10877691bac272b324e4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60036 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:48:28,225 - lava_callback - INFO - Received callback for node 69d10896691bac272b324e62 INFO: 172.19.0.1:60038 - "POST /node/69d10896691bac272b324e62 HTTP/1.0" 202 Accepted 2026-04-06 12:48:28,231 - lava_callback - INFO - Starting async job submit for node 69d10896691bac272b324e62 2026-04-06 12:48:28,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:48:28,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10896691bac272b324e62 HTTP/1.1" 200 None 2026-04-06 12:48:28,247 - lava_callback - DEBUG - Processing node 69d10896691bac272b324e62: baseline-arm-baylibre 2026-04-06 12:48:28,247 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10896691bac272b324e62 2026-04-06 12:48:28,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:48:28,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10896691bac272b324e62 HTTP/1.1" 200 None 2026-04-06 12:48:28,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:48:28,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:48:28,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:48:28,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10896691bac272b324e62 HTTP/1.1" 200 None 2026-04-06 12:48:28,301 - lava_callback - ERROR - Error processing callback for node 69d10896691bac272b324e62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52236 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:49:08,297 - lava_callback - INFO - Received callback for node 69d108b3691bac272b324e9e INFO: 172.19.0.1:52242 - "POST /node/69d108b3691bac272b324e9e HTTP/1.0" 202 Accepted 2026-04-06 12:49:08,303 - lava_callback - INFO - Starting async job submit for node 69d108b3691bac272b324e9e 2026-04-06 12:49:08,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:49:08,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d108b3691bac272b324e9e HTTP/1.1" 200 None 2026-04-06 12:49:08,321 - lava_callback - DEBUG - Processing node 69d108b3691bac272b324e9e: baseline-arm-baylibre 2026-04-06 12:49:08,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d108b3691bac272b324e9e 2026-04-06 12:49:08,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:49:08,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d108b3691bac272b324e9e HTTP/1.1" 200 None 2026-04-06 12:49:08,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:49:08,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 12:49:08,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:49:08,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d108b3691bac272b324e9e HTTP/1.1" 200 None 2026-04-06 12:49:08,384 - lava_callback - ERROR - Error processing callback for node 69d108b3691bac272b324e9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51578 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:49:48,316 - lava_callback - INFO - Received callback for node 69d108d7691bac272b324ecd INFO: 172.19.0.1:51588 - "POST /node/69d108d7691bac272b324ecd HTTP/1.0" 202 Accepted 2026-04-06 12:49:48,321 - lava_callback - INFO - Starting async job submit for node 69d108d7691bac272b324ecd 2026-04-06 12:49:48,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:49:48,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d108d7691bac272b324ecd HTTP/1.1" 200 None 2026-04-06 12:49:48,337 - lava_callback - DEBUG - Processing node 69d108d7691bac272b324ecd: baseline-arm-baylibre 2026-04-06 12:49:48,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d108d7691bac272b324ecd 2026-04-06 12:49:48,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:49:48,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d108d7691bac272b324ecd HTTP/1.1" 200 None 2026-04-06 12:49:48,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:49:48,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:49:48,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:49:48,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d108d7691bac272b324ecd HTTP/1.1" 200 None 2026-04-06 12:49:48,394 - lava_callback - ERROR - Error processing callback for node 69d108d7691bac272b324ecd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44122 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:50:08,291 - lava_callback - INFO - Received callback for node 69d108f7691bac272b324ee3 INFO: 172.19.0.1:44138 - "POST /node/69d108f7691bac272b324ee3 HTTP/1.0" 202 Accepted 2026-04-06 12:50:08,296 - lava_callback - INFO - Starting async job submit for node 69d108f7691bac272b324ee3 2026-04-06 12:50:08,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:50:08,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d108f7691bac272b324ee3 HTTP/1.1" 200 None 2026-04-06 12:50:08,317 - lava_callback - DEBUG - Processing node 69d108f7691bac272b324ee3: baseline-arm-baylibre 2026-04-06 12:50:08,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d108f7691bac272b324ee3 2026-04-06 12:50:08,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:50:08,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d108f7691bac272b324ee3 HTTP/1.1" 200 None 2026-04-06 12:50:08,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:50:08,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 12:50:08,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:50:08,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d108f7691bac272b324ee3 HTTP/1.1" 200 None 2026-04-06 12:50:08,418 - lava_callback - ERROR - Error processing callback for node 69d108f7691bac272b324ee3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34652 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:50:48,396 - lava_callback - INFO - Received callback for node 69d1091b691bac272b324ef5 INFO: 172.19.0.1:34662 - "POST /node/69d1091b691bac272b324ef5 HTTP/1.0" 202 Accepted 2026-04-06 12:50:48,402 - lava_callback - INFO - Starting async job submit for node 69d1091b691bac272b324ef5 2026-04-06 12:50:48,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:50:48,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1091b691bac272b324ef5 HTTP/1.1" 200 None 2026-04-06 12:50:48,428 - lava_callback - DEBUG - Processing node 69d1091b691bac272b324ef5: baseline-arm-baylibre 2026-04-06 12:50:48,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1091b691bac272b324ef5 2026-04-06 12:50:48,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:50:48,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1091b691bac272b324ef5 HTTP/1.1" 200 None 2026-04-06 12:50:48,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:50:48,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 12:50:48,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:50:48,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1091b691bac272b324ef5 HTTP/1.1" 200 None 2026-04-06 12:50:48,485 - lava_callback - ERROR - Error processing callback for node 69d1091b691bac272b324ef5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48880 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:52:28,482 - lava_callback - INFO - Received callback for node 69d1097b691bac272b324f6d INFO: 172.19.0.1:48886 - "POST /node/69d1097b691bac272b324f6d HTTP/1.0" 202 Accepted 2026-04-06 12:52:28,488 - lava_callback - INFO - Starting async job submit for node 69d1097b691bac272b324f6d 2026-04-06 12:52:28,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:52:28,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1097b691bac272b324f6d HTTP/1.1" 200 None 2026-04-06 12:52:28,506 - lava_callback - DEBUG - Processing node 69d1097b691bac272b324f6d: baseline-arm-baylibre 2026-04-06 12:52:28,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1097b691bac272b324f6d 2026-04-06 12:52:28,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:52:28,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1097b691bac272b324f6d HTTP/1.1" 200 None 2026-04-06 12:52:28,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:52:28,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 12:52:28,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:52:28,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1097b691bac272b324f6d HTTP/1.1" 200 None 2026-04-06 12:52:28,586 - lava_callback - ERROR - Error processing callback for node 69d1097b691bac272b324f6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43382 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:52:54,086 - lava_callback - INFO - Received callback for node 69d109a1691bac272b324f82 INFO: 172.19.0.1:39292 - "POST /node/69d109a1691bac272b324f82 HTTP/1.0" 202 Accepted 2026-04-06 12:52:54,092 - lava_callback - INFO - Starting async job submit for node 69d109a1691bac272b324f82 2026-04-06 12:52:54,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:52:54,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d109a1691bac272b324f82 HTTP/1.1" 200 None 2026-04-06 12:52:54,114 - lava_callback - DEBUG - Processing node 69d109a1691bac272b324f82: baseline-arm-clabbe 2026-04-06 12:52:54,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d109a1691bac272b324f82 2026-04-06 12:52:54,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:52:54,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d109a1691bac272b324f82 HTTP/1.1" 200 None 2026-04-06 12:52:54,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:52:54,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:52:54,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:52:54,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d109a1691bac272b324f82 HTTP/1.1" 200 None 2026-04-06 12:52:54,165 - lava_callback - ERROR - Error processing callback for node 69d109a1691bac272b324f82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52252 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:53:34,031 - lava_callback - INFO - Received callback for node 69d109c2691bac272b324f95 INFO: 172.19.0.1:53068 - "POST /node/69d109c2691bac272b324f95 HTTP/1.0" 202 Accepted 2026-04-06 12:53:34,036 - lava_callback - INFO - Starting async job submit for node 69d109c2691bac272b324f95 2026-04-06 12:53:34,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:53:34,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d109c2691bac272b324f95 HTTP/1.1" 200 None 2026-04-06 12:53:34,052 - lava_callback - DEBUG - Processing node 69d109c2691bac272b324f95: baseline-arm-clabbe 2026-04-06 12:53:34,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d109c2691bac272b324f95 2026-04-06 12:53:34,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:53:34,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d109c2691bac272b324f95 HTTP/1.1" 200 None 2026-04-06 12:53:34,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:53:34,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:53:34,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:53:34,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d109c2691bac272b324f95 HTTP/1.1" 200 None 2026-04-06 12:53:34,104 - lava_callback - ERROR - Error processing callback for node 69d109c2691bac272b324f95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42408 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:54:08,538 - lava_callback - INFO - Received callback for node 69d109e3691bac272b324fcf INFO: 172.19.0.1:42424 - "POST /node/69d109e3691bac272b324fcf HTTP/1.0" 202 Accepted 2026-04-06 12:54:08,544 - lava_callback - INFO - Starting async job submit for node 69d109e3691bac272b324fcf 2026-04-06 12:54:08,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:54:08,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d109e3691bac272b324fcf HTTP/1.1" 200 None 2026-04-06 12:54:08,565 - lava_callback - DEBUG - Processing node 69d109e3691bac272b324fcf: baseline-arm-baylibre 2026-04-06 12:54:08,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d109e3691bac272b324fcf 2026-04-06 12:54:08,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:54:08,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d109e3691bac272b324fcf HTTP/1.1" 200 None 2026-04-06 12:54:08,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:54:08,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 12:54:08,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:54:08,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d109e3691bac272b324fcf HTTP/1.1" 200 None 2026-04-06 12:54:08,621 - lava_callback - ERROR - Error processing callback for node 69d109e3691bac272b324fcf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47844 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:54:28,529 - lava_callback - INFO - Received callback for node 69d10a01691bac272b324ffd INFO: 172.19.0.1:47848 - "POST /node/69d10a01691bac272b324ffd HTTP/1.0" 202 Accepted 2026-04-06 12:54:28,539 - lava_callback - INFO - Starting async job submit for node 69d10a01691bac272b324ffd 2026-04-06 12:54:28,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:54:28,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10a01691bac272b324ffd HTTP/1.1" 200 None 2026-04-06 12:54:28,556 - lava_callback - DEBUG - Processing node 69d10a01691bac272b324ffd: baseline-arm-baylibre 2026-04-06 12:54:28,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10a01691bac272b324ffd 2026-04-06 12:54:28,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:54:28,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10a01691bac272b324ffd HTTP/1.1" 200 None 2026-04-06 12:54:28,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:54:28,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 12:54:28,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:54:28,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10a01691bac272b324ffd HTTP/1.1" 200 None 2026-04-06 12:54:28,628 - lava_callback - ERROR - Error processing callback for node 69d10a01691bac272b324ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55234 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:55:14,234 - lava_callback - INFO - Received callback for node 69d10a1e691bac272b32503a INFO: 172.19.0.1:57842 - "POST /node/69d10a1e691bac272b32503a HTTP/1.0" 202 Accepted 2026-04-06 12:55:14,239 - lava_callback - INFO - Starting async job submit for node 69d10a1e691bac272b32503a 2026-04-06 12:55:14,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:55:14,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10a1e691bac272b32503a HTTP/1.1" 200 None 2026-04-06 12:55:14,256 - lava_callback - DEBUG - Processing node 69d10a1e691bac272b32503a: baseline-arm-clabbe 2026-04-06 12:55:14,256 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10a1e691bac272b32503a 2026-04-06 12:55:14,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:55:14,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10a1e691bac272b32503a HTTP/1.1" 200 None 2026-04-06 12:55:14,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:55:14,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:55:14,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:55:14,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10a1e691bac272b32503a HTTP/1.1" 200 None 2026-04-06 12:55:14,319 - lava_callback - ERROR - Error processing callback for node 69d10a1e691bac272b32503a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57634 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:55:34,180 - lava_callback - INFO - Received callback for node 69d10a3d691bac272b32506a INFO: 172.19.0.1:57776 - "POST /node/69d10a3d691bac272b32506a HTTP/1.0" 202 Accepted 2026-04-06 12:55:34,186 - lava_callback - INFO - Starting async job submit for node 69d10a3d691bac272b32506a 2026-04-06 12:55:34,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:55:34,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10a3d691bac272b32506a HTTP/1.1" 200 None 2026-04-06 12:55:34,203 - lava_callback - DEBUG - Processing node 69d10a3d691bac272b32506a: baseline-arm-clabbe 2026-04-06 12:55:34,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10a3d691bac272b32506a 2026-04-06 12:55:34,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:55:34,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10a3d691bac272b32506a HTTP/1.1" 200 None 2026-04-06 12:55:34,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:55:34,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:55:34,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:55:34,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10a3d691bac272b32506a HTTP/1.1" 200 None 2026-04-06 12:55:34,273 - lava_callback - ERROR - Error processing callback for node 69d10a3d691bac272b32506a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58322 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:56:14,289 - lava_callback - INFO - Received callback for node 69d10a62691bac272b325076 INFO: 172.19.0.1:40302 - "POST /node/69d10a62691bac272b325076 HTTP/1.0" 202 Accepted 2026-04-06 12:56:14,294 - lava_callback - INFO - Starting async job submit for node 69d10a62691bac272b325076 2026-04-06 12:56:14,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:56:14,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10a62691bac272b325076 HTTP/1.1" 200 None 2026-04-06 12:56:14,321 - lava_callback - DEBUG - Processing node 69d10a62691bac272b325076: baseline-arm-clabbe 2026-04-06 12:56:14,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10a62691bac272b325076 2026-04-06 12:56:14,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:56:14,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10a62691bac272b325076 HTTP/1.1" 200 None 2026-04-06 12:56:14,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:56:14,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:56:14,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:56:14,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10a62691bac272b325076 HTTP/1.1" 200 None 2026-04-06 12:56:14,380 - lava_callback - ERROR - Error processing callback for node 69d10a62691bac272b325076: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58536 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:56:54,227 - lava_callback - INFO - Received callback for node 69d10a87691bac272b325088 INFO: 172.19.0.1:35480 - "POST /node/69d10a87691bac272b325088 HTTP/1.0" 202 Accepted 2026-04-06 12:56:54,232 - lava_callback - INFO - Starting async job submit for node 69d10a87691bac272b325088 2026-04-06 12:56:54,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:56:54,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10a87691bac272b325088 HTTP/1.1" 200 None 2026-04-06 12:56:54,249 - lava_callback - DEBUG - Processing node 69d10a87691bac272b325088: baseline-arm-clabbe 2026-04-06 12:56:54,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10a87691bac272b325088 2026-04-06 12:56:54,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:56:54,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10a87691bac272b325088 HTTP/1.1" 200 None 2026-04-06 12:56:54,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:56:54,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:56:54,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:56:54,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10a87691bac272b325088 HTTP/1.1" 200 None 2026-04-06 12:56:54,308 - lava_callback - ERROR - Error processing callback for node 69d10a87691bac272b325088: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35548 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:57:34,293 - lava_callback - INFO - Received callback for node 69d10aaa691bac272b3250a3 INFO: 172.19.0.1:60740 - "POST /node/69d10aaa691bac272b3250a3 HTTP/1.0" 202 Accepted 2026-04-06 12:57:34,302 - lava_callback - INFO - Starting async job submit for node 69d10aaa691bac272b3250a3 2026-04-06 12:57:34,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:57:34,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10aaa691bac272b3250a3 HTTP/1.1" 200 None 2026-04-06 12:57:34,320 - lava_callback - DEBUG - Processing node 69d10aaa691bac272b3250a3: baseline-arm-clabbe 2026-04-06 12:57:34,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10aaa691bac272b3250a3 2026-04-06 12:57:34,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:57:34,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10aaa691bac272b3250a3 HTTP/1.1" 200 None 2026-04-06 12:57:34,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:57:34,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 12:57:34,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:57:34,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10aaa691bac272b3250a3 HTTP/1.1" 200 None 2026-04-06 12:57:34,380 - lava_callback - ERROR - Error processing callback for node 69d10aaa691bac272b3250a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49216 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:57:54,276 - lava_callback - INFO - Received callback for node 69d10ace691bac272b3250be INFO: 172.19.0.1:40376 - "POST /node/69d10ace691bac272b3250be HTTP/1.0" 202 Accepted 2026-04-06 12:57:54,282 - lava_callback - INFO - Starting async job submit for node 69d10ace691bac272b3250be 2026-04-06 12:57:54,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:57:54,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10ace691bac272b3250be HTTP/1.1" 200 None 2026-04-06 12:57:54,307 - lava_callback - DEBUG - Processing node 69d10ace691bac272b3250be: baseline-arm-clabbe 2026-04-06 12:57:54,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10ace691bac272b3250be 2026-04-06 12:57:54,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:57:54,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10ace691bac272b3250be HTTP/1.1" 200 None 2026-04-06 12:57:54,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:57:54,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058cbd2be3e1cf2a5a7ef HTTP/1.1" 200 None 2026-04-06 12:57:54,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:57:54,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10ace691bac272b3250be HTTP/1.1" 200 None 2026-04-06 12:57:54,362 - lava_callback - ERROR - Error processing callback for node 69d10ace691bac272b3250be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54524 - "GET / HTTP/1.0" 200 OK 2026-04-06 12:59:14,376 - lava_callback - INFO - Received callback for node 69d10b0f691bac272b325100 INFO: 172.19.0.1:54112 - "POST /node/69d10b0f691bac272b325100 HTTP/1.0" 202 Accepted 2026-04-06 12:59:14,382 - lava_callback - INFO - Starting async job submit for node 69d10b0f691bac272b325100 2026-04-06 12:59:14,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:59:14,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10b0f691bac272b325100 HTTP/1.1" 200 None 2026-04-06 12:59:14,397 - lava_callback - DEBUG - Processing node 69d10b0f691bac272b325100: baseline-arm-clabbe 2026-04-06 12:59:14,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10b0f691bac272b325100 2026-04-06 12:59:14,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:59:14,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10b0f691bac272b325100 HTTP/1.1" 200 None 2026-04-06 12:59:14,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:59:14,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 12:59:14,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 12:59:14,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10b0f691bac272b325100 HTTP/1.1" 200 None 2026-04-06 12:59:14,462 - lava_callback - ERROR - Error processing callback for node 69d10b0f691bac272b325100: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51112 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:00:34,431 - lava_callback - INFO - Received callback for node 69d10b70691bac272b325161 INFO: 172.19.0.1:43934 - "POST /node/69d10b70691bac272b325161 HTTP/1.0" 202 Accepted 2026-04-06 13:00:34,436 - lava_callback - INFO - Starting async job submit for node 69d10b70691bac272b325161 2026-04-06 13:00:34,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:00:34,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10b70691bac272b325161 HTTP/1.1" 200 None 2026-04-06 13:00:34,454 - lava_callback - DEBUG - Processing node 69d10b70691bac272b325161: baseline-arm-clabbe 2026-04-06 13:00:34,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10b70691bac272b325161 2026-04-06 13:00:34,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:00:34,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10b70691bac272b325161 HTTP/1.1" 200 None 2026-04-06 13:00:34,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:00:34,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:00:34,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:00:34,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10b70691bac272b325161 HTTP/1.1" 200 None 2026-04-06 13:00:34,515 - lava_callback - ERROR - Error processing callback for node 69d10b70691bac272b325161: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33610 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:01:14,438 - lava_callback - INFO - Received callback for node 69d10b93691bac272b32516e INFO: 172.19.0.1:55972 - "POST /node/69d10b93691bac272b32516e HTTP/1.0" 202 Accepted 2026-04-06 13:01:14,443 - lava_callback - INFO - Starting async job submit for node 69d10b93691bac272b32516e 2026-04-06 13:01:14,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:01:14,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10b93691bac272b32516e HTTP/1.1" 200 None 2026-04-06 13:01:14,459 - lava_callback - DEBUG - Processing node 69d10b93691bac272b32516e: baseline-arm-clabbe 2026-04-06 13:01:14,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10b93691bac272b32516e 2026-04-06 13:01:14,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:01:14,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10b93691bac272b32516e HTTP/1.1" 200 None 2026-04-06 13:01:14,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:01:14,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:01:14,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:01:14,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10b93691bac272b32516e HTTP/1.1" 200 None 2026-04-06 13:01:14,519 - lava_callback - ERROR - Error processing callback for node 69d10b93691bac272b32516e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45684 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:01:49,139 - lava_callback - INFO - Received callback for node 69d10bb4691bac272b325188 INFO: 172.19.0.1:45692 - "POST /node/69d10bb4691bac272b325188 HTTP/1.0" 202 Accepted 2026-04-06 13:01:49,145 - lava_callback - INFO - Starting async job submit for node 69d10bb4691bac272b325188 2026-04-06 13:01:49,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:01:49,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10bb4691bac272b325188 HTTP/1.1" 200 None 2026-04-06 13:01:49,161 - lava_callback - DEBUG - Processing node 69d10bb4691bac272b325188: baseline-arm-baylibre 2026-04-06 13:01:49,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10bb4691bac272b325188 2026-04-06 13:01:49,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:01:49,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10bb4691bac272b325188 HTTP/1.1" 200 None 2026-04-06 13:01:49,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:01:49,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:01:49,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:01:49,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10bb4691bac272b325188 HTTP/1.1" 200 None 2026-04-06 13:01:49,223 - lava_callback - ERROR - Error processing callback for node 69d10bb4691bac272b325188: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34542 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:02:34,568 - lava_callback - INFO - Received callback for node 69d10bd9691bac272b32519e INFO: 172.19.0.1:48862 - "POST /node/69d10bd9691bac272b32519e HTTP/1.0" 202 Accepted 2026-04-06 13:02:34,574 - lava_callback - INFO - Starting async job submit for node 69d10bd9691bac272b32519e 2026-04-06 13:02:34,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:02:34,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10bd9691bac272b32519e HTTP/1.1" 200 None 2026-04-06 13:02:34,595 - lava_callback - DEBUG - Processing node 69d10bd9691bac272b32519e: baseline-arm-clabbe 2026-04-06 13:02:34,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10bd9691bac272b32519e 2026-04-06 13:02:34,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:02:34,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10bd9691bac272b32519e HTTP/1.1" 200 None 2026-04-06 13:02:34,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:02:34,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:02:34,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:02:34,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10bd9691bac272b32519e HTTP/1.1" 200 None 2026-04-06 13:02:34,667 - lava_callback - ERROR - Error processing callback for node 69d10bd9691bac272b32519e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55766 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:02:54,527 - lava_callback - INFO - Received callback for node 69d10bf8691bac272b3251bd INFO: 172.19.0.1:42422 - "POST /node/69d10bf8691bac272b3251bd HTTP/1.0" 202 Accepted 2026-04-06 13:02:54,533 - lava_callback - INFO - Starting async job submit for node 69d10bf8691bac272b3251bd 2026-04-06 13:02:54,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:02:54,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10bf8691bac272b3251bd HTTP/1.1" 200 None 2026-04-06 13:02:54,548 - lava_callback - DEBUG - Processing node 69d10bf8691bac272b3251bd: baseline-arm-clabbe 2026-04-06 13:02:54,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10bf8691bac272b3251bd 2026-04-06 13:02:54,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:02:54,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10bf8691bac272b3251bd HTTP/1.1" 200 None 2026-04-06 13:02:54,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:02:54,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:02:54,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:02:54,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10bf8691bac272b3251bd HTTP/1.1" 200 None 2026-04-06 13:02:54,603 - lava_callback - ERROR - Error processing callback for node 69d10bf8691bac272b3251bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48280 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:03:29,051 - lava_callback - INFO - Received callback for node 69d10c1a691bac272b3251ee INFO: 172.19.0.1:48290 - "POST /node/69d10c1a691bac272b3251ee HTTP/1.0" 202 Accepted 2026-04-06 13:03:29,057 - lava_callback - INFO - Starting async job submit for node 69d10c1a691bac272b3251ee 2026-04-06 13:03:29,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:03:29,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10c1a691bac272b3251ee HTTP/1.1" 200 None 2026-04-06 13:03:29,084 - lava_callback - DEBUG - Processing node 69d10c1a691bac272b3251ee: baseline-arm-baylibre 2026-04-06 13:03:29,084 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10c1a691bac272b3251ee 2026-04-06 13:03:29,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:03:29,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10c1a691bac272b3251ee HTTP/1.1" 200 None 2026-04-06 13:03:29,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:03:29,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:03:29,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:03:29,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10c1a691bac272b3251ee HTTP/1.1" 200 None 2026-04-06 13:03:29,154 - lava_callback - ERROR - Error processing callback for node 69d10c1a691bac272b3251ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53050 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:04:09,059 - lava_callback - INFO - Received callback for node 69d10c35691bac272b325230 INFO: 172.19.0.1:53062 - "POST /node/69d10c35691bac272b325230 HTTP/1.0" 202 Accepted 2026-04-06 13:04:09,064 - lava_callback - INFO - Starting async job submit for node 69d10c35691bac272b325230 2026-04-06 13:04:09,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:04:09,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10c35691bac272b325230 HTTP/1.1" 200 None 2026-04-06 13:04:09,082 - lava_callback - DEBUG - Processing node 69d10c35691bac272b325230: baseline-arm-baylibre 2026-04-06 13:04:09,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10c35691bac272b325230 2026-04-06 13:04:09,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:04:09,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10c35691bac272b325230 HTTP/1.1" 200 None 2026-04-06 13:04:09,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:04:09,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:04:09,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:04:09,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10c35691bac272b325230 HTTP/1.1" 200 None 2026-04-06 13:04:09,157 - lava_callback - ERROR - Error processing callback for node 69d10c35691bac272b325230: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51208 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:05:14,688 - lava_callback - INFO - Received callback for node 69d10c7a691bac272b325273 INFO: 172.19.0.1:40764 - "POST /node/69d10c7a691bac272b325273 HTTP/1.0" 202 Accepted 2026-04-06 13:05:14,694 - lava_callback - INFO - Starting async job submit for node 69d10c7a691bac272b325273 2026-04-06 13:05:14,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:05:14,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10c7a691bac272b325273 HTTP/1.1" 200 None 2026-04-06 13:05:14,720 - lava_callback - DEBUG - Processing node 69d10c7a691bac272b325273: baseline-arm-clabbe 2026-04-06 13:05:14,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10c7a691bac272b325273 2026-04-06 13:05:14,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:05:14,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10c7a691bac272b325273 HTTP/1.1" 200 None 2026-04-06 13:05:14,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:05:14,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:05:14,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:05:14,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10c7a691bac272b325273 HTTP/1.1" 200 None 2026-04-06 13:05:14,775 - lava_callback - ERROR - Error processing callback for node 69d10c7a691bac272b325273: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37910 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:05:54,661 - lava_callback - INFO - Received callback for node 69d10c9e691bac272b325280 INFO: 172.19.0.1:49840 - "POST /node/69d10c9e691bac272b325280 HTTP/1.0" 202 Accepted 2026-04-06 13:05:54,666 - lava_callback - INFO - Starting async job submit for node 69d10c9e691bac272b325280 2026-04-06 13:05:54,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:05:54,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10c9e691bac272b325280 HTTP/1.1" 200 None 2026-04-06 13:05:54,693 - lava_callback - DEBUG - Processing node 69d10c9e691bac272b325280: baseline-arm-clabbe 2026-04-06 13:05:54,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10c9e691bac272b325280 2026-04-06 13:05:54,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:05:54,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10c9e691bac272b325280 HTTP/1.1" 200 None 2026-04-06 13:05:54,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:05:54,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:05:54,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:05:54,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10c9e691bac272b325280 HTTP/1.1" 200 None 2026-04-06 13:05:54,751 - lava_callback - ERROR - Error processing callback for node 69d10c9e691bac272b325280: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38596 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:07:34,730 - lava_callback - INFO - Received callback for node 69d10d03691bac272b3252c2 INFO: 172.19.0.1:53040 - "POST /node/69d10d03691bac272b3252c2 HTTP/1.0" 202 Accepted 2026-04-06 13:07:34,736 - lava_callback - INFO - Starting async job submit for node 69d10d03691bac272b3252c2 2026-04-06 13:07:34,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:07:34,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10d03691bac272b3252c2 HTTP/1.1" 200 None 2026-04-06 13:07:34,760 - lava_callback - DEBUG - Processing node 69d10d03691bac272b3252c2: baseline-arm-clabbe 2026-04-06 13:07:34,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10d03691bac272b3252c2 2026-04-06 13:07:34,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:07:34,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10d03691bac272b3252c2 HTTP/1.1" 200 None 2026-04-06 13:07:34,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:07:34,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:07:34,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:07:34,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10d03691bac272b3252c2 HTTP/1.1" 200 None 2026-04-06 13:07:34,846 - lava_callback - ERROR - Error processing callback for node 69d10d03691bac272b3252c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59064 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:08:34,793 - lava_callback - INFO - Received callback for node 69d10d46691bac272b325311 INFO: 172.19.0.1:40294 - "POST /node/69d10d46691bac272b325311 HTTP/1.0" 202 Accepted 2026-04-06 13:08:34,799 - lava_callback - INFO - Starting async job submit for node 69d10d46691bac272b325311 2026-04-06 13:08:34,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:08:34,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10d46691bac272b325311 HTTP/1.1" 200 None 2026-04-06 13:08:34,815 - lava_callback - DEBUG - Processing node 69d10d46691bac272b325311: baseline-arm-clabbe 2026-04-06 13:08:34,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10d46691bac272b325311 2026-04-06 13:08:34,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:08:34,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10d46691bac272b325311 HTTP/1.1" 200 None 2026-04-06 13:08:34,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:08:34,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:08:34,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:08:34,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10d46691bac272b325311 HTTP/1.1" 200 None 2026-04-06 13:08:34,896 - lava_callback - ERROR - Error processing callback for node 69d10d46691bac272b325311: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44450 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:09:14,812 - lava_callback - INFO - Received callback for node 69d10d67691bac272b325325 INFO: 172.19.0.1:36104 - "POST /node/69d10d67691bac272b325325 HTTP/1.0" 202 Accepted 2026-04-06 13:09:14,817 - lava_callback - INFO - Starting async job submit for node 69d10d67691bac272b325325 2026-04-06 13:09:14,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:09:14,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10d67691bac272b325325 HTTP/1.1" 200 None 2026-04-06 13:09:14,834 - lava_callback - DEBUG - Processing node 69d10d67691bac272b325325: baseline-arm-clabbe 2026-04-06 13:09:14,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10d67691bac272b325325 2026-04-06 13:09:14,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:09:14,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10d67691bac272b325325 HTTP/1.1" 200 None 2026-04-06 13:09:14,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:09:14,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:09:14,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:09:14,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10d67691bac272b325325 HTTP/1.1" 200 None 2026-04-06 13:09:14,913 - lava_callback - ERROR - Error processing callback for node 69d10d67691bac272b325325: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53154 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:10:34,896 - lava_callback - INFO - Received callback for node 69d10dc7691bac272b32539b INFO: 172.19.0.1:38326 - "POST /node/69d10dc7691bac272b32539b HTTP/1.0" 202 Accepted 2026-04-06 13:10:34,901 - lava_callback - INFO - Starting async job submit for node 69d10dc7691bac272b32539b 2026-04-06 13:10:34,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:10:34,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10dc7691bac272b32539b HTTP/1.1" 200 None 2026-04-06 13:10:34,918 - lava_callback - DEBUG - Processing node 69d10dc7691bac272b32539b: baseline-arm-clabbe 2026-04-06 13:10:34,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10dc7691bac272b32539b 2026-04-06 13:10:34,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:10:34,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10dc7691bac272b32539b HTTP/1.1" 200 None 2026-04-06 13:10:34,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:10:34,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:10:34,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:10:34,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10dc7691bac272b32539b HTTP/1.1" 200 None 2026-04-06 13:10:34,988 - lava_callback - ERROR - Error processing callback for node 69d10dc7691bac272b32539b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44134 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:11:14,883 - lava_callback - INFO - Received callback for node 69d10de6691bac272b3253c5 INFO: 172.19.0.1:42054 - "POST /node/69d10de6691bac272b3253c5 HTTP/1.0" 202 Accepted 2026-04-06 13:11:14,893 - lava_callback - INFO - Starting async job submit for node 69d10de6691bac272b3253c5 2026-04-06 13:11:14,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:11:14,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10de6691bac272b3253c5 HTTP/1.1" 200 None 2026-04-06 13:11:14,960 - lava_callback - DEBUG - Processing node 69d10de6691bac272b3253c5: baseline-arm-clabbe 2026-04-06 13:11:14,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10de6691bac272b3253c5 2026-04-06 13:11:14,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:11:15,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10de6691bac272b3253c5 HTTP/1.1" 200 None 2026-04-06 13:11:15,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:11:15,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:11:15,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:11:15,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10de6691bac272b3253c5 HTTP/1.1" 200 None 2026-04-06 13:11:15,121 - lava_callback - ERROR - Error processing callback for node 69d10de6691bac272b3253c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60504 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:16:15,101 - lava_callback - INFO - Received callback for node 69d10f12691bac272b3254b9 INFO: 172.19.0.1:53644 - "POST /node/69d10f12691bac272b3254b9 HTTP/1.0" 202 Accepted 2026-04-06 13:16:15,109 - lava_callback - INFO - Starting async job submit for node 69d10f12691bac272b3254b9 2026-04-06 13:16:15,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:16:15,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10f12691bac272b3254b9 HTTP/1.1" 200 None 2026-04-06 13:16:15,132 - lava_callback - DEBUG - Processing node 69d10f12691bac272b3254b9: baseline-arm-clabbe 2026-04-06 13:16:15,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10f12691bac272b3254b9 2026-04-06 13:16:15,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:16:15,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10f12691bac272b3254b9 HTTP/1.1" 200 None 2026-04-06 13:16:15,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:16:15,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:16:15,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:53646 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 13:16:15,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10f12691bac272b3254b9 HTTP/1.1" 200 None 2026-04-06 13:16:15,182 - lava_callback - ERROR - Error processing callback for node 69d10f12691bac272b3254b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35606 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:16:49,797 - lava_callback - INFO - Received callback for node 69d10f35691bac272b3254ed INFO: 172.19.0.1:50574 - "POST /node/69d10f35691bac272b3254ed HTTP/1.0" 202 Accepted 2026-04-06 13:16:49,802 - lava_callback - INFO - Starting async job submit for node 69d10f35691bac272b3254ed 2026-04-06 13:16:49,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:16:49,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10f35691bac272b3254ed HTTP/1.1" 200 None 2026-04-06 13:16:49,819 - lava_callback - DEBUG - Processing node 69d10f35691bac272b3254ed: baseline-arm64-baylibre 2026-04-06 13:16:49,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10f35691bac272b3254ed 2026-04-06 13:16:49,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:16:49,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10f35691bac272b3254ed HTTP/1.1" 200 None 2026-04-06 13:16:49,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:16:49,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 13:16:49,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:16:49,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10f35691bac272b3254ed HTTP/1.1" 200 None 2026-04-06 13:16:49,871 - lava_callback - ERROR - Error processing callback for node 69d10f35691bac272b3254ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36312 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:18:10,040 - lava_callback - INFO - Received callback for node 69d10f7d691bac272b325510 INFO: 172.19.0.1:56130 - "POST /node/69d10f7d691bac272b325510 HTTP/1.0" 202 Accepted 2026-04-06 13:18:10,046 - lava_callback - INFO - Starting async job submit for node 69d10f7d691bac272b325510 2026-04-06 13:18:10,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:18:10,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10f7d691bac272b325510 HTTP/1.1" 200 None 2026-04-06 13:18:10,062 - lava_callback - DEBUG - Processing node 69d10f7d691bac272b325510: baseline-arm64-baylibre 2026-04-06 13:18:10,063 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10f7d691bac272b325510 2026-04-06 13:18:10,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:18:10,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10f7d691bac272b325510 HTTP/1.1" 200 None 2026-04-06 13:18:10,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:18:10,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 13:18:10,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:18:10,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10f7d691bac272b325510 HTTP/1.1" 200 None 2026-04-06 13:18:10,118 - lava_callback - ERROR - Error processing callback for node 69d10f7d691bac272b325510: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49714 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:19:09,895 - lava_callback - INFO - Received callback for node 69d10fc2691bac272b32553e INFO: 172.19.0.1:40400 - "POST /node/69d10fc2691bac272b32553e HTTP/1.0" 202 Accepted 2026-04-06 13:19:09,901 - lava_callback - INFO - Starting async job submit for node 69d10fc2691bac272b32553e 2026-04-06 13:19:09,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:19:09,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10fc2691bac272b32553e HTTP/1.1" 200 None 2026-04-06 13:19:09,918 - lava_callback - DEBUG - Processing node 69d10fc2691bac272b32553e: baseline-arm64-baylibre 2026-04-06 13:19:09,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d10fc2691bac272b32553e 2026-04-06 13:19:09,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:19:09,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d10fc2691bac272b32553e HTTP/1.1" 200 None 2026-04-06 13:19:09,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:19:09,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 13:19:09,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:19:09,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d10fc2691bac272b32553e HTTP/1.1" 200 None 2026-04-06 13:19:09,999 - lava_callback - ERROR - Error processing callback for node 69d10fc2691bac272b32553e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40310 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:20:09,970 - lava_callback - INFO - Received callback for node 69d11005691bac272b325580 INFO: 172.19.0.1:54486 - "POST /node/69d11005691bac272b325580 HTTP/1.0" 202 Accepted 2026-04-06 13:20:09,976 - lava_callback - INFO - Starting async job submit for node 69d11005691bac272b325580 2026-04-06 13:20:09,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:20:09,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11005691bac272b325580 HTTP/1.1" 200 None 2026-04-06 13:20:09,991 - lava_callback - DEBUG - Processing node 69d11005691bac272b325580: baseline-arm64-baylibre 2026-04-06 13:20:09,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11005691bac272b325580 2026-04-06 13:20:09,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:20:10,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11005691bac272b325580 HTTP/1.1" 200 None 2026-04-06 13:20:10,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:20:10,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 13:20:10,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:20:10,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11005691bac272b325580 HTTP/1.1" 200 None 2026-04-06 13:20:10,050 - lava_callback - ERROR - Error processing callback for node 69d11005691bac272b325580: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59566 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:21:30,176 - lava_callback - INFO - Received callback for node 69d11046691bac272b3255cd INFO: 172.19.0.1:49984 - "POST /node/69d11046691bac272b3255cd HTTP/1.0" 202 Accepted 2026-04-06 13:21:30,182 - lava_callback - INFO - Starting async job submit for node 69d11046691bac272b3255cd 2026-04-06 13:21:30,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:21:30,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11046691bac272b3255cd HTTP/1.1" 200 None 2026-04-06 13:21:30,200 - lava_callback - DEBUG - Processing node 69d11046691bac272b3255cd: baseline-arm64-baylibre 2026-04-06 13:21:30,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11046691bac272b3255cd 2026-04-06 13:21:30,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:21:30,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11046691bac272b3255cd HTTP/1.1" 200 None 2026-04-06 13:21:30,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:21:30,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 13:21:30,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:21:30,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11046691bac272b3255cd HTTP/1.1" 200 None 2026-04-06 13:21:30,261 - lava_callback - ERROR - Error processing callback for node 69d11046691bac272b3255cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38436 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:22:35,421 - lava_callback - INFO - Received callback for node 69d11087691bac272b3255e3 INFO: 172.19.0.1:40390 - "POST /node/69d11087691bac272b3255e3 HTTP/1.0" 202 Accepted 2026-04-06 13:22:35,426 - lava_callback - INFO - Starting async job submit for node 69d11087691bac272b3255e3 2026-04-06 13:22:35,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:22:35,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11087691bac272b3255e3 HTTP/1.1" 200 None 2026-04-06 13:22:35,443 - lava_callback - DEBUG - Processing node 69d11087691bac272b3255e3: baseline-arm-clabbe 2026-04-06 13:22:35,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11087691bac272b3255e3 2026-04-06 13:22:35,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:22:35,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11087691bac272b3255e3 HTTP/1.1" 200 None 2026-04-06 13:22:35,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:22:35,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:22:35,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:22:35,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11087691bac272b3255e3 HTTP/1.1" 200 None 2026-04-06 13:22:35,502 - lava_callback - ERROR - Error processing callback for node 69d11087691bac272b3255e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55478 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 13:23:15,408 - lava_callback - INFO - Received callback for node 69d110b7691bac272b3255fe INFO: 172.19.0.1:55480 - "POST /node/69d110b7691bac272b3255fe HTTP/1.0" 202 Accepted 2026-04-06 13:23:15,414 - lava_callback - INFO - Starting async job submit for node 69d110b7691bac272b3255fe 2026-04-06 13:23:15,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:23:15,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d110b7691bac272b3255fe HTTP/1.1" 200 None 2026-04-06 13:23:15,430 - lava_callback - DEBUG - Processing node 69d110b7691bac272b3255fe: baseline-arm64-clabbe 2026-04-06 13:23:15,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d110b7691bac272b3255fe 2026-04-06 13:23:15,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:23:15,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d110b7691bac272b3255fe HTTP/1.1" 200 None 2026-04-06 13:23:15,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:23:15,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 13:23:15,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:23:15,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d110b7691bac272b3255fe HTTP/1.1" 200 None 2026-04-06 13:23:15,494 - lava_callback - ERROR - Error processing callback for node 69d110b7691bac272b3255fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60044 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:24:35,484 - lava_callback - INFO - Received callback for node 69d110fd691bac272b325633 INFO: 172.19.0.1:48814 - "POST /node/69d110fd691bac272b325633 HTTP/1.0" 202 Accepted 2026-04-06 13:24:35,489 - lava_callback - INFO - Starting async job submit for node 69d110fd691bac272b325633 2026-04-06 13:24:35,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:24:35,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d110fd691bac272b325633 HTTP/1.1" 200 None 2026-04-06 13:24:35,505 - lava_callback - DEBUG - Processing node 69d110fd691bac272b325633: baseline-arm64-clabbe 2026-04-06 13:24:35,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d110fd691bac272b325633 2026-04-06 13:24:35,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:24:35,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d110fd691bac272b325633 HTTP/1.1" 200 None 2026-04-06 13:24:35,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:24:35,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 13:24:35,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:24:35,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d110fd691bac272b325633 HTTP/1.1" 200 None 2026-04-06 13:24:35,567 - lava_callback - ERROR - Error processing callback for node 69d110fd691bac272b325633: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33664 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:25:35,521 - lava_callback - INFO - Received callback for node 69d11143691bac272b325669 INFO: 172.19.0.1:48162 - "POST /node/69d11143691bac272b325669 HTTP/1.0" 202 Accepted 2026-04-06 13:25:35,526 - lava_callback - INFO - Starting async job submit for node 69d11143691bac272b325669 2026-04-06 13:25:35,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:25:35,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11143691bac272b325669 HTTP/1.1" 200 None 2026-04-06 13:25:35,543 - lava_callback - DEBUG - Processing node 69d11143691bac272b325669: baseline-arm64-clabbe 2026-04-06 13:25:35,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11143691bac272b325669 2026-04-06 13:25:35,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:25:35,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11143691bac272b325669 HTTP/1.1" 200 None 2026-04-06 13:25:35,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:25:35,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 13:25:35,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:25:35,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11143691bac272b325669 HTTP/1.1" 200 None 2026-04-06 13:25:35,615 - lava_callback - ERROR - Error processing callback for node 69d11143691bac272b325669: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56510 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:26:35,594 - lava_callback - INFO - Received callback for node 69d11187691bac272b3256b1 INFO: 172.19.0.1:59448 - "POST /node/69d11187691bac272b3256b1 HTTP/1.0" 202 Accepted 2026-04-06 13:26:35,599 - lava_callback - INFO - Starting async job submit for node 69d11187691bac272b3256b1 2026-04-06 13:26:35,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:26:35,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11187691bac272b3256b1 HTTP/1.1" 200 None 2026-04-06 13:26:35,620 - lava_callback - DEBUG - Processing node 69d11187691bac272b3256b1: baseline-arm64-clabbe 2026-04-06 13:26:35,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11187691bac272b3256b1 2026-04-06 13:26:35,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:26:35,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11187691bac272b3256b1 HTTP/1.1" 200 None 2026-04-06 13:26:35,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:26:35,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 13:26:35,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:26:35,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11187691bac272b3256b1 HTTP/1.1" 200 None 2026-04-06 13:26:35,673 - lava_callback - ERROR - Error processing callback for node 69d11187691bac272b3256b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60962 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:27:55,664 - lava_callback - INFO - Received callback for node 69d111d2691bac272b3256c4 INFO: 172.19.0.1:58286 - "POST /node/69d111d2691bac272b3256c4 HTTP/1.0" 202 Accepted 2026-04-06 13:27:55,670 - lava_callback - INFO - Starting async job submit for node 69d111d2691bac272b3256c4 2026-04-06 13:27:55,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:27:55,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d111d2691bac272b3256c4 HTTP/1.1" 200 None 2026-04-06 13:27:55,689 - lava_callback - DEBUG - Processing node 69d111d2691bac272b3256c4: baseline-arm64-clabbe 2026-04-06 13:27:55,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d111d2691bac272b3256c4 2026-04-06 13:27:55,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:27:55,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d111d2691bac272b3256c4 HTTP/1.1" 200 None 2026-04-06 13:27:55,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:27:55,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 13:27:55,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:27:55,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d111d2691bac272b3256c4 HTTP/1.1" 200 None 2026-04-06 13:27:55,754 - lava_callback - ERROR - Error processing callback for node 69d111d2691bac272b3256c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47126 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 13:29:15,717 - lava_callback - INFO - Received callback for node 69d1121b691bac272b3256db INFO: 172.19.0.1:47132 - "POST /node/69d1121b691bac272b3256db HTTP/1.0" 202 Accepted 2026-04-06 13:29:15,723 - lava_callback - INFO - Starting async job submit for node 69d1121b691bac272b3256db 2026-04-06 13:29:15,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:29:15,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1121b691bac272b3256db HTTP/1.1" 200 None 2026-04-06 13:29:15,739 - lava_callback - DEBUG - Processing node 69d1121b691bac272b3256db: baseline-arm64-clabbe 2026-04-06 13:29:15,739 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1121b691bac272b3256db 2026-04-06 13:29:15,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:29:15,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1121b691bac272b3256db HTTP/1.1" 200 None 2026-04-06 13:29:15,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:29:15,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d058d7d2be3e1cf2a5a804 HTTP/1.1" 200 None 2026-04-06 13:29:15,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:29:15,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1121b691bac272b3256db HTTP/1.1" 200 None 2026-04-06 13:29:15,790 - lava_callback - ERROR - Error processing callback for node 69d1121b691bac272b3256db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42714 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 13:30:15,761 - lava_callback - INFO - Received callback for node 69d11258691bac272b3256f0 INFO: 172.19.0.1:42730 - "POST /node/69d11258691bac272b3256f0 HTTP/1.0" 202 Accepted 2026-04-06 13:30:15,768 - lava_callback - INFO - Starting async job submit for node 69d11258691bac272b3256f0 2026-04-06 13:30:15,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:30:15,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11258691bac272b3256f0 HTTP/1.1" 200 None 2026-04-06 13:30:15,789 - lava_callback - DEBUG - Processing node 69d11258691bac272b3256f0: baseline-arm-clabbe 2026-04-06 13:30:15,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11258691bac272b3256f0 2026-04-06 13:30:15,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:30:15,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11258691bac272b3256f0 HTTP/1.1" 200 None 2026-04-06 13:30:15,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:30:15,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:30:15,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:30:15,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11258691bac272b3256f0 HTTP/1.1" 200 None 2026-04-06 13:30:15,841 - lava_callback - ERROR - Error processing callback for node 69d11258691bac272b3256f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36696 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:30:35,705 - lava_callback - INFO - Received callback for node 69d11278691bac272b325714 INFO: 172.19.0.1:33824 - "POST /node/69d11278691bac272b325714 HTTP/1.0" 202 Accepted 2026-04-06 13:30:35,711 - lava_callback - INFO - Starting async job submit for node 69d11278691bac272b325714 2026-04-06 13:30:35,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:30:35,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11278691bac272b325714 HTTP/1.1" 200 None 2026-04-06 13:30:35,736 - lava_callback - DEBUG - Processing node 69d11278691bac272b325714: baseline-arm-clabbe 2026-04-06 13:30:35,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11278691bac272b325714 2026-04-06 13:30:35,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:30:35,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11278691bac272b325714 HTTP/1.1" 200 None 2026-04-06 13:30:35,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:30:35,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:30:35,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:30:35,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11278691bac272b325714 HTTP/1.1" 200 None 2026-04-06 13:30:35,800 - lava_callback - ERROR - Error processing callback for node 69d11278691bac272b325714: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32988 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 13:31:15,778 - lava_callback - INFO - Received callback for node 69d11295691bac272b32574b INFO: 172.19.0.1:33000 - "POST /node/69d11295691bac272b32574b HTTP/1.0" 202 Accepted 2026-04-06 13:31:15,784 - lava_callback - INFO - Starting async job submit for node 69d11295691bac272b32574b 2026-04-06 13:31:15,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:31:15,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11295691bac272b32574b HTTP/1.1" 200 None 2026-04-06 13:31:15,799 - lava_callback - DEBUG - Processing node 69d11295691bac272b32574b: baseline-arm-clabbe 2026-04-06 13:31:15,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11295691bac272b32574b 2026-04-06 13:31:15,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:31:15,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11295691bac272b32574b HTTP/1.1" 200 None 2026-04-06 13:31:15,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:31:15,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5b723eb053795d41eb7 HTTP/1.1" 200 None 2026-04-06 13:31:15,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:31:15,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11295691bac272b32574b HTTP/1.1" 200 None 2026-04-06 13:31:15,872 - lava_callback - ERROR - Error processing callback for node 69d11295691bac272b32574b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42014 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:31:50,916 - lava_callback - INFO - Received callback for node 69d112bd691bac272b32575c INFO: 172.19.0.1:54304 - "POST /node/69d112bd691bac272b32575c HTTP/1.0" 202 Accepted 2026-04-06 13:31:50,922 - lava_callback - INFO - Starting async job submit for node 69d112bd691bac272b32575c 2026-04-06 13:31:50,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:31:50,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d112bd691bac272b32575c HTTP/1.1" 200 None 2026-04-06 13:31:50,938 - lava_callback - DEBUG - Processing node 69d112bd691bac272b32575c: baseline-arm64-baylibre 2026-04-06 13:31:50,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d112bd691bac272b32575c 2026-04-06 13:31:50,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:31:50,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d112bd691bac272b32575c HTTP/1.1" 200 None 2026-04-06 13:31:50,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:31:50,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:31:50,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:31:50,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d112bd691bac272b32575c HTTP/1.1" 200 None 2026-04-06 13:31:50,989 - lava_callback - ERROR - Error processing callback for node 69d112bd691bac272b32575c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52522 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:32:50,559 - lava_callback - INFO - Received callback for node 69d112fd691bac272b325792 INFO: 172.19.0.1:37008 - "POST /node/69d112fd691bac272b325792 HTTP/1.0" 202 Accepted 2026-04-06 13:32:50,564 - lava_callback - INFO - Starting async job submit for node 69d112fd691bac272b325792 2026-04-06 13:32:50,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:32:50,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d112fd691bac272b325792 HTTP/1.1" 200 None 2026-04-06 13:32:50,581 - lava_callback - DEBUG - Processing node 69d112fd691bac272b325792: baseline-arm64-baylibre 2026-04-06 13:32:50,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d112fd691bac272b325792 2026-04-06 13:32:50,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:32:50,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d112fd691bac272b325792 HTTP/1.1" 200 None 2026-04-06 13:32:50,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:32:50,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:32:50,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:32:50,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d112fd691bac272b325792 HTTP/1.1" 200 None 2026-04-06 13:32:50,649 - lava_callback - ERROR - Error processing callback for node 69d112fd691bac272b325792: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56890 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:34:10,706 - lava_callback - INFO - Received callback for node 69d11343691bac272b3257c7 INFO: 172.19.0.1:34170 - "POST /node/69d11343691bac272b3257c7 HTTP/1.0" 202 Accepted 2026-04-06 13:34:10,712 - lava_callback - INFO - Starting async job submit for node 69d11343691bac272b3257c7 2026-04-06 13:34:10,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:34:10,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11343691bac272b3257c7 HTTP/1.1" 200 None 2026-04-06 13:34:10,728 - lava_callback - DEBUG - Processing node 69d11343691bac272b3257c7: baseline-arm64-baylibre 2026-04-06 13:34:10,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11343691bac272b3257c7 2026-04-06 13:34:10,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:34:10,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11343691bac272b3257c7 HTTP/1.1" 200 None 2026-04-06 13:34:10,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:34:10,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:34:10,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:34:10,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11343691bac272b3257c7 HTTP/1.1" 200 None 2026-04-06 13:34:10,789 - lava_callback - ERROR - Error processing callback for node 69d11343691bac272b3257c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42692 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:35:10,658 - lava_callback - INFO - Received callback for node 69d11385691bac272b325814 INFO: 172.19.0.1:60780 - "POST /node/69d11385691bac272b325814 HTTP/1.0" 202 Accepted 2026-04-06 13:35:10,664 - lava_callback - INFO - Starting async job submit for node 69d11385691bac272b325814 2026-04-06 13:35:10,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:35:10,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11385691bac272b325814 HTTP/1.1" 200 None 2026-04-06 13:35:10,682 - lava_callback - DEBUG - Processing node 69d11385691bac272b325814: baseline-arm64-baylibre 2026-04-06 13:35:10,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11385691bac272b325814 2026-04-06 13:35:10,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:35:10,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11385691bac272b325814 HTTP/1.1" 200 None 2026-04-06 13:35:10,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:35:10,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:35:10,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:35:10,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11385691bac272b325814 HTTP/1.1" 200 None 2026-04-06 13:35:10,755 - lava_callback - ERROR - Error processing callback for node 69d11385691bac272b325814: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44316 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:36:10,790 - lava_callback - INFO - Received callback for node 69d113c5691bac272b325868 INFO: 172.19.0.1:53496 - "POST /node/69d113c5691bac272b325868 HTTP/1.0" 202 Accepted 2026-04-06 13:36:10,797 - lava_callback - INFO - Starting async job submit for node 69d113c5691bac272b325868 2026-04-06 13:36:10,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:36:10,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d113c5691bac272b325868 HTTP/1.1" 200 None 2026-04-06 13:36:10,812 - lava_callback - DEBUG - Processing node 69d113c5691bac272b325868: baseline-arm64-baylibre 2026-04-06 13:36:10,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d113c5691bac272b325868 2026-04-06 13:36:10,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:36:10,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d113c5691bac272b325868 HTTP/1.1" 200 None 2026-04-06 13:36:10,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:36:10,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:36:10,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:36:10,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d113c5691bac272b325868 HTTP/1.1" 200 None 2026-04-06 13:36:10,874 - lava_callback - ERROR - Error processing callback for node 69d113c5691bac272b325868: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47266 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:37:36,037 - lava_callback - INFO - Received callback for node 69d11411691bac272b32588e INFO: 172.19.0.1:47312 - "POST /node/69d11411691bac272b32588e HTTP/1.0" 202 Accepted 2026-04-06 13:37:36,042 - lava_callback - INFO - Starting async job submit for node 69d11411691bac272b32588e 2026-04-06 13:37:36,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:37:36,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11411691bac272b32588e HTTP/1.1" 200 None 2026-04-06 13:37:36,064 - lava_callback - DEBUG - Processing node 69d11411691bac272b32588e: baseline-arm64-clabbe 2026-04-06 13:37:36,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11411691bac272b32588e 2026-04-06 13:37:36,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:37:36,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11411691bac272b32588e HTTP/1.1" 200 None 2026-04-06 13:37:36,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:37:36,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:37:36,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:37:36,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11411691bac272b32588e HTTP/1.1" 200 None 2026-04-06 13:37:36,132 - lava_callback - ERROR - Error processing callback for node 69d11411691bac272b32588e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60002 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.19.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47318 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:39:50,998 - lava_callback - INFO - Received callback for node 69d11493691bac272b3258f3 INFO: 172.19.0.1:57684 - "POST /node/69d11493691bac272b3258f3 HTTP/1.0" 202 Accepted 2026-04-06 13:39:51,004 - lava_callback - INFO - Starting async job submit for node 69d11493691bac272b3258f3 2026-04-06 13:39:51,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:39:51,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11493691bac272b3258f3 HTTP/1.1" 200 None 2026-04-06 13:39:51,020 - lava_callback - DEBUG - Processing node 69d11493691bac272b3258f3: baseline-arm64-baylibre 2026-04-06 13:39:51,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11493691bac272b3258f3 2026-04-06 13:39:51,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:39:51,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11493691bac272b3258f3 HTTP/1.1" 200 None 2026-04-06 13:39:51,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:39:51,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:39:51,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:39:51,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11493691bac272b3258f3 HTTP/1.1" 200 None 2026-04-06 13:39:51,077 - lava_callback - ERROR - Error processing callback for node 69d11493691bac272b3258f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42540 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:40:56,192 - lava_callback - INFO - Received callback for node 69d114e1691bac272b32591a INFO: 172.19.0.1:55502 - "POST /node/69d114e1691bac272b32591a HTTP/1.0" 202 Accepted 2026-04-06 13:40:56,198 - lava_callback - INFO - Starting async job submit for node 69d114e1691bac272b32591a 2026-04-06 13:40:56,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:40:56,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d114e1691bac272b32591a HTTP/1.1" 200 None 2026-04-06 13:40:56,214 - lava_callback - DEBUG - Processing node 69d114e1691bac272b32591a: baseline-arm64-clabbe 2026-04-06 13:40:56,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d114e1691bac272b32591a 2026-04-06 13:40:56,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:40:56,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d114e1691bac272b32591a HTTP/1.1" 200 None 2026-04-06 13:40:56,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:40:56,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:40:56,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:40:56,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d114e1691bac272b32591a HTTP/1.1" 200 None 2026-04-06 13:40:56,271 - lava_callback - ERROR - Error processing callback for node 69d114e1691bac272b32591a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34264 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 13:42:16,217 - lava_callback - INFO - Received callback for node 69d11529691bac272b325956 INFO: 172.19.0.1:34270 - "POST /node/69d11529691bac272b325956 HTTP/1.0" 202 Accepted 2026-04-06 13:42:16,223 - lava_callback - INFO - Starting async job submit for node 69d11529691bac272b325956 2026-04-06 13:42:16,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:42:16,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11529691bac272b325956 HTTP/1.1" 200 None 2026-04-06 13:42:16,239 - lava_callback - DEBUG - Processing node 69d11529691bac272b325956: baseline-arm64-clabbe 2026-04-06 13:42:16,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11529691bac272b325956 2026-04-06 13:42:16,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:42:16,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11529691bac272b325956 HTTP/1.1" 200 None 2026-04-06 13:42:16,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:42:16,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:42:16,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:42:16,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11529691bac272b325956 HTTP/1.1" 200 None 2026-04-06 13:42:16,323 - lava_callback - ERROR - Error processing callback for node 69d11529691bac272b325956: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43660 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:43:11,136 - lava_callback - INFO - Received callback for node 69d11568691bac272b325983 INFO: 172.19.0.1:41360 - "POST /node/69d11568691bac272b325983 HTTP/1.0" 202 Accepted 2026-04-06 13:43:11,142 - lava_callback - INFO - Starting async job submit for node 69d11568691bac272b325983 2026-04-06 13:43:11,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:43:11,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11568691bac272b325983 HTTP/1.1" 200 None 2026-04-06 13:43:11,158 - lava_callback - DEBUG - Processing node 69d11568691bac272b325983: baseline-arm64-baylibre 2026-04-06 13:43:11,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11568691bac272b325983 2026-04-06 13:43:11,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:43:11,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11568691bac272b325983 HTTP/1.1" 200 None 2026-04-06 13:43:11,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:43:11,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:43:11,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:43:11,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11568691bac272b325983 HTTP/1.1" 200 None 2026-04-06 13:43:11,213 - lava_callback - ERROR - Error processing callback for node 69d11568691bac272b325983: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55624 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:44:36,293 - lava_callback - INFO - Received callback for node 69d115b3691bac272b3259bb INFO: 172.19.0.1:34764 - "POST /node/69d115b3691bac272b3259bb HTTP/1.0" 202 Accepted 2026-04-06 13:44:36,298 - lava_callback - INFO - Starting async job submit for node 69d115b3691bac272b3259bb 2026-04-06 13:44:36,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:44:36,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d115b3691bac272b3259bb HTTP/1.1" 200 None 2026-04-06 13:44:36,313 - lava_callback - DEBUG - Processing node 69d115b3691bac272b3259bb: baseline-arm64-clabbe 2026-04-06 13:44:36,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d115b3691bac272b3259bb 2026-04-06 13:44:36,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:44:36,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d115b3691bac272b3259bb HTTP/1.1" 200 None 2026-04-06 13:44:36,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:44:36,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:44:36,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:44:36,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d115b3691bac272b3259bb HTTP/1.1" 200 None 2026-04-06 13:44:36,367 - lava_callback - ERROR - Error processing callback for node 69d115b3691bac272b3259bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57702 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:45:31,516 - lava_callback - INFO - Received callback for node 69d115f6691bac272b3259d6 INFO: 172.19.0.1:56234 - "POST /node/69d115f6691bac272b3259d6 HTTP/1.0" 202 Accepted 2026-04-06 13:45:31,521 - lava_callback - INFO - Starting async job submit for node 69d115f6691bac272b3259d6 2026-04-06 13:45:31,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:45:31,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d115f6691bac272b3259d6 HTTP/1.1" 200 None 2026-04-06 13:45:31,537 - lava_callback - DEBUG - Processing node 69d115f6691bac272b3259d6: baseline-arm64-baylibre 2026-04-06 13:45:31,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d115f6691bac272b3259d6 2026-04-06 13:45:31,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:45:31,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d115f6691bac272b3259d6 HTTP/1.1" 200 None 2026-04-06 13:45:31,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:45:31,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:45:31,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:45:31,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d115f6691bac272b3259d6 HTTP/1.1" 200 None 2026-04-06 13:45:31,592 - lava_callback - ERROR - Error processing callback for node 69d115f6691bac272b3259d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36450 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:47:56,483 - lava_callback - INFO - Received callback for node 69d11684691bac272b325a43 INFO: 172.19.0.1:49772 - "POST /node/69d11684691bac272b325a43 HTTP/1.0" 202 Accepted 2026-04-06 13:47:56,489 - lava_callback - INFO - Starting async job submit for node 69d11684691bac272b325a43 2026-04-06 13:47:56,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:47:56,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11684691bac272b325a43 HTTP/1.1" 200 None 2026-04-06 13:47:56,504 - lava_callback - DEBUG - Processing node 69d11684691bac272b325a43: baseline-arm64-clabbe 2026-04-06 13:47:56,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11684691bac272b325a43 2026-04-06 13:47:56,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:49786 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:47:56,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11684691bac272b325a43 HTTP/1.1" 200 None 2026-04-06 13:47:56,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:47:56,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:47:56,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:47:56,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11684691bac272b325a43 HTTP/1.1" 200 None 2026-04-06 13:47:56,569 - lava_callback - ERROR - Error processing callback for node 69d11684691bac272b325a43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49710 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:48:51,589 - lava_callback - INFO - Received callback for node 69d116be691bac272b325a7e INFO: 172.19.0.1:56724 - "POST /node/69d116be691bac272b325a7e HTTP/1.0" 202 Accepted 2026-04-06 13:48:51,594 - lava_callback - INFO - Starting async job submit for node 69d116be691bac272b325a7e 2026-04-06 13:48:51,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:48:51,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d116be691bac272b325a7e HTTP/1.1" 200 None 2026-04-06 13:48:51,611 - lava_callback - DEBUG - Processing node 69d116be691bac272b325a7e: baseline-arm64-baylibre 2026-04-06 13:48:51,611 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d116be691bac272b325a7e 2026-04-06 13:48:51,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:48:51,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d116be691bac272b325a7e HTTP/1.1" 200 None 2026-04-06 13:48:51,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:48:51,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:48:51,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:48:51,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d116be691bac272b325a7e HTTP/1.1" 200 None 2026-04-06 13:48:51,677 - lava_callback - ERROR - Error processing callback for node 69d116be691bac272b325a7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34424 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:50:16,581 - lava_callback - INFO - Received callback for node 69d1170f691bac272b325a9e INFO: 172.19.0.1:34436 - "POST /node/69d1170f691bac272b325a9e HTTP/1.0" 202 Accepted 2026-04-06 13:50:16,587 - lava_callback - INFO - Starting async job submit for node 69d1170f691bac272b325a9e 2026-04-06 13:50:16,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:50:16,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1170f691bac272b325a9e HTTP/1.1" 200 None 2026-04-06 13:50:16,604 - lava_callback - DEBUG - Processing node 69d1170f691bac272b325a9e: baseline-arm64-clabbe 2026-04-06 13:50:16,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1170f691bac272b325a9e 2026-04-06 13:50:16,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:50:16,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1170f691bac272b325a9e HTTP/1.1" 200 None 2026-04-06 13:50:16,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:50:16,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:50:16,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:50:16,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1170f691bac272b325a9e HTTP/1.1" 200 None 2026-04-06 13:50:16,665 - lava_callback - ERROR - Error processing callback for node 69d1170f691bac272b325a9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42924 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:52:31,743 - lava_callback - INFO - Received callback for node 69d11794691bac272b325b00 INFO: 172.19.0.1:55536 - "POST /node/69d11794691bac272b325b00 HTTP/1.0" 202 Accepted 2026-04-06 13:52:31,748 - lava_callback - INFO - Starting async job submit for node 69d11794691bac272b325b00 2026-04-06 13:52:31,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:52:31,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11794691bac272b325b00 HTTP/1.1" 200 None 2026-04-06 13:52:31,765 - lava_callback - DEBUG - Processing node 69d11794691bac272b325b00: baseline-arm64-baylibre 2026-04-06 13:52:31,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11794691bac272b325b00 2026-04-06 13:52:31,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:52:31,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11794691bac272b325b00 HTTP/1.1" 200 None 2026-04-06 13:52:31,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:52:31,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:52:31,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:52:31,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11794691bac272b325b00 HTTP/1.1" 200 None 2026-04-06 13:52:31,823 - lava_callback - ERROR - Error processing callback for node 69d11794691bac272b325b00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60882 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:53:31,700 - lava_callback - INFO - Received callback for node 69d117d8691bac272b325b42 INFO: 172.19.0.1:54832 - "POST /node/69d117d8691bac272b325b42 HTTP/1.0" 202 Accepted 2026-04-06 13:53:31,705 - lava_callback - INFO - Starting async job submit for node 69d117d8691bac272b325b42 2026-04-06 13:53:31,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:53:31,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d117d8691bac272b325b42 HTTP/1.1" 200 None 2026-04-06 13:53:31,724 - lava_callback - DEBUG - Processing node 69d117d8691bac272b325b42: baseline-arm64-baylibre 2026-04-06 13:53:31,724 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d117d8691bac272b325b42 2026-04-06 13:53:31,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:53:31,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d117d8691bac272b325b42 HTTP/1.1" 200 None 2026-04-06 13:53:31,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:53:31,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:53:31,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:53:31,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d117d8691bac272b325b42 HTTP/1.1" 200 None 2026-04-06 13:53:31,779 - lava_callback - ERROR - Error processing callback for node 69d117d8691bac272b325b42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50530 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:54:56,853 - lava_callback - INFO - Received callback for node 69d11821691bac272b325b8a INFO: 172.19.0.1:50542 - "POST /node/69d11821691bac272b325b8a HTTP/1.0" 202 Accepted 2026-04-06 13:54:56,859 - lava_callback - INFO - Starting async job submit for node 69d11821691bac272b325b8a 2026-04-06 13:54:56,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:54:56,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11821691bac272b325b8a HTTP/1.1" 200 None 2026-04-06 13:54:56,874 - lava_callback - DEBUG - Processing node 69d11821691bac272b325b8a: baseline-arm64-clabbe 2026-04-06 13:54:56,875 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11821691bac272b325b8a 2026-04-06 13:54:56,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:54:56,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11821691bac272b325b8a HTTP/1.1" 200 None 2026-04-06 13:54:56,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:54:56,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:54:56,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:54:56,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11821691bac272b325b8a HTTP/1.1" 200 None 2026-04-06 13:54:56,935 - lava_callback - ERROR - Error processing callback for node 69d11821691bac272b325b8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55372 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:55:51,816 - lava_callback - INFO - Received callback for node 69d1185f691bac272b325bbe INFO: 172.19.0.1:33094 - "POST /node/69d1185f691bac272b325bbe HTTP/1.0" 202 Accepted 2026-04-06 13:55:51,821 - lava_callback - INFO - Starting async job submit for node 69d1185f691bac272b325bbe 2026-04-06 13:55:51,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:55:51,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1185f691bac272b325bbe HTTP/1.1" 200 None 2026-04-06 13:55:51,837 - lava_callback - DEBUG - Processing node 69d1185f691bac272b325bbe: baseline-arm64-baylibre 2026-04-06 13:55:51,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1185f691bac272b325bbe 2026-04-06 13:55:51,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:55:51,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1185f691bac272b325bbe HTTP/1.1" 200 None 2026-04-06 13:55:51,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:55:51,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:55:51,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:55:51,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1185f691bac272b325bbe HTTP/1.1" 200 None 2026-04-06 13:55:51,899 - lava_callback - ERROR - Error processing callback for node 69d1185f691bac272b325bbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50138 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:57:16,960 - lava_callback - INFO - Received callback for node 69d118ac691bac272b325be1 INFO: 172.19.0.1:50152 - "POST /node/69d118ac691bac272b325be1 HTTP/1.0" 202 Accepted 2026-04-06 13:57:16,966 - lava_callback - INFO - Starting async job submit for node 69d118ac691bac272b325be1 2026-04-06 13:57:16,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:57:16,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d118ac691bac272b325be1 HTTP/1.1" 200 None 2026-04-06 13:57:16,983 - lava_callback - DEBUG - Processing node 69d118ac691bac272b325be1: baseline-arm64-clabbe 2026-04-06 13:57:16,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d118ac691bac272b325be1 2026-04-06 13:57:16,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:57:17,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d118ac691bac272b325be1 HTTP/1.1" 200 None 2026-04-06 13:57:17,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:57:17,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:57:17,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:57:17,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d118ac691bac272b325be1 HTTP/1.1" 200 None 2026-04-06 13:57:17,067 - lava_callback - ERROR - Error processing callback for node 69d118ac691bac272b325be1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60358 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:58:12,227 - lava_callback - INFO - Received callback for node 69d118e9691bac272b325c26 INFO: 172.19.0.1:43370 - "POST /node/69d118e9691bac272b325c26 HTTP/1.0" 202 Accepted 2026-04-06 13:58:12,233 - lava_callback - INFO - Starting async job submit for node 69d118e9691bac272b325c26 2026-04-06 13:58:12,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:58:12,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d118e9691bac272b325c26 HTTP/1.1" 200 None 2026-04-06 13:58:12,249 - lava_callback - DEBUG - Processing node 69d118e9691bac272b325c26: baseline-arm64-baylibre 2026-04-06 13:58:12,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d118e9691bac272b325c26 2026-04-06 13:58:12,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:58:12,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d118e9691bac272b325c26 HTTP/1.1" 200 None 2026-04-06 13:58:12,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:58:12,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:58:12,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:58:12,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d118e9691bac272b325c26 HTTP/1.1" 200 None 2026-04-06 13:58:12,314 - lava_callback - ERROR - Error processing callback for node 69d118e9691bac272b325c26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60534 - "GET / HTTP/1.0" 200 OK 2026-04-06 13:59:37,281 - lava_callback - INFO - Received callback for node 69d11936691bac272b325c50 INFO: 172.19.0.1:60536 - "POST /node/69d11936691bac272b325c50 HTTP/1.0" 202 Accepted 2026-04-06 13:59:37,286 - lava_callback - INFO - Starting async job submit for node 69d11936691bac272b325c50 2026-04-06 13:59:37,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:59:37,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11936691bac272b325c50 HTTP/1.1" 200 None 2026-04-06 13:59:37,306 - lava_callback - DEBUG - Processing node 69d11936691bac272b325c50: baseline-arm64-clabbe 2026-04-06 13:59:37,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11936691bac272b325c50 2026-04-06 13:59:37,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:59:37,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11936691bac272b325c50 HTTP/1.1" 200 None 2026-04-06 13:59:37,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:59:37,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 13:59:37,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 13:59:37,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11936691bac272b325c50 HTTP/1.1" 200 None 2026-04-06 13:59:37,385 - lava_callback - ERROR - Error processing callback for node 69d11936691bac272b325c50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46038 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:00:37,100 - lava_callback - INFO - Received callback for node 69d11980691bac272b325c6b INFO: 172.19.0.1:46040 - "POST /node/69d11980691bac272b325c6b HTTP/1.0" 202 Accepted 2026-04-06 14:00:37,105 - lava_callback - INFO - Starting async job submit for node 69d11980691bac272b325c6b 2026-04-06 14:00:37,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:00:37,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11980691bac272b325c6b HTTP/1.1" 200 None 2026-04-06 14:00:37,121 - lava_callback - DEBUG - Processing node 69d11980691bac272b325c6b: baseline-arm64-clabbe 2026-04-06 14:00:37,122 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11980691bac272b325c6b 2026-04-06 14:00:37,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:00:37,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11980691bac272b325c6b HTTP/1.1" 200 None 2026-04-06 14:00:37,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:00:37,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 14:00:37,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:00:37,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11980691bac272b325c6b HTTP/1.1" 200 None 2026-04-06 14:00:37,183 - lava_callback - ERROR - Error processing callback for node 69d11980691bac272b325c6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35120 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:01:57,137 - lava_callback - INFO - Received callback for node 69d119cc691bac272b325c8a INFO: 172.19.0.1:35124 - "POST /node/69d119cc691bac272b325c8a HTTP/1.0" 202 Accepted 2026-04-06 14:01:57,143 - lava_callback - INFO - Starting async job submit for node 69d119cc691bac272b325c8a 2026-04-06 14:01:57,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:01:57,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d119cc691bac272b325c8a HTTP/1.1" 200 None 2026-04-06 14:01:57,158 - lava_callback - DEBUG - Processing node 69d119cc691bac272b325c8a: baseline-arm64-clabbe 2026-04-06 14:01:57,158 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d119cc691bac272b325c8a 2026-04-06 14:01:57,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:01:57,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d119cc691bac272b325c8a HTTP/1.1" 200 None 2026-04-06 14:01:57,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:01:57,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 14:01:57,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:01:57,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d119cc691bac272b325c8a HTTP/1.1" 200 None 2026-04-06 14:01:57,223 - lava_callback - ERROR - Error processing callback for node 69d119cc691bac272b325c8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45094 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:03:17,183 - lava_callback - INFO - Received callback for node 69d11a15691bac272b325c9f INFO: 172.19.0.1:45100 - "POST /node/69d11a15691bac272b325c9f HTTP/1.0" 202 Accepted 2026-04-06 14:03:17,188 - lava_callback - INFO - Starting async job submit for node 69d11a15691bac272b325c9f 2026-04-06 14:03:17,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:03:17,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11a15691bac272b325c9f HTTP/1.1" 200 None 2026-04-06 14:03:17,205 - lava_callback - DEBUG - Processing node 69d11a15691bac272b325c9f: baseline-arm64-clabbe 2026-04-06 14:03:17,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11a15691bac272b325c9f 2026-04-06 14:03:17,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:03:17,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11a15691bac272b325c9f HTTP/1.1" 200 None 2026-04-06 14:03:17,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:03:17,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 14:03:17,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:03:17,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11a15691bac272b325c9f HTTP/1.1" 200 None 2026-04-06 14:03:17,269 - lava_callback - ERROR - Error processing callback for node 69d11a15691bac272b325c9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56046 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:04:17,252 - lava_callback - INFO - Received callback for node 69d11a5b691bac272b325ccf INFO: 172.19.0.1:56058 - "POST /node/69d11a5b691bac272b325ccf HTTP/1.0" 202 Accepted 2026-04-06 14:04:17,258 - lava_callback - INFO - Starting async job submit for node 69d11a5b691bac272b325ccf 2026-04-06 14:04:17,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:04:17,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11a5b691bac272b325ccf HTTP/1.1" 200 None 2026-04-06 14:04:17,287 - lava_callback - DEBUG - Processing node 69d11a5b691bac272b325ccf: baseline-arm64-clabbe 2026-04-06 14:04:17,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11a5b691bac272b325ccf 2026-04-06 14:04:17,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:04:17,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11a5b691bac272b325ccf HTTP/1.1" 200 None 2026-04-06 14:04:17,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:04:17,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 14:04:17,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:04:17,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11a5b691bac272b325ccf HTTP/1.1" 200 None 2026-04-06 14:04:17,348 - lava_callback - ERROR - Error processing callback for node 69d11a5b691bac272b325ccf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56190 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:05:37,293 - lava_callback - INFO - Received callback for node 69d11aa3691bac272b325ceb INFO: 172.19.0.1:56196 - "POST /node/69d11aa3691bac272b325ceb HTTP/1.0" 202 Accepted 2026-04-06 14:05:37,299 - lava_callback - INFO - Starting async job submit for node 69d11aa3691bac272b325ceb 2026-04-06 14:05:37,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:05:37,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11aa3691bac272b325ceb HTTP/1.1" 200 None 2026-04-06 14:05:37,339 - lava_callback - DEBUG - Processing node 69d11aa3691bac272b325ceb: baseline-arm64-clabbe 2026-04-06 14:05:37,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11aa3691bac272b325ceb 2026-04-06 14:05:37,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:05:37,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11aa3691bac272b325ceb HTTP/1.1" 200 None 2026-04-06 14:05:37,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:05:37,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 14:05:37,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:05:37,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11aa3691bac272b325ceb HTTP/1.1" 200 None 2026-04-06 14:05:37,405 - lava_callback - ERROR - Error processing callback for node 69d11aa3691bac272b325ceb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37548 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:06:37,352 - lava_callback - INFO - Received callback for node 69d11ae7691bac272b325d33 INFO: 172.19.0.1:37564 - "POST /node/69d11ae7691bac272b325d33 HTTP/1.0" 202 Accepted 2026-04-06 14:06:37,358 - lava_callback - INFO - Starting async job submit for node 69d11ae7691bac272b325d33 2026-04-06 14:06:37,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:06:37,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11ae7691bac272b325d33 HTTP/1.1" 200 None 2026-04-06 14:06:37,374 - lava_callback - DEBUG - Processing node 69d11ae7691bac272b325d33: baseline-arm64-clabbe 2026-04-06 14:06:37,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11ae7691bac272b325d33 2026-04-06 14:06:37,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:06:37,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11ae7691bac272b325d33 HTTP/1.1" 200 None 2026-04-06 14:06:37,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:06:37,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 14:06:37,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:06:37,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11ae7691bac272b325d33 HTTP/1.1" 200 None 2026-04-06 14:06:37,445 - lava_callback - ERROR - Error processing callback for node 69d11ae7691bac272b325d33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60548 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:07:57,460 - lava_callback - INFO - Received callback for node 69d11b31691bac272b325d42 INFO: 172.19.0.1:60558 - "POST /node/69d11b31691bac272b325d42 HTTP/1.0" 202 Accepted 2026-04-06 14:07:57,466 - lava_callback - INFO - Starting async job submit for node 69d11b31691bac272b325d42 2026-04-06 14:07:57,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:07:57,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11b31691bac272b325d42 HTTP/1.1" 200 None 2026-04-06 14:07:57,482 - lava_callback - DEBUG - Processing node 69d11b31691bac272b325d42: baseline-arm64-clabbe 2026-04-06 14:07:57,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11b31691bac272b325d42 2026-04-06 14:07:57,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:07:57,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11b31691bac272b325d42 HTTP/1.1" 200 None 2026-04-06 14:07:57,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:07:57,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 14:07:57,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:07:57,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11b31691bac272b325d42 HTTP/1.1" 200 None 2026-04-06 14:07:57,533 - lava_callback - ERROR - Error processing callback for node 69d11b31691bac272b325d42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56536 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:08:57,492 - lava_callback - INFO - Received callback for node 69d11b75691bac272b325d6e INFO: 172.19.0.1:56552 - "POST /node/69d11b75691bac272b325d6e HTTP/1.0" 202 Accepted 2026-04-06 14:08:57,498 - lava_callback - INFO - Starting async job submit for node 69d11b75691bac272b325d6e 2026-04-06 14:08:57,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:08:57,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11b75691bac272b325d6e HTTP/1.1" 200 None 2026-04-06 14:08:57,544 - lava_callback - DEBUG - Processing node 69d11b75691bac272b325d6e: baseline-arm64-clabbe 2026-04-06 14:08:57,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11b75691bac272b325d6e 2026-04-06 14:08:57,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:08:57,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11b75691bac272b325d6e HTTP/1.1" 200 None 2026-04-06 14:08:57,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:08:57,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 14:08:57,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:08:57,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11b75691bac272b325d6e HTTP/1.1" 200 None 2026-04-06 14:08:57,622 - lava_callback - ERROR - Error processing callback for node 69d11b75691bac272b325d6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57186 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:10:17,556 - lava_callback - INFO - Received callback for node 69d11bba691bac272b325daf INFO: 172.19.0.1:57198 - "POST /node/69d11bba691bac272b325daf HTTP/1.0" 202 Accepted 2026-04-06 14:10:17,561 - lava_callback - INFO - Starting async job submit for node 69d11bba691bac272b325daf 2026-04-06 14:10:17,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:10:17,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11bba691bac272b325daf HTTP/1.1" 200 None 2026-04-06 14:10:17,582 - lava_callback - DEBUG - Processing node 69d11bba691bac272b325daf: baseline-arm64-clabbe 2026-04-06 14:10:17,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d11bba691bac272b325daf 2026-04-06 14:10:17,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:10:17,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d11bba691bac272b325daf HTTP/1.1" 200 None 2026-04-06 14:10:17,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:10:17,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cdb5cc23eb053795d41ecc HTTP/1.1" 200 None 2026-04-06 14:10:17,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:10:17,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d11bba691bac272b325daf HTTP/1.1" 200 None 2026-04-06 14:10:17,662 - lava_callback - ERROR - Error processing callback for node 69d11bba691bac272b325daf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35402 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:40:14,459 - lava_callback - INFO - Received callback for node 69d122c3691bac272b325e63 INFO: 172.19.0.1:59292 - "POST /node/69d122c3691bac272b325e63 HTTP/1.0" 202 Accepted 2026-04-06 14:40:14,465 - lava_callback - INFO - Starting async job submit for node 69d122c3691bac272b325e63 2026-04-06 14:40:14,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:40:14,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d122c3691bac272b325e63 HTTP/1.1" 200 None 2026-04-06 14:40:14,485 - lava_callback - DEBUG - Processing node 69d122c3691bac272b325e63: baseline-arm-baylibre 2026-04-06 14:40:14,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d122c3691bac272b325e63 2026-04-06 14:40:14,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:40:14,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d122c3691bac272b325e63 HTTP/1.1" 200 None 2026-04-06 14:40:14,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:40:14,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 14:40:14,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:40:14,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d122c3691bac272b325e63 HTTP/1.1" 200 None 2026-04-06 14:40:14,547 - lava_callback - ERROR - Error processing callback for node 69d122c3691bac272b325e63: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42518 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:40:54,264 - lava_callback - INFO - Received callback for node 69d122e7691bac272b325e74 INFO: 172.19.0.1:44708 - "POST /node/69d122e7691bac272b325e74 HTTP/1.0" 202 Accepted 2026-04-06 14:40:54,273 - lava_callback - INFO - Starting async job submit for node 69d122e7691bac272b325e74 2026-04-06 14:40:54,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:40:54,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d122e7691bac272b325e74 HTTP/1.1" 200 None 2026-04-06 14:40:54,292 - lava_callback - DEBUG - Processing node 69d122e7691bac272b325e74: baseline-arm-baylibre 2026-04-06 14:40:54,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d122e7691bac272b325e74 2026-04-06 14:40:54,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:40:54,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d122e7691bac272b325e74 HTTP/1.1" 200 None 2026-04-06 14:40:54,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:40:54,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 14:40:54,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:40:54,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d122e7691bac272b325e74 HTTP/1.1" 200 None 2026-04-06 14:40:54,362 - lava_callback - ERROR - Error processing callback for node 69d122e7691bac272b325e74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60940 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:41:14,253 - lava_callback - INFO - Received callback for node 69d12305691bac272b325ea0 INFO: 172.19.0.1:52990 - "POST /node/69d12305691bac272b325ea0 HTTP/1.0" 202 Accepted 2026-04-06 14:41:14,259 - lava_callback - INFO - Starting async job submit for node 69d12305691bac272b325ea0 2026-04-06 14:41:14,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:41:14,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12305691bac272b325ea0 HTTP/1.1" 200 None 2026-04-06 14:41:14,279 - lava_callback - DEBUG - Processing node 69d12305691bac272b325ea0: baseline-arm-baylibre 2026-04-06 14:41:14,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12305691bac272b325ea0 2026-04-06 14:41:14,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:41:14,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12305691bac272b325ea0 HTTP/1.1" 200 None 2026-04-06 14:41:14,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:41:14,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 14:41:14,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:41:14,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12305691bac272b325ea0 HTTP/1.1" 200 None 2026-04-06 14:41:14,336 - lava_callback - ERROR - Error processing callback for node 69d12305691bac272b325ea0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43118 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:41:54,343 - lava_callback - INFO - Received callback for node 69d12325691bac272b325ece INFO: 172.19.0.1:48568 - "POST /node/69d12325691bac272b325ece HTTP/1.0" 202 Accepted 2026-04-06 14:41:54,353 - lava_callback - INFO - Starting async job submit for node 69d12325691bac272b325ece 2026-04-06 14:41:54,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:41:54,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12325691bac272b325ece HTTP/1.1" 200 None 2026-04-06 14:41:54,376 - lava_callback - DEBUG - Processing node 69d12325691bac272b325ece: baseline-arm-baylibre 2026-04-06 14:41:54,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12325691bac272b325ece 2026-04-06 14:41:54,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:41:54,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12325691bac272b325ece HTTP/1.1" 200 None 2026-04-06 14:41:54,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:41:54,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 14:41:54,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:41:54,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12325691bac272b325ece HTTP/1.1" 200 None 2026-04-06 14:41:54,441 - lava_callback - ERROR - Error processing callback for node 69d12325691bac272b325ece: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32896 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:43:39,116 - lava_callback - INFO - Received callback for node 69d1238b691bac272b325f0f INFO: 172.19.0.1:32908 - "POST /node/69d1238b691bac272b325f0f HTTP/1.0" 202 Accepted 2026-04-06 14:43:39,121 - lava_callback - INFO - Starting async job submit for node 69d1238b691bac272b325f0f 2026-04-06 14:43:39,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:43:39,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1238b691bac272b325f0f HTTP/1.1" 200 None 2026-04-06 14:43:39,138 - lava_callback - DEBUG - Processing node 69d1238b691bac272b325f0f: baseline-arm-clabbe 2026-04-06 14:43:39,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1238b691bac272b325f0f 2026-04-06 14:43:39,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:43:39,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1238b691bac272b325f0f HTTP/1.1" 200 None 2026-04-06 14:43:39,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:43:39,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 14:43:39,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:43:39,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1238b691bac272b325f0f HTTP/1.1" 200 None 2026-04-06 14:43:39,194 - lava_callback - ERROR - Error processing callback for node 69d1238b691bac272b325f0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55302 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:44:19,159 - lava_callback - INFO - Received callback for node 69d123ad691bac272b325f20 INFO: 172.19.0.1:55312 - "POST /node/69d123ad691bac272b325f20 HTTP/1.0" 202 Accepted 2026-04-06 14:44:19,165 - lava_callback - INFO - Starting async job submit for node 69d123ad691bac272b325f20 2026-04-06 14:44:19,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:44:19,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d123ad691bac272b325f20 HTTP/1.1" 200 None 2026-04-06 14:44:19,180 - lava_callback - DEBUG - Processing node 69d123ad691bac272b325f20: baseline-arm-clabbe 2026-04-06 14:44:19,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d123ad691bac272b325f20 2026-04-06 14:44:19,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:44:19,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d123ad691bac272b325f20 HTTP/1.1" 200 None 2026-04-06 14:44:19,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:44:19,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 14:44:19,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:44:19,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d123ad691bac272b325f20 HTTP/1.1" 200 None 2026-04-06 14:44:19,248 - lava_callback - ERROR - Error processing callback for node 69d123ad691bac272b325f20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46452 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:44:39,188 - lava_callback - INFO - Received callback for node 69d123d0691bac272b325f42 INFO: 172.19.0.1:46456 - "POST /node/69d123d0691bac272b325f42 HTTP/1.0" 202 Accepted 2026-04-06 14:44:39,194 - lava_callback - INFO - Starting async job submit for node 69d123d0691bac272b325f42 2026-04-06 14:44:39,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:44:39,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d123d0691bac272b325f42 HTTP/1.1" 200 None 2026-04-06 14:44:39,216 - lava_callback - DEBUG - Processing node 69d123d0691bac272b325f42: baseline-arm-clabbe 2026-04-06 14:44:39,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d123d0691bac272b325f42 2026-04-06 14:44:39,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:44:39,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d123d0691bac272b325f42 HTTP/1.1" 200 None 2026-04-06 14:44:39,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:44:39,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 14:44:39,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:44:39,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d123d0691bac272b325f42 HTTP/1.1" 200 None 2026-04-06 14:44:39,273 - lava_callback - ERROR - Error processing callback for node 69d123d0691bac272b325f42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58168 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:45:19,132 - lava_callback - INFO - Received callback for node 69d123eb691bac272b325f79 INFO: 172.19.0.1:58180 - "POST /node/69d123eb691bac272b325f79 HTTP/1.0" 202 Accepted 2026-04-06 14:45:19,138 - lava_callback - INFO - Starting async job submit for node 69d123eb691bac272b325f79 2026-04-06 14:45:19,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:45:19,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d123eb691bac272b325f79 HTTP/1.1" 200 None 2026-04-06 14:45:19,156 - lava_callback - DEBUG - Processing node 69d123eb691bac272b325f79: baseline-arm-clabbe 2026-04-06 14:45:19,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d123eb691bac272b325f79 2026-04-06 14:45:19,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:45:19,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d123eb691bac272b325f79 HTTP/1.1" 200 None 2026-04-06 14:45:19,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:45:19,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 14:45:19,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:45:19,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d123eb691bac272b325f79 HTTP/1.1" 200 None 2026-04-06 14:45:19,241 - lava_callback - ERROR - Error processing callback for node 69d123eb691bac272b325f79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50472 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:45:39,205 - lava_callback - INFO - Received callback for node 69d1240b691bac272b325fa5 INFO: 172.19.0.1:50480 - "POST /node/69d1240b691bac272b325fa5 HTTP/1.0" 202 Accepted 2026-04-06 14:45:39,211 - lava_callback - INFO - Starting async job submit for node 69d1240b691bac272b325fa5 2026-04-06 14:45:39,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:45:39,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1240b691bac272b325fa5 HTTP/1.1" 200 None 2026-04-06 14:45:39,228 - lava_callback - DEBUG - Processing node 69d1240b691bac272b325fa5: baseline-arm-clabbe 2026-04-06 14:45:39,229 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1240b691bac272b325fa5 2026-04-06 14:45:39,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:45:39,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1240b691bac272b325fa5 HTTP/1.1" 200 None 2026-04-06 14:45:39,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:45:39,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 14:45:39,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:45:39,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1240b691bac272b325fa5 HTTP/1.1" 200 None 2026-04-06 14:45:39,296 - lava_callback - ERROR - Error processing callback for node 69d1240b691bac272b325fa5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58736 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:46:19,201 - lava_callback - INFO - Received callback for node 69d1242d691bac272b325fc6 INFO: 172.19.0.1:58740 - "POST /node/69d1242d691bac272b325fc6 HTTP/1.0" 202 Accepted 2026-04-06 14:46:19,207 - lava_callback - INFO - Starting async job submit for node 69d1242d691bac272b325fc6 2026-04-06 14:46:19,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:46:19,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1242d691bac272b325fc6 HTTP/1.1" 200 None 2026-04-06 14:46:19,230 - lava_callback - DEBUG - Processing node 69d1242d691bac272b325fc6: baseline-arm-clabbe 2026-04-06 14:46:19,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1242d691bac272b325fc6 2026-04-06 14:46:19,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:46:19,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1242d691bac272b325fc6 HTTP/1.1" 200 None 2026-04-06 14:46:19,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:46:19,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 14:46:19,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:46:19,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1242d691bac272b325fc6 HTTP/1.1" 200 None 2026-04-06 14:46:19,295 - lava_callback - ERROR - Error processing callback for node 69d1242d691bac272b325fc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58204 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:46:59,225 - lava_callback - INFO - Received callback for node 69d12450691bac272b325fe6 INFO: 172.19.0.1:58210 - "POST /node/69d12450691bac272b325fe6 HTTP/1.0" 202 Accepted 2026-04-06 14:46:59,231 - lava_callback - INFO - Starting async job submit for node 69d12450691bac272b325fe6 2026-04-06 14:46:59,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:46:59,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12450691bac272b325fe6 HTTP/1.1" 200 None 2026-04-06 14:46:59,246 - lava_callback - DEBUG - Processing node 69d12450691bac272b325fe6: baseline-arm-clabbe 2026-04-06 14:46:59,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12450691bac272b325fe6 2026-04-06 14:46:59,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:46:59,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12450691bac272b325fe6 HTTP/1.1" 200 None 2026-04-06 14:46:59,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:46:59,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c903691bac272b322d89 HTTP/1.1" 200 None 2026-04-06 14:46:59,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:46:59,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12450691bac272b325fe6 HTTP/1.1" 200 None 2026-04-06 14:46:59,303 - lava_callback - ERROR - Error processing callback for node 69d12450691bac272b325fe6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40848 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:47:14,741 - lava_callback - INFO - Received callback for node 69d1246a691bac272b32602c INFO: 172.19.0.1:41686 - "POST /node/69d1246a691bac272b32602c HTTP/1.0" 202 Accepted 2026-04-06 14:47:14,746 - lava_callback - INFO - Starting async job submit for node 69d1246a691bac272b32602c 2026-04-06 14:47:14,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:47:14,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1246a691bac272b32602c HTTP/1.1" 200 None 2026-04-06 14:47:14,764 - lava_callback - DEBUG - Processing node 69d1246a691bac272b32602c: baseline-arm-baylibre 2026-04-06 14:47:14,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1246a691bac272b32602c 2026-04-06 14:47:14,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:47:14,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1246a691bac272b32602c HTTP/1.1" 200 None 2026-04-06 14:47:14,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:47:14,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 14:47:14,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:47:14,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1246a691bac272b32602c HTTP/1.1" 200 None 2026-04-06 14:47:14,851 - lava_callback - ERROR - Error processing callback for node 69d1246a691bac272b32602c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45586 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:47:54,647 - lava_callback - INFO - Received callback for node 69d12488691bac272b326061 INFO: 172.19.0.1:58360 - "POST /node/69d12488691bac272b326061 HTTP/1.0" 202 Accepted 2026-04-06 14:47:54,653 - lava_callback - INFO - Starting async job submit for node 69d12488691bac272b326061 2026-04-06 14:47:54,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:47:54,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12488691bac272b326061 HTTP/1.1" 200 None 2026-04-06 14:47:54,671 - lava_callback - DEBUG - Processing node 69d12488691bac272b326061: baseline-arm-baylibre 2026-04-06 14:47:54,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12488691bac272b326061 2026-04-06 14:47:54,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:47:54,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12488691bac272b326061 HTTP/1.1" 200 None 2026-04-06 14:47:54,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:47:54,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 14:47:54,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:47:54,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12488691bac272b326061 HTTP/1.1" 200 None 2026-04-06 14:47:54,754 - lava_callback - ERROR - Error processing callback for node 69d12488691bac272b326061: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47210 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:48:14,627 - lava_callback - INFO - Received callback for node 69d124aa691bac272b326080 INFO: 172.19.0.1:37194 - "POST /node/69d124aa691bac272b326080 HTTP/1.0" 202 Accepted 2026-04-06 14:48:14,633 - lava_callback - INFO - Starting async job submit for node 69d124aa691bac272b326080 2026-04-06 14:48:14,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:48:14,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d124aa691bac272b326080 HTTP/1.1" 200 None 2026-04-06 14:48:14,653 - lava_callback - DEBUG - Processing node 69d124aa691bac272b326080: baseline-arm-baylibre 2026-04-06 14:48:14,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d124aa691bac272b326080 2026-04-06 14:48:14,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:48:14,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d124aa691bac272b326080 HTTP/1.1" 200 None 2026-04-06 14:48:14,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:48:14,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 14:48:14,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:48:14,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d124aa691bac272b326080 HTTP/1.1" 200 None 2026-04-06 14:48:14,731 - lava_callback - ERROR - Error processing callback for node 69d124aa691bac272b326080: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58524 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:48:54,721 - lava_callback - INFO - Received callback for node 69d124cb691bac272b32609c INFO: 172.19.0.1:47364 - "POST /node/69d124cb691bac272b32609c HTTP/1.0" 202 Accepted 2026-04-06 14:48:54,726 - lava_callback - INFO - Starting async job submit for node 69d124cb691bac272b32609c 2026-04-06 14:48:54,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:48:54,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d124cb691bac272b32609c HTTP/1.1" 200 None 2026-04-06 14:48:54,742 - lava_callback - DEBUG - Processing node 69d124cb691bac272b32609c: baseline-arm-baylibre 2026-04-06 14:48:54,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d124cb691bac272b32609c 2026-04-06 14:48:54,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:48:54,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d124cb691bac272b32609c HTTP/1.1" 200 None 2026-04-06 14:48:54,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:48:54,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 14:48:54,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:48:54,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d124cb691bac272b32609c HTTP/1.1" 200 None 2026-04-06 14:48:54,816 - lava_callback - ERROR - Error processing callback for node 69d124cb691bac272b32609c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36354 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:49:34,712 - lava_callback - INFO - Received callback for node 69d124ec691bac272b3260ba INFO: 172.19.0.1:40600 - "POST /node/69d124ec691bac272b3260ba HTTP/1.0" 202 Accepted 2026-04-06 14:49:34,717 - lava_callback - INFO - Starting async job submit for node 69d124ec691bac272b3260ba 2026-04-06 14:49:34,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:49:34,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d124ec691bac272b3260ba HTTP/1.1" 200 None 2026-04-06 14:49:34,733 - lava_callback - DEBUG - Processing node 69d124ec691bac272b3260ba: baseline-arm-baylibre 2026-04-06 14:49:34,733 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d124ec691bac272b3260ba 2026-04-06 14:49:34,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:49:34,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d124ec691bac272b3260ba HTTP/1.1" 200 None 2026-04-06 14:49:34,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:49:34,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 14:49:34,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:49:34,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d124ec691bac272b3260ba HTTP/1.1" 200 None 2026-04-06 14:49:34,814 - lava_callback - ERROR - Error processing callback for node 69d124ec691bac272b3260ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40176 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:50:14,894 - lava_callback - INFO - Received callback for node 69d12512691bac272b3260df INFO: 172.19.0.1:34082 - "POST /node/69d12512691bac272b3260df HTTP/1.0" 202 Accepted 2026-04-06 14:50:14,899 - lava_callback - INFO - Starting async job submit for node 69d12512691bac272b3260df 2026-04-06 14:50:14,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:50:14,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12512691bac272b3260df HTTP/1.1" 200 None 2026-04-06 14:50:14,925 - lava_callback - DEBUG - Processing node 69d12512691bac272b3260df: baseline-arm-baylibre 2026-04-06 14:50:14,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12512691bac272b3260df 2026-04-06 14:50:14,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:50:14,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12512691bac272b3260df HTTP/1.1" 200 None 2026-04-06 14:50:14,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:50:14,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 14:50:14,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:50:14,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12512691bac272b3260df HTTP/1.1" 200 None 2026-04-06 14:50:14,975 - lava_callback - ERROR - Error processing callback for node 69d12512691bac272b3260df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56448 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:50:34,749 - lava_callback - INFO - Received callback for node 69d12535691bac272b326101 INFO: 172.19.0.1:40446 - "POST /node/69d12535691bac272b326101 HTTP/1.0" 202 Accepted 2026-04-06 14:50:34,755 - lava_callback - INFO - Starting async job submit for node 69d12535691bac272b326101 2026-04-06 14:50:34,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:50:34,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12535691bac272b326101 HTTP/1.1" 200 None 2026-04-06 14:50:34,786 - lava_callback - DEBUG - Processing node 69d12535691bac272b326101: baseline-arm-baylibre 2026-04-06 14:50:34,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12535691bac272b326101 2026-04-06 14:50:34,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:50:34,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12535691bac272b326101 HTTP/1.1" 200 None 2026-04-06 14:50:34,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:50:34,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 14:50:34,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:50:34,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12535691bac272b326101 HTTP/1.1" 200 None 2026-04-06 14:50:34,853 - lava_callback - ERROR - Error processing callback for node 69d12535691bac272b326101: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48646 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:51:19,454 - lava_callback - INFO - Received callback for node 69d12557691bac272b326128 INFO: 172.19.0.1:48648 - "POST /node/69d12557691bac272b326128 HTTP/1.0" 202 Accepted 2026-04-06 14:51:19,460 - lava_callback - INFO - Starting async job submit for node 69d12557691bac272b326128 2026-04-06 14:51:19,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:51:19,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12557691bac272b326128 HTTP/1.1" 200 None 2026-04-06 14:51:19,476 - lava_callback - DEBUG - Processing node 69d12557691bac272b326128: baseline-arm-clabbe 2026-04-06 14:51:19,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12557691bac272b326128 2026-04-06 14:51:19,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:51:19,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12557691bac272b326128 HTTP/1.1" 200 None 2026-04-06 14:51:19,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:51:19,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 14:51:19,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:51:19,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12557691bac272b326128 HTTP/1.1" 200 None 2026-04-06 14:51:19,537 - lava_callback - ERROR - Error processing callback for node 69d12557691bac272b326128: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38490 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:33196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48426 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 14:56:15,279 - lava_callback - INFO - Received callback for node 69d1268b691bac272b3261cf INFO: 172.19.0.1:48432 - "POST /node/69d1268b691bac272b3261cf HTTP/1.0" 202 Accepted 2026-04-06 14:56:15,286 - lava_callback - INFO - Starting async job submit for node 69d1268b691bac272b3261cf 2026-04-06 14:56:15,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:56:15,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1268b691bac272b3261cf HTTP/1.1" 200 None 2026-04-06 14:56:15,301 - lava_callback - DEBUG - Processing node 69d1268b691bac272b3261cf: baseline-arm-baylibre 2026-04-06 14:56:15,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1268b691bac272b3261cf 2026-04-06 14:56:15,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:56:15,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1268b691bac272b3261cf HTTP/1.1" 200 None 2026-04-06 14:56:15,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:56:15,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 14:56:15,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:56:15,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1268b691bac272b3261cf HTTP/1.1" 200 None 2026-04-06 14:56:15,399 - lava_callback - ERROR - Error processing callback for node 69d1268b691bac272b3261cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34900 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:56:59,682 - lava_callback - INFO - Received callback for node 69d126ad691bac272b3261f5 INFO: 172.19.0.1:34902 - "POST /node/69d126ad691bac272b3261f5 HTTP/1.0" 202 Accepted 2026-04-06 14:56:59,687 - lava_callback - INFO - Starting async job submit for node 69d126ad691bac272b3261f5 2026-04-06 14:56:59,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:56:59,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d126ad691bac272b3261f5 HTTP/1.1" 200 None 2026-04-06 14:56:59,706 - lava_callback - DEBUG - Processing node 69d126ad691bac272b3261f5: baseline-arm-clabbe 2026-04-06 14:56:59,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d126ad691bac272b3261f5 2026-04-06 14:56:59,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:56:59,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d126ad691bac272b3261f5 HTTP/1.1" 200 None 2026-04-06 14:56:59,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:56:59,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 14:56:59,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:56:59,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d126ad691bac272b3261f5 HTTP/1.1" 200 None 2026-04-06 14:56:59,790 - lava_callback - ERROR - Error processing callback for node 69d126ad691bac272b3261f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34568 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:57:35,218 - lava_callback - INFO - Received callback for node 69d126d1691bac272b326208 INFO: 172.19.0.1:36338 - "POST /node/69d126d1691bac272b326208 HTTP/1.0" 202 Accepted 2026-04-06 14:57:35,224 - lava_callback - INFO - Starting async job submit for node 69d126d1691bac272b326208 2026-04-06 14:57:35,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:57:35,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d126d1691bac272b326208 HTTP/1.1" 200 None 2026-04-06 14:57:35,241 - lava_callback - DEBUG - Processing node 69d126d1691bac272b326208: baseline-arm-baylibre 2026-04-06 14:57:35,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d126d1691bac272b326208 2026-04-06 14:57:35,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:57:35,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d126d1691bac272b326208 HTTP/1.1" 200 None 2026-04-06 14:57:35,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:57:35,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 14:57:35,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:57:35,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d126d1691bac272b326208 HTTP/1.1" 200 None 2026-04-06 14:57:35,298 - lava_callback - ERROR - Error processing callback for node 69d126d1691bac272b326208: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43450 - "GET / HTTP/1.0" 200 OK 2026-04-06 14:58:15,134 - lava_callback - INFO - Received callback for node 69d126f7691bac272b326236 INFO: 172.19.0.1:56514 - "POST /node/69d126f7691bac272b326236 HTTP/1.0" 202 Accepted 2026-04-06 14:58:15,140 - lava_callback - INFO - Starting async job submit for node 69d126f7691bac272b326236 2026-04-06 14:58:15,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:58:15,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d126f7691bac272b326236 HTTP/1.1" 200 None 2026-04-06 14:58:15,156 - lava_callback - DEBUG - Processing node 69d126f7691bac272b326236: baseline-arm64-baylibre 2026-04-06 14:58:15,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d126f7691bac272b326236 2026-04-06 14:58:15,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:56526 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 14:58:15,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d126f7691bac272b326236 HTTP/1.1" 200 None 2026-04-06 14:58:15,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:58:15,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 14:58:15,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:58:15,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d126f7691bac272b326236 HTTP/1.1" 200 None 2026-04-06 14:58:15,227 - lava_callback - ERROR - Error processing callback for node 69d126f7691bac272b326236: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57004 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 14:59:15,287 - lava_callback - INFO - Received callback for node 69d1273a691bac272b326279 INFO: 172.19.0.1:57014 - "POST /node/69d1273a691bac272b326279 HTTP/1.0" 202 Accepted 2026-04-06 14:59:15,292 - lava_callback - INFO - Starting async job submit for node 69d1273a691bac272b326279 2026-04-06 14:59:15,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:59:15,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1273a691bac272b326279 HTTP/1.1" 200 None 2026-04-06 14:59:15,308 - lava_callback - DEBUG - Processing node 69d1273a691bac272b326279: baseline-arm64-baylibre 2026-04-06 14:59:15,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1273a691bac272b326279 2026-04-06 14:59:15,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:59:15,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1273a691bac272b326279 HTTP/1.1" 200 None 2026-04-06 14:59:15,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:59:15,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 14:59:15,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 14:59:15,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1273a691bac272b326279 HTTP/1.1" 200 None 2026-04-06 14:59:15,364 - lava_callback - ERROR - Error processing callback for node 69d1273a691bac272b326279: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35896 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 15:00:15,269 - lava_callback - INFO - Received callback for node 69d1277a691bac272b3262d4 INFO: 172.19.0.1:35910 - "POST /node/69d1277a691bac272b3262d4 HTTP/1.0" 202 Accepted 2026-04-06 15:00:15,275 - lava_callback - INFO - Starting async job submit for node 69d1277a691bac272b3262d4 2026-04-06 15:00:15,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:00:15,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1277a691bac272b3262d4 HTTP/1.1" 200 None 2026-04-06 15:00:15,291 - lava_callback - DEBUG - Processing node 69d1277a691bac272b3262d4: baseline-arm64-baylibre 2026-04-06 15:00:15,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1277a691bac272b3262d4 2026-04-06 15:00:15,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:00:15,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1277a691bac272b3262d4 HTTP/1.1" 200 None 2026-04-06 15:00:15,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:00:15,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 15:00:15,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:00:15,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1277a691bac272b3262d4 HTTP/1.1" 200 None 2026-04-06 15:00:15,351 - lava_callback - ERROR - Error processing callback for node 69d1277a691bac272b3262d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48860 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:01:35,386 - lava_callback - INFO - Received callback for node 69d127bb691bac272b326325 INFO: 172.19.0.1:50540 - "POST /node/69d127bb691bac272b326325 HTTP/1.0" 202 Accepted 2026-04-06 15:01:35,395 - lava_callback - INFO - Starting async job submit for node 69d127bb691bac272b326325 2026-04-06 15:01:35,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:01:35,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d127bb691bac272b326325 HTTP/1.1" 200 None 2026-04-06 15:01:35,415 - lava_callback - DEBUG - Processing node 69d127bb691bac272b326325: baseline-arm64-baylibre 2026-04-06 15:01:35,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d127bb691bac272b326325 2026-04-06 15:01:35,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:01:35,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d127bb691bac272b326325 HTTP/1.1" 200 None 2026-04-06 15:01:35,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:01:35,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 15:01:35,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:01:35,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d127bb691bac272b326325 HTTP/1.1" 200 None 2026-04-06 15:01:35,499 - lava_callback - ERROR - Error processing callback for node 69d127bb691bac272b326325: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38202 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:02:35,375 - lava_callback - INFO - Received callback for node 69d12804691bac272b32633e INFO: 172.19.0.1:48348 - "POST /node/69d12804691bac272b32633e HTTP/1.0" 202 Accepted 2026-04-06 15:02:35,380 - lava_callback - INFO - Starting async job submit for node 69d12804691bac272b32633e 2026-04-06 15:02:35,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:02:35,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12804691bac272b32633e HTTP/1.1" 200 None 2026-04-06 15:02:35,397 - lava_callback - DEBUG - Processing node 69d12804691bac272b32633e: baseline-arm64-baylibre 2026-04-06 15:02:35,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12804691bac272b32633e 2026-04-06 15:02:35,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:02:35,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12804691bac272b32633e HTTP/1.1" 200 None 2026-04-06 15:02:35,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:02:35,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 15:02:35,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:02:35,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12804691bac272b32633e HTTP/1.1" 200 None 2026-04-06 15:02:35,457 - lava_callback - ERROR - Error processing callback for node 69d12804691bac272b32633e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38186 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:03:55,481 - lava_callback - INFO - Received callback for node 69d12847691bac272b326392 INFO: 172.19.0.1:45368 - "POST /node/69d12847691bac272b326392 HTTP/1.0" 202 Accepted 2026-04-06 15:03:55,490 - lava_callback - INFO - Starting async job submit for node 69d12847691bac272b326392 2026-04-06 15:03:55,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:03:55,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12847691bac272b326392 HTTP/1.1" 200 None 2026-04-06 15:03:55,513 - lava_callback - DEBUG - Processing node 69d12847691bac272b326392: baseline-arm64-baylibre 2026-04-06 15:03:55,513 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12847691bac272b326392 2026-04-06 15:03:55,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:03:55,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12847691bac272b326392 HTTP/1.1" 200 None 2026-04-06 15:03:55,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:03:55,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 15:03:55,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:03:55,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12847691bac272b326392 HTTP/1.1" 200 None 2026-04-06 15:03:55,577 - lava_callback - ERROR - Error processing callback for node 69d12847691bac272b326392: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36860 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:05:00,036 - lava_callback - INFO - Received callback for node 69d12895691bac272b3263a4 INFO: 172.19.0.1:37528 - "POST /node/69d12895691bac272b3263a4 HTTP/1.0" 202 Accepted 2026-04-06 15:05:00,042 - lava_callback - INFO - Starting async job submit for node 69d12895691bac272b3263a4 2026-04-06 15:05:00,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:05:00,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12895691bac272b3263a4 HTTP/1.1" 200 None 2026-04-06 15:05:00,059 - lava_callback - DEBUG - Processing node 69d12895691bac272b3263a4: baseline-arm64-clabbe 2026-04-06 15:05:00,059 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12895691bac272b3263a4 2026-04-06 15:05:00,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:05:00,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12895691bac272b3263a4 HTTP/1.1" 200 None 2026-04-06 15:05:00,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:05:00,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 15:05:00,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:05:00,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12895691bac272b3263a4 HTTP/1.1" 200 None 2026-04-06 15:05:00,132 - lava_callback - ERROR - Error processing callback for node 69d12895691bac272b3263a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55478 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:06:20,133 - lava_callback - INFO - Received callback for node 69d128db691bac272b3263e5 INFO: 172.19.0.1:55404 - "POST /node/69d128db691bac272b3263e5 HTTP/1.0" 202 Accepted 2026-04-06 15:06:20,142 - lava_callback - INFO - Starting async job submit for node 69d128db691bac272b3263e5 2026-04-06 15:06:20,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:06:20,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d128db691bac272b3263e5 HTTP/1.1" 200 None 2026-04-06 15:06:20,159 - lava_callback - DEBUG - Processing node 69d128db691bac272b3263e5: baseline-arm64-clabbe 2026-04-06 15:06:20,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d128db691bac272b3263e5 2026-04-06 15:06:20,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:06:20,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d128db691bac272b3263e5 HTTP/1.1" 200 None 2026-04-06 15:06:20,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:06:20,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 15:06:20,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:06:20,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d128db691bac272b3263e5 HTTP/1.1" 200 None 2026-04-06 15:06:20,218 - lava_callback - ERROR - Error processing callback for node 69d128db691bac272b3263e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43418 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:07:20,155 - lava_callback - INFO - Received callback for node 69d12922691bac272b326404 INFO: 172.19.0.1:37420 - "POST /node/69d12922691bac272b326404 HTTP/1.0" 202 Accepted 2026-04-06 15:07:20,163 - lava_callback - INFO - Starting async job submit for node 69d12922691bac272b326404 2026-04-06 15:07:20,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:07:20,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12922691bac272b326404 HTTP/1.1" 200 None 2026-04-06 15:07:20,180 - lava_callback - DEBUG - Processing node 69d12922691bac272b326404: baseline-arm64-clabbe 2026-04-06 15:07:20,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12922691bac272b326404 2026-04-06 15:07:20,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:07:20,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12922691bac272b326404 HTTP/1.1" 200 None 2026-04-06 15:07:20,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:07:20,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 15:07:20,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:07:20,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12922691bac272b326404 HTTP/1.1" 200 None 2026-04-06 15:07:20,238 - lava_callback - ERROR - Error processing callback for node 69d12922691bac272b326404: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52578 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:08:40,189 - lava_callback - INFO - Received callback for node 69d12964691bac272b32644e INFO: 172.19.0.1:42518 - "POST /node/69d12964691bac272b32644e HTTP/1.0" 202 Accepted 2026-04-06 15:08:40,194 - lava_callback - INFO - Starting async job submit for node 69d12964691bac272b32644e 2026-04-06 15:08:40,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:08:40,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12964691bac272b32644e HTTP/1.1" 200 None 2026-04-06 15:08:40,210 - lava_callback - DEBUG - Processing node 69d12964691bac272b32644e: baseline-arm64-clabbe 2026-04-06 15:08:40,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12964691bac272b32644e 2026-04-06 15:08:40,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:08:40,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12964691bac272b32644e HTTP/1.1" 200 None 2026-04-06 15:08:40,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:08:40,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 15:08:40,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:08:40,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12964691bac272b32644e HTTP/1.1" 200 None 2026-04-06 15:08:40,268 - lava_callback - ERROR - Error processing callback for node 69d12964691bac272b32644e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34260 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:09:40,204 - lava_callback - INFO - Received callback for node 69d129aa691bac272b326478 INFO: 172.19.0.1:56084 - "POST /node/69d129aa691bac272b326478 HTTP/1.0" 202 Accepted 2026-04-06 15:09:40,209 - lava_callback - INFO - Starting async job submit for node 69d129aa691bac272b326478 2026-04-06 15:09:40,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:09:40,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d129aa691bac272b326478 HTTP/1.1" 200 None 2026-04-06 15:09:40,226 - lava_callback - DEBUG - Processing node 69d129aa691bac272b326478: baseline-arm64-clabbe 2026-04-06 15:09:40,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d129aa691bac272b326478 2026-04-06 15:09:40,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:09:40,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d129aa691bac272b326478 HTTP/1.1" 200 None 2026-04-06 15:09:40,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:09:40,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 15:09:40,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:09:40,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d129aa691bac272b326478 HTTP/1.1" 200 None 2026-04-06 15:09:40,301 - lava_callback - ERROR - Error processing callback for node 69d129aa691bac272b326478: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41980 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:11:00,258 - lava_callback - INFO - Received callback for node 69d129f1691bac272b3264ab INFO: 172.19.0.1:39296 - "POST /node/69d129f1691bac272b3264ab HTTP/1.0" 202 Accepted 2026-04-06 15:11:00,264 - lava_callback - INFO - Starting async job submit for node 69d129f1691bac272b3264ab 2026-04-06 15:11:00,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:11:00,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d129f1691bac272b3264ab HTTP/1.1" 200 None 2026-04-06 15:11:00,279 - lava_callback - DEBUG - Processing node 69d129f1691bac272b3264ab: baseline-arm64-clabbe 2026-04-06 15:11:00,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d129f1691bac272b3264ab 2026-04-06 15:11:00,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:11:00,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d129f1691bac272b3264ab HTTP/1.1" 200 None 2026-04-06 15:11:00,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:11:00,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d0c910691bac272b322da1 HTTP/1.1" 200 None 2026-04-06 15:11:00,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:11:00,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d129f1691bac272b3264ab HTTP/1.1" 200 None 2026-04-06 15:11:00,342 - lava_callback - ERROR - Error processing callback for node 69d129f1691bac272b3264ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55238 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:11:56,107 - lava_callback - INFO - Received callback for node 69d12a28691bac272b3264d4 INFO: 172.19.0.1:38296 - "POST /node/69d12a28691bac272b3264d4 HTTP/1.0" 202 Accepted 2026-04-06 15:11:56,113 - lava_callback - INFO - Starting async job submit for node 69d12a28691bac272b3264d4 2026-04-06 15:11:56,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:11:56,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12a28691bac272b3264d4 HTTP/1.1" 200 None 2026-04-06 15:11:56,137 - lava_callback - DEBUG - Processing node 69d12a28691bac272b3264d4: baseline-arm-baylibre 2026-04-06 15:11:56,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12a28691bac272b3264d4 2026-04-06 15:11:56,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:11:56,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12a28691bac272b3264d4 HTTP/1.1" 200 None 2026-04-06 15:11:56,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:11:56,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:11:56,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:11:56,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12a28691bac272b3264d4 HTTP/1.1" 200 None 2026-04-06 15:11:56,229 - lava_callback - ERROR - Error processing callback for node 69d12a28691bac272b3264d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42592 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:12:20,300 - lava_callback - INFO - Received callback for node 69d12a49691bac272b3264f6 INFO: 172.19.0.1:47990 - "POST /node/69d12a49691bac272b3264f6 HTTP/1.0" 202 Accepted 2026-04-06 15:12:20,305 - lava_callback - INFO - Starting async job submit for node 69d12a49691bac272b3264f6 2026-04-06 15:12:20,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:12:20,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12a49691bac272b3264f6 HTTP/1.1" 200 None 2026-04-06 15:12:20,321 - lava_callback - DEBUG - Processing node 69d12a49691bac272b3264f6: baseline-arm-clabbe 2026-04-06 15:12:20,321 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12a49691bac272b3264f6 2026-04-06 15:12:20,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:12:20,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12a49691bac272b3264f6 HTTP/1.1" 200 None 2026-04-06 15:12:20,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:12:20,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:12:20,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:12:20,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12a49691bac272b3264f6 HTTP/1.1" 200 None 2026-04-06 15:12:20,373 - lava_callback - ERROR - Error processing callback for node 69d12a49691bac272b3264f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49738 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:13:00,258 - lava_callback - INFO - Received callback for node 69d12a68691bac272b326521 INFO: 172.19.0.1:42878 - "POST /node/69d12a68691bac272b326521 HTTP/1.0" 202 Accepted 2026-04-06 15:13:00,264 - lava_callback - INFO - Starting async job submit for node 69d12a68691bac272b326521 2026-04-06 15:13:00,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:13:00,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12a68691bac272b326521 HTTP/1.1" 200 None 2026-04-06 15:13:00,279 - lava_callback - DEBUG - Processing node 69d12a68691bac272b326521: baseline-arm-clabbe 2026-04-06 15:13:00,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12a68691bac272b326521 2026-04-06 15:13:00,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:13:00,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12a68691bac272b326521 HTTP/1.1" 200 None 2026-04-06 15:13:00,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:13:00,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:13:00,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:13:00,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12a68691bac272b326521 HTTP/1.1" 200 None 2026-04-06 15:13:00,331 - lava_callback - ERROR - Error processing callback for node 69d12a68691bac272b326521: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36178 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 15:13:16,049 - lava_callback - INFO - Received callback for node 69d12a8a691bac272b326535 INFO: 172.19.0.1:36186 - "POST /node/69d12a8a691bac272b326535 HTTP/1.0" 202 Accepted 2026-04-06 15:13:16,054 - lava_callback - INFO - Starting async job submit for node 69d12a8a691bac272b326535 2026-04-06 15:13:16,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:13:16,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12a8a691bac272b326535 HTTP/1.1" 200 None 2026-04-06 15:13:16,075 - lava_callback - DEBUG - Processing node 69d12a8a691bac272b326535: baseline-arm-baylibre 2026-04-06 15:13:16,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12a8a691bac272b326535 2026-04-06 15:13:16,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:13:16,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12a8a691bac272b326535 HTTP/1.1" 200 None 2026-04-06 15:13:16,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:13:16,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:13:16,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:13:16,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12a8a691bac272b326535 HTTP/1.1" 200 None 2026-04-06 15:13:16,131 - lava_callback - ERROR - Error processing callback for node 69d12a8a691bac272b326535: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37498 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:14:00,368 - lava_callback - INFO - Received callback for node 69d12aac691bac272b326552 INFO: 172.19.0.1:45524 - "POST /node/69d12aac691bac272b326552 HTTP/1.0" 202 Accepted 2026-04-06 15:14:00,376 - lava_callback - INFO - Starting async job submit for node 69d12aac691bac272b326552 2026-04-06 15:14:00,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:14:00,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12aac691bac272b326552 HTTP/1.1" 200 None 2026-04-06 15:14:00,391 - lava_callback - DEBUG - Processing node 69d12aac691bac272b326552: baseline-arm-clabbe 2026-04-06 15:14:00,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12aac691bac272b326552 2026-04-06 15:14:00,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:14:00,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12aac691bac272b326552 HTTP/1.1" 200 None 2026-04-06 15:14:00,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:14:00,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:14:00,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:14:00,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12aac691bac272b326552 HTTP/1.1" 200 None 2026-04-06 15:14:00,455 - lava_callback - ERROR - Error processing callback for node 69d12aac691bac272b326552: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54738 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:14:40,355 - lava_callback - INFO - Received callback for node 69d12ad1691bac272b326564 INFO: 172.19.0.1:52032 - "POST /node/69d12ad1691bac272b326564 HTTP/1.0" 202 Accepted 2026-04-06 15:14:40,361 - lava_callback - INFO - Starting async job submit for node 69d12ad1691bac272b326564 2026-04-06 15:14:40,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:14:40,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12ad1691bac272b326564 HTTP/1.1" 200 None 2026-04-06 15:14:40,379 - lava_callback - DEBUG - Processing node 69d12ad1691bac272b326564: baseline-arm-clabbe 2026-04-06 15:14:40,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12ad1691bac272b326564 2026-04-06 15:14:40,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:14:40,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12ad1691bac272b326564 HTTP/1.1" 200 None 2026-04-06 15:14:40,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:14:40,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:14:40,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:14:40,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12ad1691bac272b326564 HTTP/1.1" 200 None 2026-04-06 15:14:40,444 - lava_callback - ERROR - Error processing callback for node 69d12ad1691bac272b326564: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43106 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:15:20,417 - lava_callback - INFO - Received callback for node 69d12af5691bac272b326579 INFO: 172.19.0.1:33704 - "POST /node/69d12af5691bac272b326579 HTTP/1.0" 202 Accepted 2026-04-06 15:15:20,423 - lava_callback - INFO - Starting async job submit for node 69d12af5691bac272b326579 2026-04-06 15:15:20,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:15:20,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12af5691bac272b326579 HTTP/1.1" 200 None 2026-04-06 15:15:20,439 - lava_callback - DEBUG - Processing node 69d12af5691bac272b326579: baseline-arm-clabbe 2026-04-06 15:15:20,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12af5691bac272b326579 2026-04-06 15:15:20,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:15:20,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12af5691bac272b326579 HTTP/1.1" 200 None 2026-04-06 15:15:20,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:15:20,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:15:20,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:15:20,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12af5691bac272b326579 HTTP/1.1" 200 None 2026-04-06 15:15:20,505 - lava_callback - ERROR - Error processing callback for node 69d12af5691bac272b326579: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35620 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:15:40,396 - lava_callback - INFO - Received callback for node 69d12b17691bac272b326594 INFO: 172.19.0.1:60404 - "POST /node/69d12b17691bac272b326594 HTTP/1.0" 202 Accepted 2026-04-06 15:15:40,402 - lava_callback - INFO - Starting async job submit for node 69d12b17691bac272b326594 2026-04-06 15:15:40,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:15:40,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12b17691bac272b326594 HTTP/1.1" 200 None 2026-04-06 15:15:40,423 - lava_callback - DEBUG - Processing node 69d12b17691bac272b326594: baseline-arm-clabbe 2026-04-06 15:15:40,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12b17691bac272b326594 2026-04-06 15:15:40,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:15:40,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12b17691bac272b326594 HTTP/1.1" 200 None 2026-04-06 15:15:40,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:15:40,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:15:40,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:15:40,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12b17691bac272b326594 HTTP/1.1" 200 None 2026-04-06 15:15:40,490 - lava_callback - ERROR - Error processing callback for node 69d12b17691bac272b326594: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48938 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:16:20,480 - lava_callback - INFO - Received callback for node 69d12b3d691bac272b32659f INFO: 172.19.0.1:40360 - "POST /node/69d12b3d691bac272b32659f HTTP/1.0" 202 Accepted 2026-04-06 15:16:20,486 - lava_callback - INFO - Starting async job submit for node 69d12b3d691bac272b32659f 2026-04-06 15:16:20,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:16:20,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12b3d691bac272b32659f HTTP/1.1" 200 None 2026-04-06 15:16:20,502 - lava_callback - DEBUG - Processing node 69d12b3d691bac272b32659f: baseline-arm-clabbe 2026-04-06 15:16:20,503 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12b3d691bac272b32659f 2026-04-06 15:16:20,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:16:20,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12b3d691bac272b32659f HTTP/1.1" 200 None 2026-04-06 15:16:20,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:16:20,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:16:20,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:16:20,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12b3d691bac272b32659f HTTP/1.1" 200 None 2026-04-06 15:16:20,573 - lava_callback - ERROR - Error processing callback for node 69d12b3d691bac272b32659f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37162 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:16:56,274 - lava_callback - INFO - Received callback for node 69d12b5d691bac272b3265bb INFO: 172.19.0.1:53342 - "POST /node/69d12b5d691bac272b3265bb HTTP/1.0" 202 Accepted 2026-04-06 15:16:56,280 - lava_callback - INFO - Starting async job submit for node 69d12b5d691bac272b3265bb 2026-04-06 15:16:56,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:16:56,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12b5d691bac272b3265bb HTTP/1.1" 200 None 2026-04-06 15:16:56,295 - lava_callback - DEBUG - Processing node 69d12b5d691bac272b3265bb: baseline-arm-baylibre 2026-04-06 15:16:56,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12b5d691bac272b3265bb 2026-04-06 15:16:56,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:16:56,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12b5d691bac272b3265bb HTTP/1.1" 200 None 2026-04-06 15:16:56,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:16:56,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:16:56,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:16:56,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12b5d691bac272b3265bb HTTP/1.1" 200 None 2026-04-06 15:16:56,348 - lava_callback - ERROR - Error processing callback for node 69d12b5d691bac272b3265bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33748 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:17:40,538 - lava_callback - INFO - Received callback for node 69d12b82691bac272b3265ce INFO: 172.19.0.1:50576 - "POST /node/69d12b82691bac272b3265ce HTTP/1.0" 202 Accepted 2026-04-06 15:17:40,544 - lava_callback - INFO - Starting async job submit for node 69d12b82691bac272b3265ce 2026-04-06 15:17:40,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:17:40,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12b82691bac272b3265ce HTTP/1.1" 200 None 2026-04-06 15:17:40,560 - lava_callback - DEBUG - Processing node 69d12b82691bac272b3265ce: baseline-arm-clabbe 2026-04-06 15:17:40,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12b82691bac272b3265ce 2026-04-06 15:17:40,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:17:40,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12b82691bac272b3265ce HTTP/1.1" 200 None 2026-04-06 15:17:40,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:17:40,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:17:40,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:17:40,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12b82691bac272b3265ce HTTP/1.1" 200 None 2026-04-06 15:17:40,628 - lava_callback - ERROR - Error processing callback for node 69d12b82691bac272b3265ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34144 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:18:00,523 - lava_callback - INFO - Received callback for node 69d12b9f691bac272b3265ec INFO: 172.19.0.1:58706 - "POST /node/69d12b9f691bac272b3265ec HTTP/1.0" 202 Accepted 2026-04-06 15:18:00,529 - lava_callback - INFO - Starting async job submit for node 69d12b9f691bac272b3265ec 2026-04-06 15:18:00,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:00,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12b9f691bac272b3265ec HTTP/1.1" 200 None 2026-04-06 15:18:00,545 - lava_callback - DEBUG - Processing node 69d12b9f691bac272b3265ec: baseline-arm-clabbe 2026-04-06 15:18:00,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12b9f691bac272b3265ec 2026-04-06 15:18:00,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:00,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12b9f691bac272b3265ec HTTP/1.1" 200 None 2026-04-06 15:18:00,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:00,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:18:00,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:00,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12b9f691bac272b3265ec HTTP/1.1" 200 None 2026-04-06 15:18:00,607 - lava_callback - ERROR - Error processing callback for node 69d12b9f691bac272b3265ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56246 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:18:36,343 - lava_callback - INFO - Received callback for node 69d12bb8691bac272b326620 INFO: 172.19.0.1:37284 - "POST /node/69d12bb8691bac272b326620 HTTP/1.0" 202 Accepted 2026-04-06 15:18:36,349 - lava_callback - INFO - Starting async job submit for node 69d12bb8691bac272b326620 2026-04-06 15:18:36,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:36,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12bb8691bac272b326620 HTTP/1.1" 200 None 2026-04-06 15:18:36,364 - lava_callback - DEBUG - Processing node 69d12bb8691bac272b326620: baseline-arm-baylibre 2026-04-06 15:18:36,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12bb8691bac272b326620 2026-04-06 15:18:36,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:36,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12bb8691bac272b326620 HTTP/1.1" 200 None 2026-04-06 15:18:36,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:36,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:18:36,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:36,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12bb8691bac272b326620 HTTP/1.1" 200 None 2026-04-06 15:18:36,459 - lava_callback - ERROR - Error processing callback for node 69d12bb8691bac272b326620: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45666 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:18:56,280 - lava_callback - INFO - Received callback for node 69d12bd5691bac272b326658 INFO: 172.19.0.1:53214 - "POST /node/69d12bd5691bac272b326658 HTTP/1.0" 202 Accepted 2026-04-06 15:18:56,289 - lava_callback - INFO - Starting async job submit for node 69d12bd5691bac272b326658 2026-04-06 15:18:56,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:56,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12bd5691bac272b326658 HTTP/1.1" 200 None 2026-04-06 15:18:56,338 - lava_callback - DEBUG - Processing node 69d12bd5691bac272b326658: baseline-arm-baylibre 2026-04-06 15:18:56,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12bd5691bac272b326658 2026-04-06 15:18:56,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:56,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12bd5691bac272b326658 HTTP/1.1" 200 None 2026-04-06 15:18:56,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:56,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:18:56,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:18:56,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12bd5691bac272b326658 HTTP/1.1" 200 None 2026-04-06 15:18:56,399 - lava_callback - ERROR - Error processing callback for node 69d12bd5691bac272b326658: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60054 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:19:40,660 - lava_callback - INFO - Received callback for node 69d12bfc691bac272b32667e INFO: 172.19.0.1:33136 - "POST /node/69d12bfc691bac272b32667e HTTP/1.0" 202 Accepted 2026-04-06 15:19:40,666 - lava_callback - INFO - Starting async job submit for node 69d12bfc691bac272b32667e 2026-04-06 15:19:40,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:19:40,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12bfc691bac272b32667e HTTP/1.1" 200 None 2026-04-06 15:19:40,682 - lava_callback - DEBUG - Processing node 69d12bfc691bac272b32667e: baseline-arm-clabbe 2026-04-06 15:19:40,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12bfc691bac272b32667e 2026-04-06 15:19:40,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:19:40,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12bfc691bac272b32667e HTTP/1.1" 200 None 2026-04-06 15:19:40,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:19:40,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-06 15:19:40,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:19:40,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12bfc691bac272b32667e HTTP/1.1" 200 None 2026-04-06 15:19:40,739 - lava_callback - ERROR - Error processing callback for node 69d12bfc691bac272b32667e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33150 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:19:56,354 - lava_callback - INFO - Received callback for node 69d12c17691bac272b32668a INFO: 172.19.0.1:40616 - "POST /node/69d12c17691bac272b32668a HTTP/1.0" 202 Accepted 2026-04-06 15:19:56,359 - lava_callback - INFO - Starting async job submit for node 69d12c17691bac272b32668a 2026-04-06 15:19:56,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:19:56,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12c17691bac272b32668a HTTP/1.1" 200 None 2026-04-06 15:19:56,384 - lava_callback - DEBUG - Processing node 69d12c17691bac272b32668a: baseline-arm-baylibre 2026-04-06 15:19:56,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12c17691bac272b32668a 2026-04-06 15:19:56,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:19:56,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12c17691bac272b32668a HTTP/1.1" 200 None 2026-04-06 15:19:56,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:19:56,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:19:56,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:19:56,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12c17691bac272b32668a HTTP/1.1" 200 None 2026-04-06 15:19:56,448 - lava_callback - ERROR - Error processing callback for node 69d12c17691bac272b32668a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58084 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:20:36,361 - lava_callback - INFO - Received callback for node 69d12c39691bac272b3266c0 INFO: 172.19.0.1:41974 - "POST /node/69d12c39691bac272b3266c0 HTTP/1.0" 202 Accepted 2026-04-06 15:20:36,370 - lava_callback - INFO - Starting async job submit for node 69d12c39691bac272b3266c0 2026-04-06 15:20:36,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:20:36,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12c39691bac272b3266c0 HTTP/1.1" 200 None 2026-04-06 15:20:36,397 - lava_callback - DEBUG - Processing node 69d12c39691bac272b3266c0: baseline-arm-baylibre 2026-04-06 15:20:36,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12c39691bac272b3266c0 2026-04-06 15:20:36,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:20:36,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12c39691bac272b3266c0 HTTP/1.1" 200 None 2026-04-06 15:20:36,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:20:36,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:20:36,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:20:36,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12c39691bac272b3266c0 HTTP/1.1" 200 None 2026-04-06 15:20:36,497 - lava_callback - ERROR - Error processing callback for node 69d12c39691bac272b3266c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57782 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 15:21:16,414 - lava_callback - INFO - Received callback for node 69d12c5c691bac272b3266ca INFO: 172.19.0.1:57794 - "POST /node/69d12c5c691bac272b3266ca HTTP/1.0" 202 Accepted 2026-04-06 15:21:16,421 - lava_callback - INFO - Starting async job submit for node 69d12c5c691bac272b3266ca 2026-04-06 15:21:16,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:21:16,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12c5c691bac272b3266ca HTTP/1.1" 200 None 2026-04-06 15:21:16,465 - lava_callback - DEBUG - Processing node 69d12c5c691bac272b3266ca: baseline-arm-baylibre 2026-04-06 15:21:16,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12c5c691bac272b3266ca 2026-04-06 15:21:16,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:21:16,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12c5c691bac272b3266ca HTTP/1.1" 200 None 2026-04-06 15:21:16,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:57798 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:21:16,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:21:16,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:21:16,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12c5c691bac272b3266ca HTTP/1.1" 200 None 2026-04-06 15:21:16,524 - lava_callback - ERROR - Error processing callback for node 69d12c5c691bac272b3266ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60912 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:21:56,457 - lava_callback - INFO - Received callback for node 69d12c80691bac272b3266e8 INFO: 172.19.0.1:38652 - "POST /node/69d12c80691bac272b3266e8 HTTP/1.0" 202 Accepted 2026-04-06 15:21:56,462 - lava_callback - INFO - Starting async job submit for node 69d12c80691bac272b3266e8 2026-04-06 15:21:56,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:21:56,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12c80691bac272b3266e8 HTTP/1.1" 200 None 2026-04-06 15:21:56,478 - lava_callback - DEBUG - Processing node 69d12c80691bac272b3266e8: baseline-arm-baylibre 2026-04-06 15:21:56,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12c80691bac272b3266e8 2026-04-06 15:21:56,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:21:56,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12c80691bac272b3266e8 HTTP/1.1" 200 None 2026-04-06 15:21:56,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:38662 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:21:56,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:21:56,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:21:56,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12c80691bac272b3266e8 HTTP/1.1" 200 None 2026-04-06 15:21:56,530 - lava_callback - ERROR - Error processing callback for node 69d12c80691bac272b3266e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35024 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-06 15:22:16,479 - lava_callback - INFO - Received callback for node 69d12c9f691bac272b32670d INFO: 172.19.0.1:35032 - "POST /node/69d12c9f691bac272b32670d HTTP/1.0" 202 Accepted 2026-04-06 15:22:16,488 - lava_callback - INFO - Starting async job submit for node 69d12c9f691bac272b32670d 2026-04-06 15:22:16,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:22:16,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12c9f691bac272b32670d HTTP/1.1" 200 None 2026-04-06 15:22:16,508 - lava_callback - DEBUG - Processing node 69d12c9f691bac272b32670d: baseline-arm-baylibre 2026-04-06 15:22:16,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12c9f691bac272b32670d 2026-04-06 15:22:16,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:35040 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:22:16,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12c9f691bac272b32670d HTTP/1.1" 200 None 2026-04-06 15:22:16,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:22:16,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:22:16,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:22:16,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12c9f691bac272b32670d HTTP/1.1" 200 None 2026-04-06 15:22:16,571 - lava_callback - ERROR - Error processing callback for node 69d12c9f691bac272b32670d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45852 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:23:00,824 - lava_callback - INFO - Received callback for node 69d12cc3691bac272b32672c INFO: 172.19.0.1:39984 - "POST /node/69d12cc3691bac272b32672c HTTP/1.0" 202 Accepted 2026-04-06 15:23:00,831 - lava_callback - INFO - Starting async job submit for node 69d12cc3691bac272b32672c 2026-04-06 15:23:00,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:23:00,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12cc3691bac272b32672c HTTP/1.1" 200 None 2026-04-06 15:23:00,856 - lava_callback - DEBUG - Processing node 69d12cc3691bac272b32672c: baseline-arm-clabbe 2026-04-06 15:23:00,856 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12cc3691bac272b32672c 2026-04-06 15:23:00,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:23:00,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12cc3691bac272b32672c HTTP/1.1" 200 None 2026-04-06 15:23:00,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:23:00,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:23:00,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:23:00,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12cc3691bac272b32672c HTTP/1.1" 200 None 2026-04-06 15:23:00,920 - lava_callback - ERROR - Error processing callback for node 69d12cc3691bac272b32672c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56276 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:23:16,552 - lava_callback - INFO - Received callback for node 69d12cde691bac272b326758 INFO: 172.19.0.1:56292 - "POST /node/69d12cde691bac272b326758 HTTP/1.0" 202 Accepted 2026-04-06 15:23:16,558 - lava_callback - INFO - Starting async job submit for node 69d12cde691bac272b326758 2026-04-06 15:23:16,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:23:16,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12cde691bac272b326758 HTTP/1.1" 200 None 2026-04-06 15:23:16,575 - lava_callback - DEBUG - Processing node 69d12cde691bac272b326758: baseline-arm-baylibre 2026-04-06 15:23:16,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12cde691bac272b326758 2026-04-06 15:23:16,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:23:16,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12cde691bac272b326758 HTTP/1.1" 200 None 2026-04-06 15:23:16,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:23:16,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:23:16,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:23:16,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12cde691bac272b326758 HTTP/1.1" 200 None 2026-04-06 15:23:16,641 - lava_callback - ERROR - Error processing callback for node 69d12cde691bac272b326758: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47502 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:24:00,880 - lava_callback - INFO - Received callback for node 69d12d04691bac272b32676e INFO: 172.19.0.1:59240 - "POST /node/69d12d04691bac272b32676e HTTP/1.0" 202 Accepted 2026-04-06 15:24:00,887 - lava_callback - INFO - Starting async job submit for node 69d12d04691bac272b32676e 2026-04-06 15:24:00,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:24:00,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12d04691bac272b32676e HTTP/1.1" 200 None 2026-04-06 15:24:00,903 - lava_callback - DEBUG - Processing node 69d12d04691bac272b32676e: baseline-arm-clabbe 2026-04-06 15:24:00,904 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12d04691bac272b32676e 2026-04-06 15:24:00,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:24:00,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12d04691bac272b32676e HTTP/1.1" 200 None 2026-04-06 15:24:00,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:24:00,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:24:00,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:24:00,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12d04691bac272b32676e HTTP/1.1" 200 None 2026-04-06 15:24:00,964 - lava_callback - ERROR - Error processing callback for node 69d12d04691bac272b32676e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54864 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:24:36,637 - lava_callback - INFO - Received callback for node 69d12d21691bac272b326787 INFO: 172.19.0.1:54878 - "POST /node/69d12d21691bac272b326787 HTTP/1.0" 202 Accepted 2026-04-06 15:24:36,643 - lava_callback - INFO - Starting async job submit for node 69d12d21691bac272b326787 2026-04-06 15:24:36,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:24:36,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12d21691bac272b326787 HTTP/1.1" 200 None 2026-04-06 15:24:36,661 - lava_callback - DEBUG - Processing node 69d12d21691bac272b326787: baseline-arm-baylibre 2026-04-06 15:24:36,661 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12d21691bac272b326787 2026-04-06 15:24:36,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:24:36,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12d21691bac272b326787 HTTP/1.1" 200 None 2026-04-06 15:24:36,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:24:36,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:24:36,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:24:36,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12d21691bac272b326787 HTTP/1.1" 200 None 2026-04-06 15:24:36,721 - lava_callback - ERROR - Error processing callback for node 69d12d21691bac272b326787: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44464 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:25:00,951 - lava_callback - INFO - Received callback for node 69d12d48691bac272b3267a2 INFO: 172.19.0.1:35370 - "POST /node/69d12d48691bac272b3267a2 HTTP/1.0" 202 Accepted 2026-04-06 15:25:00,960 - lava_callback - INFO - Starting async job submit for node 69d12d48691bac272b3267a2 2026-04-06 15:25:00,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:25:00,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12d48691bac272b3267a2 HTTP/1.1" 200 None 2026-04-06 15:25:00,979 - lava_callback - DEBUG - Processing node 69d12d48691bac272b3267a2: baseline-arm-clabbe 2026-04-06 15:25:00,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12d48691bac272b3267a2 2026-04-06 15:25:00,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:25:01,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12d48691bac272b3267a2 HTTP/1.1" 200 None 2026-04-06 15:25:01,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:25:01,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:25:01,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:25:01,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12d48691bac272b3267a2 HTTP/1.1" 200 None 2026-04-06 15:25:01,050 - lava_callback - ERROR - Error processing callback for node 69d12d48691bac272b3267a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60940 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:25:40,966 - lava_callback - INFO - Received callback for node 69d12d66691bac272b3267ad INFO: 172.19.0.1:48214 - "POST /node/69d12d66691bac272b3267ad HTTP/1.0" 202 Accepted 2026-04-06 15:25:40,975 - lava_callback - INFO - Starting async job submit for node 69d12d66691bac272b3267ad 2026-04-06 15:25:40,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:25:41,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12d66691bac272b3267ad HTTP/1.1" 200 None 2026-04-06 15:25:41,001 - lava_callback - DEBUG - Processing node 69d12d66691bac272b3267ad: baseline-arm-clabbe 2026-04-06 15:25:41,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12d66691bac272b3267ad 2026-04-06 15:25:41,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:25:41,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12d66691bac272b3267ad HTTP/1.1" 200 None 2026-04-06 15:25:41,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:25:41,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:25:41,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:25:41,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12d66691bac272b3267ad HTTP/1.1" 200 None 2026-04-06 15:25:41,072 - lava_callback - ERROR - Error processing callback for node 69d12d66691bac272b3267ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36800 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:26:21,035 - lava_callback - INFO - Received callback for node 69d12d89691bac272b3267f3 INFO: 172.19.0.1:56930 - "POST /node/69d12d89691bac272b3267f3 HTTP/1.0" 202 Accepted 2026-04-06 15:26:21,045 - lava_callback - INFO - Starting async job submit for node 69d12d89691bac272b3267f3 2026-04-06 15:26:21,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:26:21,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12d89691bac272b3267f3 HTTP/1.1" 200 None 2026-04-06 15:26:21,067 - lava_callback - DEBUG - Processing node 69d12d89691bac272b3267f3: baseline-arm-clabbe 2026-04-06 15:26:21,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12d89691bac272b3267f3 2026-04-06 15:26:21,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:26:21,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12d89691bac272b3267f3 HTTP/1.1" 200 None 2026-04-06 15:26:21,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:26:21,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:26:21,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:26:21,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12d89691bac272b3267f3 HTTP/1.1" 200 None 2026-04-06 15:26:21,145 - lava_callback - ERROR - Error processing callback for node 69d12d89691bac272b3267f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60974 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:26:56,918 - lava_callback - INFO - Received callback for node 69d12dab691bac272b3267fb INFO: 172.19.0.1:60982 - "POST /node/69d12dab691bac272b3267fb HTTP/1.0" 202 Accepted 2026-04-06 15:26:56,924 - lava_callback - INFO - Starting async job submit for node 69d12dab691bac272b3267fb 2026-04-06 15:26:56,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:26:56,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12dab691bac272b3267fb HTTP/1.1" 200 None 2026-04-06 15:26:56,947 - lava_callback - DEBUG - Processing node 69d12dab691bac272b3267fb: baseline-arm-baylibre 2026-04-06 15:26:56,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12dab691bac272b3267fb 2026-04-06 15:26:56,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:26:56,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12dab691bac272b3267fb HTTP/1.1" 200 None 2026-04-06 15:26:56,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:26:56,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:26:56,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:26:57,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12dab691bac272b3267fb HTTP/1.1" 200 None 2026-04-06 15:26:57,013 - lava_callback - ERROR - Error processing callback for node 69d12dab691bac272b3267fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56562 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:27:21,077 - lava_callback - INFO - Received callback for node 69d12dd1691bac272b326806 INFO: 172.19.0.1:36946 - "POST /node/69d12dd1691bac272b326806 HTTP/1.0" 202 Accepted 2026-04-06 15:27:21,083 - lava_callback - INFO - Starting async job submit for node 69d12dd1691bac272b326806 2026-04-06 15:27:21,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:27:21,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12dd1691bac272b326806 HTTP/1.1" 200 None 2026-04-06 15:27:21,099 - lava_callback - DEBUG - Processing node 69d12dd1691bac272b326806: baseline-arm-clabbe 2026-04-06 15:27:21,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12dd1691bac272b326806 2026-04-06 15:27:21,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:27:21,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12dd1691bac272b326806 HTTP/1.1" 200 None 2026-04-06 15:27:21,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:27:21,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:27:21,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:27:21,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12dd1691bac272b326806 HTTP/1.1" 200 None 2026-04-06 15:27:21,167 - lava_callback - ERROR - Error processing callback for node 69d12dd1691bac272b326806: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39512 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:28:01,046 - lava_callback - INFO - Received callback for node 69d12dee691bac272b32682e INFO: 172.19.0.1:56498 - "POST /node/69d12dee691bac272b32682e HTTP/1.0" 202 Accepted 2026-04-06 15:28:01,054 - lava_callback - INFO - Starting async job submit for node 69d12dee691bac272b32682e 2026-04-06 15:28:01,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:28:01,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12dee691bac272b32682e HTTP/1.1" 200 None 2026-04-06 15:28:01,077 - lava_callback - DEBUG - Processing node 69d12dee691bac272b32682e: baseline-arm-clabbe 2026-04-06 15:28:01,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12dee691bac272b32682e 2026-04-06 15:28:01,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:28:01,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12dee691bac272b32682e HTTP/1.1" 200 None 2026-04-06 15:28:01,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:28:01,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:28:01,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:28:01,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12dee691bac272b32682e HTTP/1.1" 200 None 2026-04-06 15:28:01,156 - lava_callback - ERROR - Error processing callback for node 69d12dee691bac272b32682e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50370 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:28:21,102 - lava_callback - INFO - Received callback for node 69d12e11691bac272b32684d INFO: 172.19.0.1:37708 - "POST /node/69d12e11691bac272b32684d HTTP/1.0" 202 Accepted 2026-04-06 15:28:21,109 - lava_callback - INFO - Starting async job submit for node 69d12e11691bac272b32684d 2026-04-06 15:28:21,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:28:21,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12e11691bac272b32684d HTTP/1.1" 200 None 2026-04-06 15:28:21,130 - lava_callback - DEBUG - Processing node 69d12e11691bac272b32684d: baseline-arm-clabbe 2026-04-06 15:28:21,131 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12e11691bac272b32684d 2026-04-06 15:28:21,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:28:21,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12e11691bac272b32684d HTTP/1.1" 200 None 2026-04-06 15:28:21,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:28:21,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:28:21,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:28:21,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12e11691bac272b32684d HTTP/1.1" 200 None 2026-04-06 15:28:21,200 - lava_callback - ERROR - Error processing callback for node 69d12e11691bac272b32684d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37864 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:29:01,076 - lava_callback - INFO - Received callback for node 69d12e2f691bac272b326868 INFO: 172.19.0.1:38940 - "POST /node/69d12e2f691bac272b326868 HTTP/1.0" 202 Accepted 2026-04-06 15:29:01,082 - lava_callback - INFO - Starting async job submit for node 69d12e2f691bac272b326868 2026-04-06 15:29:01,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:29:01,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12e2f691bac272b326868 HTTP/1.1" 200 None 2026-04-06 15:29:01,099 - lava_callback - DEBUG - Processing node 69d12e2f691bac272b326868: baseline-arm-clabbe 2026-04-06 15:29:01,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12e2f691bac272b326868 2026-04-06 15:29:01,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:29:01,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12e2f691bac272b326868 HTTP/1.1" 200 None 2026-04-06 15:29:01,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:29:01,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:29:01,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:29:01,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12e2f691bac272b326868 HTTP/1.1" 200 None 2026-04-06 15:29:01,183 - lava_callback - ERROR - Error processing callback for node 69d12e2f691bac272b326868: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56212 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:29:21,123 - lava_callback - INFO - Received callback for node 69d12e4e691bac272b326899 INFO: 172.19.0.1:36800 - "POST /node/69d12e4e691bac272b326899 HTTP/1.0" 202 Accepted 2026-04-06 15:29:21,132 - lava_callback - INFO - Starting async job submit for node 69d12e4e691bac272b326899 2026-04-06 15:29:21,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:29:21,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12e4e691bac272b326899 HTTP/1.1" 200 None 2026-04-06 15:29:21,148 - lava_callback - DEBUG - Processing node 69d12e4e691bac272b326899: baseline-arm-clabbe 2026-04-06 15:29:21,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12e4e691bac272b326899 2026-04-06 15:29:21,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:29:21,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12e4e691bac272b326899 HTTP/1.1" 200 None 2026-04-06 15:29:21,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:29:21,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:29:21,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:29:21,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12e4e691bac272b326899 HTTP/1.1" 200 None 2026-04-06 15:29:21,218 - lava_callback - ERROR - Error processing callback for node 69d12e4e691bac272b326899: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35094 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:30:01,065 - lava_callback - INFO - Received callback for node 69d12e71691bac272b3268b3 INFO: 172.19.0.1:55762 - "POST /node/69d12e71691bac272b3268b3 HTTP/1.0" 202 Accepted 2026-04-06 15:30:01,072 - lava_callback - INFO - Starting async job submit for node 69d12e71691bac272b3268b3 2026-04-06 15:30:01,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:30:01,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12e71691bac272b3268b3 HTTP/1.1" 200 None 2026-04-06 15:30:01,098 - lava_callback - DEBUG - Processing node 69d12e71691bac272b3268b3: baseline-arm-clabbe 2026-04-06 15:30:01,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12e71691bac272b3268b3 2026-04-06 15:30:01,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:30:01,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12e71691bac272b3268b3 HTTP/1.1" 200 None 2026-04-06 15:30:01,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:30:01,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:30:01,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:30:01,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12e71691bac272b3268b3 HTTP/1.1" 200 None 2026-04-06 15:30:01,174 - lava_callback - ERROR - Error processing callback for node 69d12e71691bac272b3268b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56724 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:30:41,161 - lava_callback - INFO - Received callback for node 69d12e94691bac272b3268c8 INFO: 172.19.0.1:47340 - "POST /node/69d12e94691bac272b3268c8 HTTP/1.0" 202 Accepted 2026-04-06 15:30:41,167 - lava_callback - INFO - Starting async job submit for node 69d12e94691bac272b3268c8 2026-04-06 15:30:41,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:30:41,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12e94691bac272b3268c8 HTTP/1.1" 200 None 2026-04-06 15:30:41,184 - lava_callback - DEBUG - Processing node 69d12e94691bac272b3268c8: baseline-arm-clabbe 2026-04-06 15:30:41,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12e94691bac272b3268c8 2026-04-06 15:30:41,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:30:41,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12e94691bac272b3268c8 HTTP/1.1" 200 None 2026-04-06 15:30:41,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:30:41,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:30:41,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:30:41,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12e94691bac272b3268c8 HTTP/1.1" 200 None 2026-04-06 15:30:41,243 - lava_callback - ERROR - Error processing callback for node 69d12e94691bac272b3268c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34652 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:31:21,145 - lava_callback - INFO - Received callback for node 69d12eb3691bac272b3268e1 INFO: 172.19.0.1:55310 - "POST /node/69d12eb3691bac272b3268e1 HTTP/1.0" 202 Accepted 2026-04-06 15:31:21,151 - lava_callback - INFO - Starting async job submit for node 69d12eb3691bac272b3268e1 2026-04-06 15:31:21,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:31:21,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12eb3691bac272b3268e1 HTTP/1.1" 200 None 2026-04-06 15:31:21,174 - lava_callback - DEBUG - Processing node 69d12eb3691bac272b3268e1: baseline-arm-clabbe 2026-04-06 15:31:21,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12eb3691bac272b3268e1 2026-04-06 15:31:21,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:31:21,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12eb3691bac272b3268e1 HTTP/1.1" 200 None 2026-04-06 15:31:21,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:31:21,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:31:21,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:31:21,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12eb3691bac272b3268e1 HTTP/1.1" 200 None 2026-04-06 15:31:21,235 - lava_callback - ERROR - Error processing callback for node 69d12eb3691bac272b3268e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33374 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:31:41,239 - lava_callback - INFO - Received callback for node 69d12ed7691bac272b326914 INFO: 172.19.0.1:60496 - "POST /node/69d12ed7691bac272b326914 HTTP/1.0" 202 Accepted 2026-04-06 15:31:41,245 - lava_callback - INFO - Starting async job submit for node 69d12ed7691bac272b326914 2026-04-06 15:31:41,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:31:41,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12ed7691bac272b326914 HTTP/1.1" 200 None 2026-04-06 15:31:41,262 - lava_callback - DEBUG - Processing node 69d12ed7691bac272b326914: baseline-arm-clabbe 2026-04-06 15:31:41,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12ed7691bac272b326914 2026-04-06 15:31:41,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:31:41,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12ed7691bac272b326914 HTTP/1.1" 200 None 2026-04-06 15:31:41,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:31:41,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:31:41,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:31:41,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12ed7691bac272b326914 HTTP/1.1" 200 None 2026-04-06 15:31:41,328 - lava_callback - ERROR - Error processing callback for node 69d12ed7691bac272b326914: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50206 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:32:21,314 - lava_callback - INFO - Received callback for node 69d12efb691bac272b326926 INFO: 172.19.0.1:56584 - "POST /node/69d12efb691bac272b326926 HTTP/1.0" 202 Accepted 2026-04-06 15:32:21,320 - lava_callback - INFO - Starting async job submit for node 69d12efb691bac272b326926 2026-04-06 15:32:21,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:32:21,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12efb691bac272b326926 HTTP/1.1" 200 None 2026-04-06 15:32:21,336 - lava_callback - DEBUG - Processing node 69d12efb691bac272b326926: baseline-arm-clabbe 2026-04-06 15:32:21,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12efb691bac272b326926 2026-04-06 15:32:21,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:32:21,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12efb691bac272b326926 HTTP/1.1" 200 None 2026-04-06 15:32:21,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:32:21,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-06 15:32:21,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:32:21,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12efb691bac272b326926 HTTP/1.1" 200 None 2026-04-06 15:32:21,405 - lava_callback - ERROR - Error processing callback for node 69d12efb691bac272b326926: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37358 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:32:57,002 - lava_callback - INFO - Received callback for node 69d12f27691bac272b326930 INFO: 172.19.0.1:37366 - "POST /node/69d12f27691bac272b326930 HTTP/1.0" 202 Accepted 2026-04-06 15:32:57,008 - lava_callback - INFO - Starting async job submit for node 69d12f27691bac272b326930 2026-04-06 15:32:57,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:32:57,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12f27691bac272b326930 HTTP/1.1" 200 None 2026-04-06 15:32:57,023 - lava_callback - DEBUG - Processing node 69d12f27691bac272b326930: baseline-arm64-baylibre 2026-04-06 15:32:57,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12f27691bac272b326930 2026-04-06 15:32:57,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:32:57,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12f27691bac272b326930 HTTP/1.1" 200 None 2026-04-06 15:32:57,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:32:57,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:32:57,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:32:57,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12f27691bac272b326930 HTTP/1.1" 200 None 2026-04-06 15:32:57,085 - lava_callback - ERROR - Error processing callback for node 69d12f27691bac272b326930: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41714 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:34:17,092 - lava_callback - INFO - Received callback for node 69d12f6e691bac272b326958 INFO: 172.19.0.1:41730 - "POST /node/69d12f6e691bac272b326958 HTTP/1.0" 202 Accepted 2026-04-06 15:34:17,097 - lava_callback - INFO - Starting async job submit for node 69d12f6e691bac272b326958 2026-04-06 15:34:17,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:34:17,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12f6e691bac272b326958 HTTP/1.1" 200 None 2026-04-06 15:34:17,125 - lava_callback - DEBUG - Processing node 69d12f6e691bac272b326958: baseline-arm64-baylibre 2026-04-06 15:34:17,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12f6e691bac272b326958 2026-04-06 15:34:17,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:34:17,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12f6e691bac272b326958 HTTP/1.1" 200 None 2026-04-06 15:34:17,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:34:17,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:34:17,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:34:17,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12f6e691bac272b326958 HTTP/1.1" 200 None 2026-04-06 15:34:17,181 - lava_callback - ERROR - Error processing callback for node 69d12f6e691bac272b326958: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58654 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:35:37,407 - lava_callback - INFO - Received callback for node 69d12fb7691bac272b32696d INFO: 172.19.0.1:58658 - "POST /node/69d12fb7691bac272b32696d HTTP/1.0" 202 Accepted 2026-04-06 15:35:37,413 - lava_callback - INFO - Starting async job submit for node 69d12fb7691bac272b32696d 2026-04-06 15:35:37,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:35:37,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12fb7691bac272b32696d HTTP/1.1" 200 None 2026-04-06 15:35:37,430 - lava_callback - DEBUG - Processing node 69d12fb7691bac272b32696d: baseline-arm64-baylibre 2026-04-06 15:35:37,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12fb7691bac272b32696d 2026-04-06 15:35:37,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:35:37,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12fb7691bac272b32696d HTTP/1.1" 200 None 2026-04-06 15:35:37,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:35:37,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:35:37,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:35:37,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12fb7691bac272b32696d HTTP/1.1" 200 None 2026-04-06 15:35:37,524 - lava_callback - ERROR - Error processing callback for node 69d12fb7691bac272b32696d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45738 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:36:37,172 - lava_callback - INFO - Received callback for node 69d12ffa691bac272b3269a3 INFO: 172.19.0.1:45752 - "POST /node/69d12ffa691bac272b3269a3 HTTP/1.0" 202 Accepted 2026-04-06 15:36:37,178 - lava_callback - INFO - Starting async job submit for node 69d12ffa691bac272b3269a3 2026-04-06 15:36:37,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:36:37,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12ffa691bac272b3269a3 HTTP/1.1" 200 None 2026-04-06 15:36:37,193 - lava_callback - DEBUG - Processing node 69d12ffa691bac272b3269a3: baseline-arm64-baylibre 2026-04-06 15:36:37,193 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d12ffa691bac272b3269a3 2026-04-06 15:36:37,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:36:37,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d12ffa691bac272b3269a3 HTTP/1.1" 200 None 2026-04-06 15:36:37,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:36:37,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:36:37,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:36:37,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d12ffa691bac272b3269a3 HTTP/1.1" 200 None 2026-04-06 15:36:37,285 - lava_callback - ERROR - Error processing callback for node 69d12ffa691bac272b3269a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35500 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:37:37,311 - lava_callback - INFO - Received callback for node 69d1303c691bac272b3269fd INFO: 172.19.0.1:35502 - "POST /node/69d1303c691bac272b3269fd HTTP/1.0" 202 Accepted 2026-04-06 15:37:37,317 - lava_callback - INFO - Starting async job submit for node 69d1303c691bac272b3269fd 2026-04-06 15:37:37,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:37:37,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1303c691bac272b3269fd HTTP/1.1" 200 None 2026-04-06 15:37:37,340 - lava_callback - DEBUG - Processing node 69d1303c691bac272b3269fd: baseline-arm64-baylibre 2026-04-06 15:37:37,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1303c691bac272b3269fd 2026-04-06 15:37:37,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:37:37,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1303c691bac272b3269fd HTTP/1.1" 200 None 2026-04-06 15:37:37,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:37:37,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:37:37,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:37:37,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1303c691bac272b3269fd HTTP/1.1" 200 None 2026-04-06 15:37:37,411 - lava_callback - ERROR - Error processing callback for node 69d1303c691bac272b3269fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53292 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:38:57,355 - lava_callback - INFO - Received callback for node 69d13085691bac272b326a1a INFO: 172.19.0.1:53294 - "POST /node/69d13085691bac272b326a1a HTTP/1.0" 202 Accepted 2026-04-06 15:38:57,364 - lava_callback - INFO - Starting async job submit for node 69d13085691bac272b326a1a 2026-04-06 15:38:57,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:38:57,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13085691bac272b326a1a HTTP/1.1" 200 None 2026-04-06 15:38:57,381 - lava_callback - DEBUG - Processing node 69d13085691bac272b326a1a: baseline-arm64-baylibre 2026-04-06 15:38:57,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13085691bac272b326a1a 2026-04-06 15:38:57,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:38:57,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13085691bac272b326a1a HTTP/1.1" 200 None 2026-04-06 15:38:57,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:38:57,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:38:57,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:38:57,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13085691bac272b326a1a HTTP/1.1" 200 None 2026-04-06 15:38:57,449 - lava_callback - ERROR - Error processing callback for node 69d13085691bac272b326a1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41216 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:40:21,716 - lava_callback - INFO - Received callback for node 69d130cf691bac272b326a3a INFO: 172.19.0.1:44388 - "POST /node/69d130cf691bac272b326a3a HTTP/1.0" 202 Accepted 2026-04-06 15:40:21,722 - lava_callback - INFO - Starting async job submit for node 69d130cf691bac272b326a3a 2026-04-06 15:40:21,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:40:21,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d130cf691bac272b326a3a HTTP/1.1" 200 None 2026-04-06 15:40:21,738 - lava_callback - DEBUG - Processing node 69d130cf691bac272b326a3a: baseline-arm64-clabbe 2026-04-06 15:40:21,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d130cf691bac272b326a3a 2026-04-06 15:40:21,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:40:21,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d130cf691bac272b326a3a HTTP/1.1" 200 None 2026-04-06 15:40:21,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:40:21,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:40:21,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:40:21,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d130cf691bac272b326a3a HTTP/1.1" 200 None 2026-04-06 15:40:21,795 - lava_callback - ERROR - Error processing callback for node 69d130cf691bac272b326a3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58370 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:41:21,804 - lava_callback - INFO - Received callback for node 69d1310f691bac272b326a9a INFO: 172.19.0.1:37640 - "POST /node/69d1310f691bac272b326a9a HTTP/1.0" 202 Accepted 2026-04-06 15:41:21,810 - lava_callback - INFO - Starting async job submit for node 69d1310f691bac272b326a9a 2026-04-06 15:41:21,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:41:21,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1310f691bac272b326a9a HTTP/1.1" 200 None 2026-04-06 15:41:21,826 - lava_callback - DEBUG - Processing node 69d1310f691bac272b326a9a: baseline-arm64-clabbe 2026-04-06 15:41:21,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d1310f691bac272b326a9a 2026-04-06 15:41:21,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:41:21,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1310f691bac272b326a9a HTTP/1.1" 200 None 2026-04-06 15:41:21,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:41:21,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:41:21,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:41:21,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1310f691bac272b326a9a HTTP/1.1" 200 None 2026-04-06 15:41:21,886 - lava_callback - ERROR - Error processing callback for node 69d1310f691bac272b326a9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42582 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:42:21,820 - lava_callback - INFO - Received callback for node 69d13159691bac272b326ab3 INFO: 172.19.0.1:57506 - "POST /node/69d13159691bac272b326ab3 HTTP/1.0" 202 Accepted 2026-04-06 15:42:21,825 - lava_callback - INFO - Starting async job submit for node 69d13159691bac272b326ab3 2026-04-06 15:42:21,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:42:21,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13159691bac272b326ab3 HTTP/1.1" 200 None 2026-04-06 15:42:21,840 - lava_callback - DEBUG - Processing node 69d13159691bac272b326ab3: baseline-arm64-clabbe 2026-04-06 15:42:21,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13159691bac272b326ab3 2026-04-06 15:42:21,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:42:21,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13159691bac272b326ab3 HTTP/1.1" 200 None 2026-04-06 15:42:21,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:42:21,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:42:21,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:42:21,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13159691bac272b326ab3 HTTP/1.1" 200 None 2026-04-06 15:42:21,895 - lava_callback - ERROR - Error processing callback for node 69d13159691bac272b326ab3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52296 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:43:37,707 - lava_callback - INFO - Received callback for node 69d13196691bac272b326ae5 INFO: 172.19.0.1:52302 - "POST /node/69d13196691bac272b326ae5 HTTP/1.0" 202 Accepted 2026-04-06 15:43:37,715 - lava_callback - INFO - Starting async job submit for node 69d13196691bac272b326ae5 2026-04-06 15:43:37,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:43:37,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13196691bac272b326ae5 HTTP/1.1" 200 None 2026-04-06 15:43:37,743 - lava_callback - DEBUG - Processing node 69d13196691bac272b326ae5: baseline-arm64-baylibre 2026-04-06 15:43:37,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13196691bac272b326ae5 2026-04-06 15:43:37,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:43:37,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13196691bac272b326ae5 HTTP/1.1" 200 None 2026-04-06 15:43:37,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:43:37,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:43:37,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:43:37,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13196691bac272b326ae5 HTTP/1.1" 200 None 2026-04-06 15:43:37,817 - lava_callback - ERROR - Error processing callback for node 69d13196691bac272b326ae5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57762 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:44:37,687 - lava_callback - INFO - Received callback for node 69d131d7691bac272b326b21 INFO: 172.19.0.1:57766 - "POST /node/69d131d7691bac272b326b21 HTTP/1.0" 202 Accepted 2026-04-06 15:44:37,693 - lava_callback - INFO - Starting async job submit for node 69d131d7691bac272b326b21 2026-04-06 15:44:37,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:44:37,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d131d7691bac272b326b21 HTTP/1.1" 200 None 2026-04-06 15:44:37,707 - lava_callback - DEBUG - Processing node 69d131d7691bac272b326b21: baseline-arm64-baylibre 2026-04-06 15:44:37,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d131d7691bac272b326b21 2026-04-06 15:44:37,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:44:37,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d131d7691bac272b326b21 HTTP/1.1" 200 None 2026-04-06 15:44:37,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:44:37,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:44:37,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:44:37,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d131d7691bac272b326b21 HTTP/1.1" 200 None 2026-04-06 15:44:37,770 - lava_callback - ERROR - Error processing callback for node 69d131d7691bac272b326b21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35750 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:46:01,936 - lava_callback - INFO - Received callback for node 69d13228691bac272b326b48 INFO: 172.19.0.1:39346 - "POST /node/69d13228691bac272b326b48 HTTP/1.0" 202 Accepted 2026-04-06 15:46:01,941 - lava_callback - INFO - Starting async job submit for node 69d13228691bac272b326b48 2026-04-06 15:46:01,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:46:01,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13228691bac272b326b48 HTTP/1.1" 200 None 2026-04-06 15:46:01,958 - lava_callback - DEBUG - Processing node 69d13228691bac272b326b48: baseline-arm64-clabbe 2026-04-06 15:46:01,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13228691bac272b326b48 2026-04-06 15:46:01,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:46:01,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13228691bac272b326b48 HTTP/1.1" 200 None 2026-04-06 15:46:01,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:46:01,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:46:01,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:46:02,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13228691bac272b326b48 HTTP/1.1" 200 None 2026-04-06 15:46:02,015 - lava_callback - ERROR - Error processing callback for node 69d13228691bac272b326b48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34382 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:46:57,787 - lava_callback - INFO - Received callback for node 69d13264691bac272b326b8c INFO: 172.19.0.1:34396 - "POST /node/69d13264691bac272b326b8c HTTP/1.0" 202 Accepted 2026-04-06 15:46:57,793 - lava_callback - INFO - Starting async job submit for node 69d13264691bac272b326b8c 2026-04-06 15:46:57,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:46:57,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13264691bac272b326b8c HTTP/1.1" 200 None 2026-04-06 15:46:57,815 - lava_callback - DEBUG - Processing node 69d13264691bac272b326b8c: baseline-arm64-baylibre 2026-04-06 15:46:57,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13264691bac272b326b8c 2026-04-06 15:46:57,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:46:57,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13264691bac272b326b8c HTTP/1.1" 200 None 2026-04-06 15:46:57,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:46:57,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:46:57,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:46:57,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13264691bac272b326b8c HTTP/1.1" 200 None 2026-04-06 15:46:57,881 - lava_callback - ERROR - Error processing callback for node 69d13264691bac272b326b8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54972 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57268 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:48:57,934 - lava_callback - INFO - Received callback for node 69d132e4691bac272b326c0a INFO: 172.19.0.1:57278 - "POST /node/69d132e4691bac272b326c0a HTTP/1.0" 202 Accepted 2026-04-06 15:48:57,939 - lava_callback - INFO - Starting async job submit for node 69d132e4691bac272b326c0a 2026-04-06 15:48:57,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:48:57,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d132e4691bac272b326c0a HTTP/1.1" 200 None 2026-04-06 15:48:57,955 - lava_callback - DEBUG - Processing node 69d132e4691bac272b326c0a: baseline-arm64-baylibre 2026-04-06 15:48:57,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d132e4691bac272b326c0a 2026-04-06 15:48:57,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:48:57,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d132e4691bac272b326c0a HTTP/1.1" 200 None 2026-04-06 15:48:57,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:48:57,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:48:57,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:48:58,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d132e4691bac272b326c0a HTTP/1.1" 200 None 2026-04-06 15:48:58,017 - lava_callback - ERROR - Error processing callback for node 69d132e4691bac272b326c0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52874 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33542 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:49:57,968 - lava_callback - INFO - Received callback for node 69d13322691bac272b326c53 INFO: 172.19.0.1:33556 - "POST /node/69d13322691bac272b326c53 HTTP/1.0" 202 Accepted 2026-04-06 15:49:57,976 - lava_callback - INFO - Starting async job submit for node 69d13322691bac272b326c53 2026-04-06 15:49:57,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:49:58,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13322691bac272b326c53 HTTP/1.1" 200 None 2026-04-06 15:49:58,003 - lava_callback - DEBUG - Processing node 69d13322691bac272b326c53: baseline-arm64-baylibre 2026-04-06 15:49:58,003 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13322691bac272b326c53 2026-04-06 15:49:58,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:49:58,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13322691bac272b326c53 HTTP/1.1" 200 None 2026-04-06 15:49:58,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:49:58,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 15:49:58,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:49:58,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13322691bac272b326c53 HTTP/1.1" 200 None 2026-04-06 15:49:58,069 - lava_callback - ERROR - Error processing callback for node 69d13322691bac272b326c53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43222 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:52:18,115 - lava_callback - INFO - Received callback for node 69d133a6691bac272b326cf3 INFO: 172.19.0.1:43234 - "POST /node/69d133a6691bac272b326cf3 HTTP/1.0" 202 Accepted 2026-04-06 15:52:18,120 - lava_callback - INFO - Starting async job submit for node 69d133a6691bac272b326cf3 2026-04-06 15:52:18,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:52:18,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d133a6691bac272b326cf3 HTTP/1.1" 200 None 2026-04-06 15:52:18,136 - lava_callback - DEBUG - Processing node 69d133a6691bac272b326cf3: baseline-arm64-baylibre 2026-04-06 15:52:18,137 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d133a6691bac272b326cf3 2026-04-06 15:52:18,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:52:18,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d133a6691bac272b326cf3 HTTP/1.1" 200 None 2026-04-06 15:52:18,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:52:18,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 15:52:18,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:52:18,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d133a6691bac272b326cf3 HTTP/1.1" 200 None 2026-04-06 15:52:18,201 - lava_callback - ERROR - Error processing callback for node 69d133a6691bac272b326cf3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37428 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:53:38,206 - lava_callback - INFO - Received callback for node 69d133ed691bac272b326d19 INFO: 172.19.0.1:37436 - "POST /node/69d133ed691bac272b326d19 HTTP/1.0" 202 Accepted 2026-04-06 15:53:38,212 - lava_callback - INFO - Starting async job submit for node 69d133ed691bac272b326d19 2026-04-06 15:53:38,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:53:38,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d133ed691bac272b326d19 HTTP/1.1" 200 None 2026-04-06 15:53:38,227 - lava_callback - DEBUG - Processing node 69d133ed691bac272b326d19: baseline-arm64-baylibre 2026-04-06 15:53:38,227 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d133ed691bac272b326d19 2026-04-06 15:53:38,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:53:38,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d133ed691bac272b326d19 HTTP/1.1" 200 None 2026-04-06 15:53:38,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:53:38,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:53:38,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:53:38,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d133ed691bac272b326d19 HTTP/1.1" 200 None 2026-04-06 15:53:38,284 - lava_callback - ERROR - Error processing callback for node 69d133ed691bac272b326d19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46452 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:54:38,165 - lava_callback - INFO - Received callback for node 69d13432691bac272b326d59 INFO: 172.19.0.1:46454 - "POST /node/69d13432691bac272b326d59 HTTP/1.0" 202 Accepted 2026-04-06 15:54:38,171 - lava_callback - INFO - Starting async job submit for node 69d13432691bac272b326d59 2026-04-06 15:54:38,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:54:38,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13432691bac272b326d59 HTTP/1.1" 200 None 2026-04-06 15:54:38,186 - lava_callback - DEBUG - Processing node 69d13432691bac272b326d59: baseline-arm64-baylibre 2026-04-06 15:54:38,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13432691bac272b326d59 2026-04-06 15:54:38,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:54:38,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13432691bac272b326d59 HTTP/1.1" 200 None 2026-04-06 15:54:38,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:54:38,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:54:38,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:54:38,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13432691bac272b326d59 HTTP/1.1" 200 None 2026-04-06 15:54:38,273 - lava_callback - ERROR - Error processing callback for node 69d13432691bac272b326d59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42936 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:55:38,270 - lava_callback - INFO - Received callback for node 69d13472691bac272b326d94 INFO: 172.19.0.1:42942 - "POST /node/69d13472691bac272b326d94 HTTP/1.0" 202 Accepted 2026-04-06 15:55:38,277 - lava_callback - INFO - Starting async job submit for node 69d13472691bac272b326d94 2026-04-06 15:55:38,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:55:38,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13472691bac272b326d94 HTTP/1.1" 200 None 2026-04-06 15:55:38,301 - lava_callback - DEBUG - Processing node 69d13472691bac272b326d94: baseline-arm64-baylibre 2026-04-06 15:55:38,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13472691bac272b326d94 2026-04-06 15:55:38,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:55:38,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13472691bac272b326d94 HTTP/1.1" 200 None 2026-04-06 15:55:38,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:55:38,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 15:55:38,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:55:38,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13472691bac272b326d94 HTTP/1.1" 200 None 2026-04-06 15:55:38,356 - lava_callback - ERROR - Error processing callback for node 69d13472691bac272b326d94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46394 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:56:58,476 - lava_callback - INFO - Received callback for node 69d134b6691bac272b326ddb INFO: 172.19.0.1:46404 - "POST /node/69d134b6691bac272b326ddb HTTP/1.0" 202 Accepted 2026-04-06 15:56:58,483 - lava_callback - INFO - Starting async job submit for node 69d134b6691bac272b326ddb 2026-04-06 15:56:58,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:56:58,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d134b6691bac272b326ddb HTTP/1.1" 200 None 2026-04-06 15:56:58,500 - lava_callback - DEBUG - Processing node 69d134b6691bac272b326ddb: baseline-arm64-baylibre 2026-04-06 15:56:58,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d134b6691bac272b326ddb 2026-04-06 15:56:58,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:56:58,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d134b6691bac272b326ddb HTTP/1.1" 200 None 2026-04-06 15:56:58,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:56:58,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 15:56:58,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:56:58,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d134b6691bac272b326ddb HTTP/1.1" 200 None 2026-04-06 15:56:58,571 - lava_callback - ERROR - Error processing callback for node 69d134b6691bac272b326ddb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47534 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:57:58,374 - lava_callback - INFO - Received callback for node 69d134ff691bac272b326df7 INFO: 172.19.0.1:47548 - "POST /node/69d134ff691bac272b326df7 HTTP/1.0" 202 Accepted 2026-04-06 15:57:58,383 - lava_callback - INFO - Starting async job submit for node 69d134ff691bac272b326df7 2026-04-06 15:57:58,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:57:58,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d134ff691bac272b326df7 HTTP/1.1" 200 None 2026-04-06 15:57:58,408 - lava_callback - DEBUG - Processing node 69d134ff691bac272b326df7: baseline-arm64-baylibre 2026-04-06 15:57:58,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d134ff691bac272b326df7 2026-04-06 15:57:58,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:57:58,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d134ff691bac272b326df7 HTTP/1.1" 200 None 2026-04-06 15:57:58,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:57:58,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 15:57:58,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:57:58,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d134ff691bac272b326df7 HTTP/1.1" 200 None 2026-04-06 15:57:58,474 - lava_callback - ERROR - Error processing callback for node 69d134ff691bac272b326df7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36830 - "GET / HTTP/1.0" 200 OK 2026-04-06 15:59:02,594 - lava_callback - INFO - Received callback for node 69d13540691bac272b326e59 INFO: 172.19.0.1:36844 - "POST /node/69d13540691bac272b326e59 HTTP/1.0" 202 Accepted 2026-04-06 15:59:02,603 - lava_callback - INFO - Starting async job submit for node 69d13540691bac272b326e59 2026-04-06 15:59:02,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:59:02,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13540691bac272b326e59 HTTP/1.1" 200 None 2026-04-06 15:59:02,628 - lava_callback - DEBUG - Processing node 69d13540691bac272b326e59: baseline-arm64-clabbe 2026-04-06 15:59:02,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13540691bac272b326e59 2026-04-06 15:59:02,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:59:02,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13540691bac272b326e59 HTTP/1.1" 200 None 2026-04-06 15:59:02,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:59:02,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 15:59:02,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 15:59:02,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13540691bac272b326e59 HTTP/1.1" 200 None 2026-04-06 15:59:02,689 - lava_callback - ERROR - Error processing callback for node 69d13540691bac272b326e59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59344 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:00:22,621 - lava_callback - INFO - Received callback for node 69d13582691bac272b326eb3 INFO: 172.19.0.1:55014 - "POST /node/69d13582691bac272b326eb3 HTTP/1.0" 202 Accepted 2026-04-06 16:00:22,630 - lava_callback - INFO - Starting async job submit for node 69d13582691bac272b326eb3 2026-04-06 16:00:22,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:00:22,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13582691bac272b326eb3 HTTP/1.1" 200 None 2026-04-06 16:00:22,685 - lava_callback - DEBUG - Processing node 69d13582691bac272b326eb3: baseline-arm64-clabbe 2026-04-06 16:00:22,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13582691bac272b326eb3 2026-04-06 16:00:22,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:00:22,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13582691bac272b326eb3 HTTP/1.1" 200 None 2026-04-06 16:00:22,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:00:22,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 16:00:22,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:00:22,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13582691bac272b326eb3 HTTP/1.1" 200 None 2026-04-06 16:00:22,795 - lava_callback - ERROR - Error processing callback for node 69d13582691bac272b326eb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35502 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:01:22,683 - lava_callback - INFO - Received callback for node 69d135cb691bac272b326eda INFO: 172.19.0.1:39590 - "POST /node/69d135cb691bac272b326eda HTTP/1.0" 202 Accepted 2026-04-06 16:01:22,689 - lava_callback - INFO - Starting async job submit for node 69d135cb691bac272b326eda 2026-04-06 16:01:22,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:01:22,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d135cb691bac272b326eda HTTP/1.1" 200 None 2026-04-06 16:01:22,711 - lava_callback - DEBUG - Processing node 69d135cb691bac272b326eda: baseline-arm64-clabbe 2026-04-06 16:01:22,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d135cb691bac272b326eda 2026-04-06 16:01:22,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:01:22,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d135cb691bac272b326eda HTTP/1.1" 200 None 2026-04-06 16:01:22,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:01:22,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 16:01:22,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:01:22,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d135cb691bac272b326eda HTTP/1.1" 200 None 2026-04-06 16:01:22,777 - lava_callback - ERROR - Error processing callback for node 69d135cb691bac272b326eda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36214 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:02:42,762 - lava_callback - INFO - Received callback for node 69d13610691bac272b326f0a INFO: 172.19.0.1:38238 - "POST /node/69d13610691bac272b326f0a HTTP/1.0" 202 Accepted 2026-04-06 16:02:42,767 - lava_callback - INFO - Starting async job submit for node 69d13610691bac272b326f0a 2026-04-06 16:02:42,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:02:42,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13610691bac272b326f0a HTTP/1.1" 200 None 2026-04-06 16:02:42,782 - lava_callback - DEBUG - Processing node 69d13610691bac272b326f0a: baseline-arm64-clabbe 2026-04-06 16:02:42,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13610691bac272b326f0a 2026-04-06 16:02:42,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:02:42,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13610691bac272b326f0a HTTP/1.1" 200 None 2026-04-06 16:02:42,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:02:42,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 16:02:42,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:02:42,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13610691bac272b326f0a HTTP/1.1" 200 None 2026-04-06 16:02:42,845 - lava_callback - ERROR - Error processing callback for node 69d13610691bac272b326f0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43148 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:03:42,789 - lava_callback - INFO - Received callback for node 69d13657691bac272b326f43 INFO: 172.19.0.1:48086 - "POST /node/69d13657691bac272b326f43 HTTP/1.0" 202 Accepted 2026-04-06 16:03:42,799 - lava_callback - INFO - Starting async job submit for node 69d13657691bac272b326f43 2026-04-06 16:03:42,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:03:42,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13657691bac272b326f43 HTTP/1.1" 200 None 2026-04-06 16:03:42,816 - lava_callback - DEBUG - Processing node 69d13657691bac272b326f43: baseline-arm64-clabbe 2026-04-06 16:03:42,816 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13657691bac272b326f43 2026-04-06 16:03:42,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:03:42,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13657691bac272b326f43 HTTP/1.1" 200 None 2026-04-06 16:03:42,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:03:42,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 16:03:42,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:03:42,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13657691bac272b326f43 HTTP/1.1" 200 None 2026-04-06 16:03:42,878 - lava_callback - ERROR - Error processing callback for node 69d13657691bac272b326f43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57790 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:05:02,862 - lava_callback - INFO - Received callback for node 69d136a4691bac272b326f58 INFO: 172.19.0.1:57802 - "POST /node/69d136a4691bac272b326f58 HTTP/1.0" 202 Accepted 2026-04-06 16:05:02,868 - lava_callback - INFO - Starting async job submit for node 69d136a4691bac272b326f58 2026-04-06 16:05:02,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:05:02,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d136a4691bac272b326f58 HTTP/1.1" 200 None 2026-04-06 16:05:02,891 - lava_callback - DEBUG - Processing node 69d136a4691bac272b326f58: baseline-arm64-clabbe 2026-04-06 16:05:02,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d136a4691bac272b326f58 2026-04-06 16:05:02,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:05:02,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d136a4691bac272b326f58 HTTP/1.1" 200 None 2026-04-06 16:05:02,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:05:02,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 16:05:02,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:05:02,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d136a4691bac272b326f58 HTTP/1.1" 200 None 2026-04-06 16:05:02,951 - lava_callback - ERROR - Error processing callback for node 69d136a4691bac272b326f58: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39782 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:06:22,984 - lava_callback - INFO - Received callback for node 69d136ed691bac272b326f82 INFO: 172.19.0.1:45494 - "POST /node/69d136ed691bac272b326f82 HTTP/1.0" 202 Accepted 2026-04-06 16:06:22,990 - lava_callback - INFO - Starting async job submit for node 69d136ed691bac272b326f82 2026-04-06 16:06:22,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:06:23,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d136ed691bac272b326f82 HTTP/1.1" 200 None 2026-04-06 16:06:23,012 - lava_callback - DEBUG - Processing node 69d136ed691bac272b326f82: baseline-arm64-clabbe 2026-04-06 16:06:23,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d136ed691bac272b326f82 2026-04-06 16:06:23,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:06:23,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d136ed691bac272b326f82 HTTP/1.1" 200 None 2026-04-06 16:06:23,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:06:23,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 16:06:23,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:06:23,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d136ed691bac272b326f82 HTTP/1.1" 200 None 2026-04-06 16:06:23,080 - lava_callback - ERROR - Error processing callback for node 69d136ed691bac272b326f82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39520 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:07:22,968 - lava_callback - INFO - Received callback for node 69d13730691bac272b326fb5 INFO: 172.19.0.1:45460 - "POST /node/69d13730691bac272b326fb5 HTTP/1.0" 202 Accepted 2026-04-06 16:07:22,973 - lava_callback - INFO - Starting async job submit for node 69d13730691bac272b326fb5 2026-04-06 16:07:22,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:07:22,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13730691bac272b326fb5 HTTP/1.1" 200 None 2026-04-06 16:07:22,992 - lava_callback - DEBUG - Processing node 69d13730691bac272b326fb5: baseline-arm64-clabbe 2026-04-06 16:07:22,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13730691bac272b326fb5 2026-04-06 16:07:22,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:07:23,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13730691bac272b326fb5 HTTP/1.1" 200 None 2026-04-06 16:07:23,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:07:23,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 16:07:23,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:07:23,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13730691bac272b326fb5 HTTP/1.1" 200 None 2026-04-06 16:07:23,061 - lava_callback - ERROR - Error processing callback for node 69d13730691bac272b326fb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45508 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:08:22,984 - lava_callback - INFO - Received callback for node 69d13772691bac272b326ffd INFO: 172.19.0.1:45756 - "POST /node/69d13772691bac272b326ffd HTTP/1.0" 202 Accepted 2026-04-06 16:08:22,990 - lava_callback - INFO - Starting async job submit for node 69d13772691bac272b326ffd 2026-04-06 16:08:22,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:08:23,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13772691bac272b326ffd HTTP/1.1" 200 None 2026-04-06 16:08:23,012 - lava_callback - DEBUG - Processing node 69d13772691bac272b326ffd: baseline-arm64-clabbe 2026-04-06 16:08:23,012 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13772691bac272b326ffd 2026-04-06 16:08:23,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:08:23,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13772691bac272b326ffd HTTP/1.1" 200 None 2026-04-06 16:08:23,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:08:23,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 16:08:23,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:08:23,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13772691bac272b326ffd HTTP/1.1" 200 None 2026-04-06 16:08:23,083 - lava_callback - ERROR - Error processing callback for node 69d13772691bac272b326ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48368 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:09:39,026 - lava_callback - INFO - Received callback for node 69d137af691bac272b327033 INFO: 172.19.0.1:48376 - "POST /node/69d137af691bac272b327033 HTTP/1.0" 202 Accepted 2026-04-06 16:09:39,032 - lava_callback - INFO - Starting async job submit for node 69d137af691bac272b327033 2026-04-06 16:09:39,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:09:39,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d137af691bac272b327033 HTTP/1.1" 200 None 2026-04-06 16:09:39,048 - lava_callback - DEBUG - Processing node 69d137af691bac272b327033: baseline-arm64-baylibre 2026-04-06 16:09:39,048 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d137af691bac272b327033 2026-04-06 16:09:39,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:09:39,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d137af691bac272b327033 HTTP/1.1" 200 None 2026-04-06 16:09:39,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:09:39,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 16:09:39,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:09:39,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d137af691bac272b327033 HTTP/1.1" 200 None 2026-04-06 16:09:39,128 - lava_callback - ERROR - Error processing callback for node 69d137af691bac272b327033: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55244 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:10:43,111 - lava_callback - INFO - Received callback for node 69d13801691bac272b327055 INFO: 172.19.0.1:37768 - "POST /node/69d13801691bac272b327055 HTTP/1.0" 202 Accepted 2026-04-06 16:10:43,118 - lava_callback - INFO - Starting async job submit for node 69d13801691bac272b327055 2026-04-06 16:10:43,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:10:43,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13801691bac272b327055 HTTP/1.1" 200 None 2026-04-06 16:10:43,135 - lava_callback - DEBUG - Processing node 69d13801691bac272b327055: baseline-arm64-clabbe 2026-04-06 16:10:43,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13801691bac272b327055 2026-04-06 16:10:43,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:10:43,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13801691bac272b327055 HTTP/1.1" 200 None 2026-04-06 16:10:43,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:10:43,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 16:10:43,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:10:43,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13801691bac272b327055 HTTP/1.1" 200 None 2026-04-06 16:10:43,211 - lava_callback - ERROR - Error processing callback for node 69d13801691bac272b327055: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56136 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:12:03,185 - lava_callback - INFO - Received callback for node 69d13845691bac272b327087 INFO: 172.19.0.1:56138 - "POST /node/69d13845691bac272b327087 HTTP/1.0" 202 Accepted 2026-04-06 16:12:03,191 - lava_callback - INFO - Starting async job submit for node 69d13845691bac272b327087 2026-04-06 16:12:03,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:12:03,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13845691bac272b327087 HTTP/1.1" 200 None 2026-04-06 16:12:03,233 - lava_callback - DEBUG - Processing node 69d13845691bac272b327087: baseline-arm64-clabbe 2026-04-06 16:12:03,233 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13845691bac272b327087 2026-04-06 16:12:03,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:12:03,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13845691bac272b327087 HTTP/1.1" 200 None 2026-04-06 16:12:03,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:12:03,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 16:12:03,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:12:03,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13845691bac272b327087 HTTP/1.1" 200 None 2026-04-06 16:12:03,293 - lava_callback - ERROR - Error processing callback for node 69d13845691bac272b327087: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42166 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:12:59,166 - lava_callback - INFO - Received callback for node 69d13883691bac272b3270b4 INFO: 172.19.0.1:42172 - "POST /node/69d13883691bac272b3270b4 HTTP/1.0" 202 Accepted 2026-04-06 16:12:59,172 - lava_callback - INFO - Starting async job submit for node 69d13883691bac272b3270b4 2026-04-06 16:12:59,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:12:59,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13883691bac272b3270b4 HTTP/1.1" 200 None 2026-04-06 16:12:59,196 - lava_callback - DEBUG - Processing node 69d13883691bac272b3270b4: baseline-arm64-baylibre 2026-04-06 16:12:59,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d13883691bac272b3270b4 2026-04-06 16:12:59,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:12:59,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d13883691bac272b3270b4 HTTP/1.1" 200 None 2026-04-06 16:12:59,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:12:59,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-06 16:12:59,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:12:59,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d13883691bac272b3270b4 HTTP/1.1" 200 None 2026-04-06 16:12:59,276 - lava_callback - ERROR - Error processing callback for node 69d13883691bac272b3270b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46624 - "GET / HTTP/1.0" 200 OK 2026-04-06 16:14:19,347 - lava_callback - INFO - Received callback for node 69d138ce691bac272b3270d7 INFO: 172.19.0.1:46640 - "POST /node/69d138ce691bac272b3270d7 HTTP/1.0" 202 Accepted 2026-04-06 16:14:19,355 - lava_callback - INFO - Starting async job submit for node 69d138ce691bac272b3270d7 2026-04-06 16:14:19,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:14:19,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d138ce691bac272b3270d7 HTTP/1.1" 200 None 2026-04-06 16:14:19,378 - lava_callback - DEBUG - Processing node 69d138ce691bac272b3270d7: baseline-arm64-baylibre 2026-04-06 16:14:19,378 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69d138ce691bac272b3270d7 2026-04-06 16:14:19,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:14:19,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d138ce691bac272b3270d7 HTTP/1.1" 200 None 2026-04-06 16:14:19,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:14:19,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-06 16:14:19,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-06 16:14:19,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d138ce691bac272b3270d7 HTTP/1.1" 200 None 2026-04-06 16:14:19,451 - lava_callback - ERROR - Error processing callback for node 69d138ce691bac272b3270d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]